00:00:00.001 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v22.11" build number 968 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3635 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.059 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.060 The recommended git tool is: git 00:00:00.060 using credential 00000000-0000-0000-0000-000000000002 00:00:00.066 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.092 Fetching changes from the remote Git repository 00:00:00.094 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.127 Using shallow fetch with depth 1 00:00:00.127 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.127 > git --version # timeout=10 00:00:00.163 > git --version # 'git version 2.39.2' 00:00:00.163 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.192 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.192 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:03.974 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:03.986 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:03.998 Checking out Revision b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf (FETCH_HEAD) 00:00:03.998 > git config core.sparsecheckout # timeout=10 00:00:04.009 > git read-tree -mu HEAD # timeout=10 00:00:04.024 > git checkout -f b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf # timeout=5 00:00:04.042 Commit message: "jenkins/jjb-config: Ignore OS version mismatch under freebsd" 00:00:04.043 > git rev-list --no-walk b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf # timeout=10 00:00:04.122 [Pipeline] Start of Pipeline 00:00:04.134 [Pipeline] library 00:00:04.135 Loading library shm_lib@master 00:00:04.135 Library shm_lib@master is cached. Copying from home. 00:00:04.151 [Pipeline] node 00:00:04.159 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:04.160 [Pipeline] { 00:00:04.168 [Pipeline] catchError 00:00:04.170 [Pipeline] { 00:00:04.179 [Pipeline] wrap 00:00:04.187 [Pipeline] { 00:00:04.192 [Pipeline] stage 00:00:04.193 [Pipeline] { (Prologue) 00:00:04.382 [Pipeline] sh 00:00:04.666 + logger -p user.info -t JENKINS-CI 00:00:04.682 [Pipeline] echo 00:00:04.683 Node: GP11 00:00:04.690 [Pipeline] sh 00:00:04.993 [Pipeline] setCustomBuildProperty 00:00:05.004 [Pipeline] echo 00:00:05.006 Cleanup processes 00:00:05.011 [Pipeline] sh 00:00:05.296 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.296 987447 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.309 [Pipeline] sh 00:00:05.598 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.598 ++ grep -v 'sudo pgrep' 00:00:05.598 ++ awk '{print $1}' 00:00:05.598 + sudo kill -9 00:00:05.598 + true 00:00:05.612 [Pipeline] cleanWs 00:00:05.622 [WS-CLEANUP] Deleting project workspace... 00:00:05.622 [WS-CLEANUP] Deferred wipeout is used... 00:00:05.628 [WS-CLEANUP] done 00:00:05.630 [Pipeline] setCustomBuildProperty 00:00:05.641 [Pipeline] sh 00:00:05.923 + sudo git config --global --replace-all safe.directory '*' 00:00:05.992 [Pipeline] httpRequest 00:00:06.614 [Pipeline] echo 00:00:06.615 Sorcerer 10.211.164.20 is alive 00:00:06.622 [Pipeline] retry 00:00:06.624 [Pipeline] { 00:00:06.636 [Pipeline] httpRequest 00:00:06.640 HttpMethod: GET 00:00:06.640 URL: http://10.211.164.20/packages/jbp_b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf.tar.gz 00:00:06.641 Sending request to url: http://10.211.164.20/packages/jbp_b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf.tar.gz 00:00:06.645 Response Code: HTTP/1.1 200 OK 00:00:06.645 Success: Status code 200 is in the accepted range: 200,404 00:00:06.645 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf.tar.gz 00:00:07.721 [Pipeline] } 00:00:07.737 [Pipeline] // retry 00:00:07.744 [Pipeline] sh 00:00:08.029 + tar --no-same-owner -xf jbp_b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf.tar.gz 00:00:08.045 [Pipeline] httpRequest 00:00:08.855 [Pipeline] echo 00:00:08.857 Sorcerer 10.211.164.20 is alive 00:00:08.863 [Pipeline] retry 00:00:08.865 [Pipeline] { 00:00:08.874 [Pipeline] httpRequest 00:00:08.877 HttpMethod: GET 00:00:08.878 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:08.880 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:08.907 Response Code: HTTP/1.1 200 OK 00:00:08.907 Success: Status code 200 is in the accepted range: 200,404 00:00:08.908 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:08.230 [Pipeline] } 00:01:08.248 [Pipeline] // retry 00:01:08.255 [Pipeline] sh 00:01:08.542 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:11.878 [Pipeline] sh 00:01:12.169 + git -C spdk log --oneline -n5 00:01:12.169 c13c99a5e test: Various fixes for Fedora40 00:01:12.169 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:12.169 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:12.169 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:12.169 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:12.189 [Pipeline] withCredentials 00:01:12.201 > git --version # timeout=10 00:01:12.214 > git --version # 'git version 2.39.2' 00:01:12.233 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:01:12.235 [Pipeline] { 00:01:12.244 [Pipeline] retry 00:01:12.246 [Pipeline] { 00:01:12.261 [Pipeline] sh 00:01:12.546 + git ls-remote http://dpdk.org/git/dpdk-stable v22.11.4 00:01:12.820 [Pipeline] } 00:01:12.841 [Pipeline] // retry 00:01:12.845 [Pipeline] } 00:01:12.862 [Pipeline] // withCredentials 00:01:12.871 [Pipeline] httpRequest 00:01:13.337 [Pipeline] echo 00:01:13.339 Sorcerer 10.211.164.20 is alive 00:01:13.349 [Pipeline] retry 00:01:13.351 [Pipeline] { 00:01:13.367 [Pipeline] httpRequest 00:01:13.372 HttpMethod: GET 00:01:13.373 URL: http://10.211.164.20/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:13.375 Sending request to url: http://10.211.164.20/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:13.381 Response Code: HTTP/1.1 200 OK 00:01:13.381 Success: Status code 200 is in the accepted range: 200,404 00:01:13.382 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:30.381 [Pipeline] } 00:01:30.400 [Pipeline] // retry 00:01:30.409 [Pipeline] sh 00:01:30.699 + tar --no-same-owner -xf dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:32.614 [Pipeline] sh 00:01:32.903 + git -C dpdk log --oneline -n5 00:01:32.903 caf0f5d395 version: 22.11.4 00:01:32.903 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:32.903 dc9c799c7d vhost: fix missing spinlock unlock 00:01:32.903 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:32.903 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:32.915 [Pipeline] } 00:01:32.929 [Pipeline] // stage 00:01:32.938 [Pipeline] stage 00:01:32.941 [Pipeline] { (Prepare) 00:01:32.966 [Pipeline] writeFile 00:01:32.980 [Pipeline] sh 00:01:33.267 + logger -p user.info -t JENKINS-CI 00:01:33.278 [Pipeline] sh 00:01:33.558 + logger -p user.info -t JENKINS-CI 00:01:33.573 [Pipeline] sh 00:01:33.884 + cat autorun-spdk.conf 00:01:33.884 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:33.884 SPDK_TEST_NVMF=1 00:01:33.884 SPDK_TEST_NVME_CLI=1 00:01:33.884 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:33.884 SPDK_TEST_NVMF_NICS=e810 00:01:33.884 SPDK_TEST_VFIOUSER=1 00:01:33.884 SPDK_RUN_UBSAN=1 00:01:33.884 NET_TYPE=phy 00:01:33.884 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:33.884 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:33.892 RUN_NIGHTLY=1 00:01:33.898 [Pipeline] readFile 00:01:33.924 [Pipeline] withEnv 00:01:33.926 [Pipeline] { 00:01:33.940 [Pipeline] sh 00:01:34.231 + set -ex 00:01:34.231 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:34.231 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:34.231 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:34.231 ++ SPDK_TEST_NVMF=1 00:01:34.231 ++ SPDK_TEST_NVME_CLI=1 00:01:34.231 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:34.231 ++ SPDK_TEST_NVMF_NICS=e810 00:01:34.231 ++ SPDK_TEST_VFIOUSER=1 00:01:34.231 ++ SPDK_RUN_UBSAN=1 00:01:34.231 ++ NET_TYPE=phy 00:01:34.231 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:34.231 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:34.231 ++ RUN_NIGHTLY=1 00:01:34.231 + case $SPDK_TEST_NVMF_NICS in 00:01:34.231 + DRIVERS=ice 00:01:34.231 + [[ tcp == \r\d\m\a ]] 00:01:34.231 + [[ -n ice ]] 00:01:34.231 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:34.231 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:34.231 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:34.231 rmmod: ERROR: Module irdma is not currently loaded 00:01:34.231 rmmod: ERROR: Module i40iw is not currently loaded 00:01:34.231 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:34.231 + true 00:01:34.231 + for D in $DRIVERS 00:01:34.231 + sudo modprobe ice 00:01:34.231 + exit 0 00:01:34.242 [Pipeline] } 00:01:34.257 [Pipeline] // withEnv 00:01:34.260 [Pipeline] } 00:01:34.273 [Pipeline] // stage 00:01:34.282 [Pipeline] catchError 00:01:34.284 [Pipeline] { 00:01:34.305 [Pipeline] timeout 00:01:34.305 Timeout set to expire in 1 hr 0 min 00:01:34.307 [Pipeline] { 00:01:34.318 [Pipeline] stage 00:01:34.320 [Pipeline] { (Tests) 00:01:34.333 [Pipeline] sh 00:01:34.622 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:34.622 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:34.622 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:34.622 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:34.622 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:34.622 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:34.622 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:34.622 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:34.623 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:34.623 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:34.623 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:34.623 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:34.623 + source /etc/os-release 00:01:34.623 ++ NAME='Fedora Linux' 00:01:34.623 ++ VERSION='39 (Cloud Edition)' 00:01:34.623 ++ ID=fedora 00:01:34.623 ++ VERSION_ID=39 00:01:34.623 ++ VERSION_CODENAME= 00:01:34.623 ++ PLATFORM_ID=platform:f39 00:01:34.623 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:34.623 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:34.623 ++ LOGO=fedora-logo-icon 00:01:34.623 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:34.623 ++ HOME_URL=https://fedoraproject.org/ 00:01:34.623 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:34.623 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:34.623 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:34.623 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:34.623 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:34.623 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:34.623 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:34.623 ++ SUPPORT_END=2024-11-12 00:01:34.623 ++ VARIANT='Cloud Edition' 00:01:34.623 ++ VARIANT_ID=cloud 00:01:34.623 + uname -a 00:01:34.623 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:34.623 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:35.565 Hugepages 00:01:35.565 node hugesize free / total 00:01:35.565 node0 1048576kB 0 / 0 00:01:35.565 node0 2048kB 0 / 0 00:01:35.565 node1 1048576kB 0 / 0 00:01:35.565 node1 2048kB 0 / 0 00:01:35.565 00:01:35.565 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:35.565 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:35.565 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:35.565 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:35.565 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:35.565 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:35.565 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:35.824 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:35.824 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:35.824 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:35.824 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:35.824 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:35.824 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:35.824 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:35.824 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:35.824 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:35.824 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:35.824 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:35.824 + rm -f /tmp/spdk-ld-path 00:01:35.824 + source autorun-spdk.conf 00:01:35.824 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:35.824 ++ SPDK_TEST_NVMF=1 00:01:35.824 ++ SPDK_TEST_NVME_CLI=1 00:01:35.824 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:35.824 ++ SPDK_TEST_NVMF_NICS=e810 00:01:35.824 ++ SPDK_TEST_VFIOUSER=1 00:01:35.824 ++ SPDK_RUN_UBSAN=1 00:01:35.824 ++ NET_TYPE=phy 00:01:35.824 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:35.824 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:35.824 ++ RUN_NIGHTLY=1 00:01:35.824 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:35.824 + [[ -n '' ]] 00:01:35.824 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:35.824 + for M in /var/spdk/build-*-manifest.txt 00:01:35.824 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:35.824 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:35.824 + for M in /var/spdk/build-*-manifest.txt 00:01:35.824 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:35.824 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:35.824 + for M in /var/spdk/build-*-manifest.txt 00:01:35.824 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:35.824 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:35.824 ++ uname 00:01:35.824 + [[ Linux == \L\i\n\u\x ]] 00:01:35.824 + sudo dmesg -T 00:01:35.824 + sudo dmesg --clear 00:01:35.824 + dmesg_pid=988771 00:01:35.824 + [[ Fedora Linux == FreeBSD ]] 00:01:35.824 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:35.824 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:35.824 + sudo dmesg -Tw 00:01:35.824 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:35.824 + [[ -x /usr/src/fio-static/fio ]] 00:01:35.824 + export FIO_BIN=/usr/src/fio-static/fio 00:01:35.824 + FIO_BIN=/usr/src/fio-static/fio 00:01:35.824 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:35.824 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:35.824 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:35.824 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:35.824 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:35.824 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:35.824 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:35.824 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:35.824 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:35.824 Test configuration: 00:01:35.825 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:35.825 SPDK_TEST_NVMF=1 00:01:35.825 SPDK_TEST_NVME_CLI=1 00:01:35.825 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:35.825 SPDK_TEST_NVMF_NICS=e810 00:01:35.825 SPDK_TEST_VFIOUSER=1 00:01:35.825 SPDK_RUN_UBSAN=1 00:01:35.825 NET_TYPE=phy 00:01:35.825 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:35.825 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:35.825 RUN_NIGHTLY=1 16:37:21 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:35.825 16:37:21 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:35.825 16:37:21 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:35.825 16:37:21 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:35.825 16:37:21 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:35.825 16:37:21 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:35.825 16:37:21 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:35.825 16:37:21 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:35.825 16:37:21 -- paths/export.sh@5 -- $ export PATH 00:01:35.825 16:37:21 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:35.825 16:37:21 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:35.825 16:37:21 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:35.825 16:37:21 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1731771441.XXXXXX 00:01:35.825 16:37:21 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1731771441.FT2nSt 00:01:35.825 16:37:21 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:35.825 16:37:21 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:01:35.825 16:37:21 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:35.825 16:37:21 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:35.825 16:37:21 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:35.825 16:37:21 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:35.825 16:37:21 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:35.825 16:37:21 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:35.825 16:37:21 -- common/autotest_common.sh@10 -- $ set +x 00:01:35.825 16:37:21 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:35.825 16:37:21 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:35.825 16:37:21 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:35.825 16:37:21 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:35.825 16:37:21 -- spdk/autobuild.sh@16 -- $ date -u 00:01:35.825 Sat Nov 16 03:37:21 PM UTC 2024 00:01:35.825 16:37:21 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:35.825 LTS-67-gc13c99a5e 00:01:35.825 16:37:21 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:35.825 16:37:21 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:35.825 16:37:21 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:35.825 16:37:21 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:35.825 16:37:21 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:35.825 16:37:21 -- common/autotest_common.sh@10 -- $ set +x 00:01:35.825 ************************************ 00:01:35.825 START TEST ubsan 00:01:35.825 ************************************ 00:01:35.825 16:37:21 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:35.825 using ubsan 00:01:35.825 00:01:35.825 real 0m0.000s 00:01:35.825 user 0m0.000s 00:01:35.825 sys 0m0.000s 00:01:35.825 16:37:21 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:35.825 16:37:21 -- common/autotest_common.sh@10 -- $ set +x 00:01:35.825 ************************************ 00:01:35.825 END TEST ubsan 00:01:35.825 ************************************ 00:01:36.085 16:37:21 -- spdk/autobuild.sh@27 -- $ '[' -n v22.11.4 ']' 00:01:36.085 16:37:21 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:36.085 16:37:21 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:36.085 16:37:21 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:36.085 16:37:21 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:36.085 16:37:21 -- common/autotest_common.sh@10 -- $ set +x 00:01:36.085 ************************************ 00:01:36.085 START TEST build_native_dpdk 00:01:36.085 ************************************ 00:01:36.085 16:37:21 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:36.085 16:37:21 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:36.085 16:37:21 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:36.085 16:37:21 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:36.085 16:37:21 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:36.085 16:37:21 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:36.085 16:37:21 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:36.085 16:37:21 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:36.085 16:37:21 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:36.085 16:37:21 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:36.085 16:37:21 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:36.086 16:37:21 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:36.086 16:37:21 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:36.086 16:37:21 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:36.086 16:37:21 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:36.086 16:37:21 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:36.086 16:37:21 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:36.086 16:37:21 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:36.086 16:37:21 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:36.086 16:37:21 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:36.086 16:37:21 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:36.086 caf0f5d395 version: 22.11.4 00:01:36.086 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:36.086 dc9c799c7d vhost: fix missing spinlock unlock 00:01:36.086 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:36.086 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:36.086 16:37:21 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:36.086 16:37:21 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:36.086 16:37:21 -- common/autobuild_common.sh@87 -- $ dpdk_ver=22.11.4 00:01:36.086 16:37:21 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:36.086 16:37:21 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:36.086 16:37:21 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:36.086 16:37:21 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:36.086 16:37:21 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:36.086 16:37:21 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:36.086 16:37:21 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:36.086 16:37:21 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:36.086 16:37:21 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:36.086 16:37:21 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:36.086 16:37:21 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:36.086 16:37:21 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:36.086 16:37:21 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:36.086 16:37:21 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:36.086 16:37:21 -- common/autobuild_common.sh@169 -- $ lt 22.11.4 21.11.0 00:01:36.086 16:37:21 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 21.11.0 00:01:36.086 16:37:21 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:36.086 16:37:21 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:36.086 16:37:21 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:36.086 16:37:21 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:36.086 16:37:21 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:36.086 16:37:21 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:36.086 16:37:21 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:36.086 16:37:21 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:36.086 16:37:21 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:36.086 16:37:21 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:36.086 16:37:21 -- scripts/common.sh@343 -- $ case "$op" in 00:01:36.086 16:37:21 -- scripts/common.sh@344 -- $ : 1 00:01:36.086 16:37:21 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:36.086 16:37:21 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:36.086 16:37:21 -- scripts/common.sh@364 -- $ decimal 22 00:01:36.086 16:37:21 -- scripts/common.sh@352 -- $ local d=22 00:01:36.086 16:37:21 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:36.086 16:37:21 -- scripts/common.sh@354 -- $ echo 22 00:01:36.086 16:37:21 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:36.086 16:37:21 -- scripts/common.sh@365 -- $ decimal 21 00:01:36.086 16:37:21 -- scripts/common.sh@352 -- $ local d=21 00:01:36.086 16:37:21 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:36.086 16:37:21 -- scripts/common.sh@354 -- $ echo 21 00:01:36.086 16:37:21 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:36.086 16:37:21 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:36.086 16:37:21 -- scripts/common.sh@366 -- $ return 1 00:01:36.086 16:37:21 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:36.086 patching file config/rte_config.h 00:01:36.086 Hunk #1 succeeded at 60 (offset 1 line). 00:01:36.086 16:37:21 -- common/autobuild_common.sh@176 -- $ lt 22.11.4 24.07.0 00:01:36.086 16:37:21 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 24.07.0 00:01:36.086 16:37:21 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:36.086 16:37:21 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:36.086 16:37:21 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:36.086 16:37:21 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:36.086 16:37:21 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:36.086 16:37:21 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:36.086 16:37:21 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:36.086 16:37:21 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:36.086 16:37:21 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:36.086 16:37:21 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:36.086 16:37:21 -- scripts/common.sh@343 -- $ case "$op" in 00:01:36.086 16:37:21 -- scripts/common.sh@344 -- $ : 1 00:01:36.086 16:37:21 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:36.086 16:37:21 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:36.086 16:37:21 -- scripts/common.sh@364 -- $ decimal 22 00:01:36.086 16:37:21 -- scripts/common.sh@352 -- $ local d=22 00:01:36.086 16:37:21 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:36.086 16:37:21 -- scripts/common.sh@354 -- $ echo 22 00:01:36.086 16:37:21 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:36.086 16:37:21 -- scripts/common.sh@365 -- $ decimal 24 00:01:36.086 16:37:21 -- scripts/common.sh@352 -- $ local d=24 00:01:36.086 16:37:21 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:36.086 16:37:21 -- scripts/common.sh@354 -- $ echo 24 00:01:36.086 16:37:21 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:36.086 16:37:21 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:36.086 16:37:21 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:36.086 16:37:21 -- scripts/common.sh@367 -- $ return 0 00:01:36.086 16:37:21 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:36.086 patching file lib/pcapng/rte_pcapng.c 00:01:36.086 Hunk #1 succeeded at 110 (offset -18 lines). 00:01:36.086 16:37:21 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:36.086 16:37:21 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:36.086 16:37:21 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:36.086 16:37:21 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:36.086 16:37:21 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:40.283 The Meson build system 00:01:40.283 Version: 1.5.0 00:01:40.283 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:40.283 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:40.283 Build type: native build 00:01:40.283 Program cat found: YES (/usr/bin/cat) 00:01:40.283 Project name: DPDK 00:01:40.283 Project version: 22.11.4 00:01:40.283 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:40.283 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:40.283 Host machine cpu family: x86_64 00:01:40.283 Host machine cpu: x86_64 00:01:40.283 Message: ## Building in Developer Mode ## 00:01:40.283 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:40.283 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:40.283 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:40.283 Program objdump found: YES (/usr/bin/objdump) 00:01:40.283 Program python3 found: YES (/usr/bin/python3) 00:01:40.283 Program cat found: YES (/usr/bin/cat) 00:01:40.283 config/meson.build:83: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:40.283 Checking for size of "void *" : 8 00:01:40.283 Checking for size of "void *" : 8 (cached) 00:01:40.283 Library m found: YES 00:01:40.283 Library numa found: YES 00:01:40.283 Has header "numaif.h" : YES 00:01:40.283 Library fdt found: NO 00:01:40.283 Library execinfo found: NO 00:01:40.283 Has header "execinfo.h" : YES 00:01:40.283 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:40.283 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:40.283 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:40.283 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:40.283 Run-time dependency openssl found: YES 3.1.1 00:01:40.283 Run-time dependency libpcap found: YES 1.10.4 00:01:40.283 Has header "pcap.h" with dependency libpcap: YES 00:01:40.283 Compiler for C supports arguments -Wcast-qual: YES 00:01:40.283 Compiler for C supports arguments -Wdeprecated: YES 00:01:40.283 Compiler for C supports arguments -Wformat: YES 00:01:40.283 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:40.283 Compiler for C supports arguments -Wformat-security: NO 00:01:40.283 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:40.283 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:40.283 Compiler for C supports arguments -Wnested-externs: YES 00:01:40.283 Compiler for C supports arguments -Wold-style-definition: YES 00:01:40.283 Compiler for C supports arguments -Wpointer-arith: YES 00:01:40.283 Compiler for C supports arguments -Wsign-compare: YES 00:01:40.283 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:40.283 Compiler for C supports arguments -Wundef: YES 00:01:40.283 Compiler for C supports arguments -Wwrite-strings: YES 00:01:40.283 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:40.283 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:40.283 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:40.283 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:40.283 Compiler for C supports arguments -mavx512f: YES 00:01:40.283 Checking if "AVX512 checking" compiles: YES 00:01:40.283 Fetching value of define "__SSE4_2__" : 1 00:01:40.283 Fetching value of define "__AES__" : 1 00:01:40.283 Fetching value of define "__AVX__" : 1 00:01:40.283 Fetching value of define "__AVX2__" : (undefined) 00:01:40.283 Fetching value of define "__AVX512BW__" : (undefined) 00:01:40.283 Fetching value of define "__AVX512CD__" : (undefined) 00:01:40.283 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:40.283 Fetching value of define "__AVX512F__" : (undefined) 00:01:40.283 Fetching value of define "__AVX512VL__" : (undefined) 00:01:40.283 Fetching value of define "__PCLMUL__" : 1 00:01:40.283 Fetching value of define "__RDRND__" : 1 00:01:40.283 Fetching value of define "__RDSEED__" : (undefined) 00:01:40.283 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:40.283 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:40.283 Message: lib/kvargs: Defining dependency "kvargs" 00:01:40.283 Message: lib/telemetry: Defining dependency "telemetry" 00:01:40.283 Checking for function "getentropy" : YES 00:01:40.283 Message: lib/eal: Defining dependency "eal" 00:01:40.283 Message: lib/ring: Defining dependency "ring" 00:01:40.283 Message: lib/rcu: Defining dependency "rcu" 00:01:40.283 Message: lib/mempool: Defining dependency "mempool" 00:01:40.283 Message: lib/mbuf: Defining dependency "mbuf" 00:01:40.283 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:40.283 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:40.283 Compiler for C supports arguments -mpclmul: YES 00:01:40.283 Compiler for C supports arguments -maes: YES 00:01:40.283 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:40.283 Compiler for C supports arguments -mavx512bw: YES 00:01:40.283 Compiler for C supports arguments -mavx512dq: YES 00:01:40.283 Compiler for C supports arguments -mavx512vl: YES 00:01:40.283 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:40.283 Compiler for C supports arguments -mavx2: YES 00:01:40.283 Compiler for C supports arguments -mavx: YES 00:01:40.283 Message: lib/net: Defining dependency "net" 00:01:40.283 Message: lib/meter: Defining dependency "meter" 00:01:40.283 Message: lib/ethdev: Defining dependency "ethdev" 00:01:40.283 Message: lib/pci: Defining dependency "pci" 00:01:40.283 Message: lib/cmdline: Defining dependency "cmdline" 00:01:40.283 Message: lib/metrics: Defining dependency "metrics" 00:01:40.283 Message: lib/hash: Defining dependency "hash" 00:01:40.283 Message: lib/timer: Defining dependency "timer" 00:01:40.283 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:40.283 Compiler for C supports arguments -mavx2: YES (cached) 00:01:40.283 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:40.283 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:40.283 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:40.283 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:40.283 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:40.283 Message: lib/acl: Defining dependency "acl" 00:01:40.283 Message: lib/bbdev: Defining dependency "bbdev" 00:01:40.283 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:40.283 Run-time dependency libelf found: YES 0.191 00:01:40.283 Message: lib/bpf: Defining dependency "bpf" 00:01:40.283 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:40.283 Message: lib/compressdev: Defining dependency "compressdev" 00:01:40.283 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:40.283 Message: lib/distributor: Defining dependency "distributor" 00:01:40.283 Message: lib/efd: Defining dependency "efd" 00:01:40.283 Message: lib/eventdev: Defining dependency "eventdev" 00:01:40.283 Message: lib/gpudev: Defining dependency "gpudev" 00:01:40.283 Message: lib/gro: Defining dependency "gro" 00:01:40.283 Message: lib/gso: Defining dependency "gso" 00:01:40.283 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:40.283 Message: lib/jobstats: Defining dependency "jobstats" 00:01:40.283 Message: lib/latencystats: Defining dependency "latencystats" 00:01:40.283 Message: lib/lpm: Defining dependency "lpm" 00:01:40.283 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:40.283 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:40.283 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:40.283 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:40.283 Message: lib/member: Defining dependency "member" 00:01:40.283 Message: lib/pcapng: Defining dependency "pcapng" 00:01:40.283 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:40.283 Message: lib/power: Defining dependency "power" 00:01:40.283 Message: lib/rawdev: Defining dependency "rawdev" 00:01:40.283 Message: lib/regexdev: Defining dependency "regexdev" 00:01:40.283 Message: lib/dmadev: Defining dependency "dmadev" 00:01:40.283 Message: lib/rib: Defining dependency "rib" 00:01:40.283 Message: lib/reorder: Defining dependency "reorder" 00:01:40.283 Message: lib/sched: Defining dependency "sched" 00:01:40.283 Message: lib/security: Defining dependency "security" 00:01:40.283 Message: lib/stack: Defining dependency "stack" 00:01:40.283 Has header "linux/userfaultfd.h" : YES 00:01:40.283 Message: lib/vhost: Defining dependency "vhost" 00:01:40.283 Message: lib/ipsec: Defining dependency "ipsec" 00:01:40.283 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:40.283 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:40.283 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:40.283 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:40.284 Message: lib/fib: Defining dependency "fib" 00:01:40.284 Message: lib/port: Defining dependency "port" 00:01:40.284 Message: lib/pdump: Defining dependency "pdump" 00:01:40.284 Message: lib/table: Defining dependency "table" 00:01:40.284 Message: lib/pipeline: Defining dependency "pipeline" 00:01:40.284 Message: lib/graph: Defining dependency "graph" 00:01:40.284 Message: lib/node: Defining dependency "node" 00:01:40.284 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:40.284 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:40.284 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:40.284 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:40.284 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:40.284 Compiler for C supports arguments -Wno-unused-value: YES 00:01:42.193 Compiler for C supports arguments -Wno-format: YES 00:01:42.193 Compiler for C supports arguments -Wno-format-security: YES 00:01:42.193 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:42.193 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:42.193 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:42.193 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:42.193 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:42.193 Compiler for C supports arguments -mavx2: YES (cached) 00:01:42.193 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:42.193 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:42.193 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:42.193 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:42.193 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:42.193 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:42.193 Configuring doxy-api.conf using configuration 00:01:42.193 Program sphinx-build found: NO 00:01:42.193 Configuring rte_build_config.h using configuration 00:01:42.193 Message: 00:01:42.193 ================= 00:01:42.193 Applications Enabled 00:01:42.193 ================= 00:01:42.193 00:01:42.193 apps: 00:01:42.193 dumpcap, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, test-crypto-perf, 00:01:42.193 test-eventdev, test-fib, test-flow-perf, test-gpudev, test-pipeline, test-pmd, test-regex, test-sad, 00:01:42.193 test-security-perf, 00:01:42.193 00:01:42.193 Message: 00:01:42.193 ================= 00:01:42.193 Libraries Enabled 00:01:42.193 ================= 00:01:42.193 00:01:42.193 libs: 00:01:42.193 kvargs, telemetry, eal, ring, rcu, mempool, mbuf, net, 00:01:42.193 meter, ethdev, pci, cmdline, metrics, hash, timer, acl, 00:01:42.193 bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, efd, 00:01:42.193 eventdev, gpudev, gro, gso, ip_frag, jobstats, latencystats, lpm, 00:01:42.193 member, pcapng, power, rawdev, regexdev, dmadev, rib, reorder, 00:01:42.193 sched, security, stack, vhost, ipsec, fib, port, pdump, 00:01:42.193 table, pipeline, graph, node, 00:01:42.193 00:01:42.193 Message: 00:01:42.193 =============== 00:01:42.193 Drivers Enabled 00:01:42.193 =============== 00:01:42.193 00:01:42.193 common: 00:01:42.193 00:01:42.193 bus: 00:01:42.193 pci, vdev, 00:01:42.193 mempool: 00:01:42.193 ring, 00:01:42.193 dma: 00:01:42.193 00:01:42.193 net: 00:01:42.193 i40e, 00:01:42.193 raw: 00:01:42.193 00:01:42.193 crypto: 00:01:42.193 00:01:42.193 compress: 00:01:42.193 00:01:42.193 regex: 00:01:42.193 00:01:42.193 vdpa: 00:01:42.193 00:01:42.193 event: 00:01:42.193 00:01:42.193 baseband: 00:01:42.193 00:01:42.193 gpu: 00:01:42.193 00:01:42.193 00:01:42.193 Message: 00:01:42.193 ================= 00:01:42.193 Content Skipped 00:01:42.193 ================= 00:01:42.193 00:01:42.193 apps: 00:01:42.193 00:01:42.193 libs: 00:01:42.193 kni: explicitly disabled via build config (deprecated lib) 00:01:42.193 flow_classify: explicitly disabled via build config (deprecated lib) 00:01:42.193 00:01:42.193 drivers: 00:01:42.193 common/cpt: not in enabled drivers build config 00:01:42.193 common/dpaax: not in enabled drivers build config 00:01:42.193 common/iavf: not in enabled drivers build config 00:01:42.193 common/idpf: not in enabled drivers build config 00:01:42.193 common/mvep: not in enabled drivers build config 00:01:42.193 common/octeontx: not in enabled drivers build config 00:01:42.193 bus/auxiliary: not in enabled drivers build config 00:01:42.193 bus/dpaa: not in enabled drivers build config 00:01:42.193 bus/fslmc: not in enabled drivers build config 00:01:42.193 bus/ifpga: not in enabled drivers build config 00:01:42.193 bus/vmbus: not in enabled drivers build config 00:01:42.193 common/cnxk: not in enabled drivers build config 00:01:42.193 common/mlx5: not in enabled drivers build config 00:01:42.193 common/qat: not in enabled drivers build config 00:01:42.193 common/sfc_efx: not in enabled drivers build config 00:01:42.193 mempool/bucket: not in enabled drivers build config 00:01:42.193 mempool/cnxk: not in enabled drivers build config 00:01:42.193 mempool/dpaa: not in enabled drivers build config 00:01:42.193 mempool/dpaa2: not in enabled drivers build config 00:01:42.193 mempool/octeontx: not in enabled drivers build config 00:01:42.193 mempool/stack: not in enabled drivers build config 00:01:42.193 dma/cnxk: not in enabled drivers build config 00:01:42.193 dma/dpaa: not in enabled drivers build config 00:01:42.193 dma/dpaa2: not in enabled drivers build config 00:01:42.193 dma/hisilicon: not in enabled drivers build config 00:01:42.193 dma/idxd: not in enabled drivers build config 00:01:42.193 dma/ioat: not in enabled drivers build config 00:01:42.193 dma/skeleton: not in enabled drivers build config 00:01:42.193 net/af_packet: not in enabled drivers build config 00:01:42.193 net/af_xdp: not in enabled drivers build config 00:01:42.193 net/ark: not in enabled drivers build config 00:01:42.193 net/atlantic: not in enabled drivers build config 00:01:42.193 net/avp: not in enabled drivers build config 00:01:42.193 net/axgbe: not in enabled drivers build config 00:01:42.194 net/bnx2x: not in enabled drivers build config 00:01:42.194 net/bnxt: not in enabled drivers build config 00:01:42.194 net/bonding: not in enabled drivers build config 00:01:42.194 net/cnxk: not in enabled drivers build config 00:01:42.194 net/cxgbe: not in enabled drivers build config 00:01:42.194 net/dpaa: not in enabled drivers build config 00:01:42.194 net/dpaa2: not in enabled drivers build config 00:01:42.194 net/e1000: not in enabled drivers build config 00:01:42.194 net/ena: not in enabled drivers build config 00:01:42.194 net/enetc: not in enabled drivers build config 00:01:42.194 net/enetfec: not in enabled drivers build config 00:01:42.194 net/enic: not in enabled drivers build config 00:01:42.194 net/failsafe: not in enabled drivers build config 00:01:42.194 net/fm10k: not in enabled drivers build config 00:01:42.194 net/gve: not in enabled drivers build config 00:01:42.194 net/hinic: not in enabled drivers build config 00:01:42.194 net/hns3: not in enabled drivers build config 00:01:42.194 net/iavf: not in enabled drivers build config 00:01:42.194 net/ice: not in enabled drivers build config 00:01:42.194 net/idpf: not in enabled drivers build config 00:01:42.194 net/igc: not in enabled drivers build config 00:01:42.194 net/ionic: not in enabled drivers build config 00:01:42.194 net/ipn3ke: not in enabled drivers build config 00:01:42.194 net/ixgbe: not in enabled drivers build config 00:01:42.194 net/kni: not in enabled drivers build config 00:01:42.194 net/liquidio: not in enabled drivers build config 00:01:42.194 net/mana: not in enabled drivers build config 00:01:42.194 net/memif: not in enabled drivers build config 00:01:42.194 net/mlx4: not in enabled drivers build config 00:01:42.194 net/mlx5: not in enabled drivers build config 00:01:42.194 net/mvneta: not in enabled drivers build config 00:01:42.194 net/mvpp2: not in enabled drivers build config 00:01:42.194 net/netvsc: not in enabled drivers build config 00:01:42.194 net/nfb: not in enabled drivers build config 00:01:42.194 net/nfp: not in enabled drivers build config 00:01:42.194 net/ngbe: not in enabled drivers build config 00:01:42.194 net/null: not in enabled drivers build config 00:01:42.194 net/octeontx: not in enabled drivers build config 00:01:42.194 net/octeon_ep: not in enabled drivers build config 00:01:42.194 net/pcap: not in enabled drivers build config 00:01:42.194 net/pfe: not in enabled drivers build config 00:01:42.194 net/qede: not in enabled drivers build config 00:01:42.194 net/ring: not in enabled drivers build config 00:01:42.194 net/sfc: not in enabled drivers build config 00:01:42.194 net/softnic: not in enabled drivers build config 00:01:42.194 net/tap: not in enabled drivers build config 00:01:42.194 net/thunderx: not in enabled drivers build config 00:01:42.194 net/txgbe: not in enabled drivers build config 00:01:42.194 net/vdev_netvsc: not in enabled drivers build config 00:01:42.194 net/vhost: not in enabled drivers build config 00:01:42.194 net/virtio: not in enabled drivers build config 00:01:42.194 net/vmxnet3: not in enabled drivers build config 00:01:42.194 raw/cnxk_bphy: not in enabled drivers build config 00:01:42.194 raw/cnxk_gpio: not in enabled drivers build config 00:01:42.194 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:42.194 raw/ifpga: not in enabled drivers build config 00:01:42.194 raw/ntb: not in enabled drivers build config 00:01:42.194 raw/skeleton: not in enabled drivers build config 00:01:42.194 crypto/armv8: not in enabled drivers build config 00:01:42.194 crypto/bcmfs: not in enabled drivers build config 00:01:42.194 crypto/caam_jr: not in enabled drivers build config 00:01:42.194 crypto/ccp: not in enabled drivers build config 00:01:42.194 crypto/cnxk: not in enabled drivers build config 00:01:42.194 crypto/dpaa_sec: not in enabled drivers build config 00:01:42.194 crypto/dpaa2_sec: not in enabled drivers build config 00:01:42.194 crypto/ipsec_mb: not in enabled drivers build config 00:01:42.194 crypto/mlx5: not in enabled drivers build config 00:01:42.194 crypto/mvsam: not in enabled drivers build config 00:01:42.194 crypto/nitrox: not in enabled drivers build config 00:01:42.194 crypto/null: not in enabled drivers build config 00:01:42.194 crypto/octeontx: not in enabled drivers build config 00:01:42.194 crypto/openssl: not in enabled drivers build config 00:01:42.194 crypto/scheduler: not in enabled drivers build config 00:01:42.194 crypto/uadk: not in enabled drivers build config 00:01:42.194 crypto/virtio: not in enabled drivers build config 00:01:42.194 compress/isal: not in enabled drivers build config 00:01:42.194 compress/mlx5: not in enabled drivers build config 00:01:42.194 compress/octeontx: not in enabled drivers build config 00:01:42.194 compress/zlib: not in enabled drivers build config 00:01:42.194 regex/mlx5: not in enabled drivers build config 00:01:42.194 regex/cn9k: not in enabled drivers build config 00:01:42.194 vdpa/ifc: not in enabled drivers build config 00:01:42.194 vdpa/mlx5: not in enabled drivers build config 00:01:42.194 vdpa/sfc: not in enabled drivers build config 00:01:42.194 event/cnxk: not in enabled drivers build config 00:01:42.194 event/dlb2: not in enabled drivers build config 00:01:42.194 event/dpaa: not in enabled drivers build config 00:01:42.194 event/dpaa2: not in enabled drivers build config 00:01:42.194 event/dsw: not in enabled drivers build config 00:01:42.194 event/opdl: not in enabled drivers build config 00:01:42.194 event/skeleton: not in enabled drivers build config 00:01:42.194 event/sw: not in enabled drivers build config 00:01:42.194 event/octeontx: not in enabled drivers build config 00:01:42.194 baseband/acc: not in enabled drivers build config 00:01:42.194 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:42.194 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:42.194 baseband/la12xx: not in enabled drivers build config 00:01:42.194 baseband/null: not in enabled drivers build config 00:01:42.194 baseband/turbo_sw: not in enabled drivers build config 00:01:42.194 gpu/cuda: not in enabled drivers build config 00:01:42.194 00:01:42.194 00:01:42.194 Build targets in project: 316 00:01:42.194 00:01:42.194 DPDK 22.11.4 00:01:42.194 00:01:42.194 User defined options 00:01:42.194 libdir : lib 00:01:42.194 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:42.194 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:42.194 c_link_args : 00:01:42.194 enable_docs : false 00:01:42.194 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:42.194 enable_kmods : false 00:01:42.194 machine : native 00:01:42.194 tests : false 00:01:42.194 00:01:42.194 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:42.194 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:42.194 16:37:27 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:42.194 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:42.454 [1/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:42.454 [2/745] Generating lib/rte_kvargs_mingw with a custom command 00:01:42.454 [3/745] Generating lib/rte_telemetry_def with a custom command 00:01:42.454 [4/745] Generating lib/rte_telemetry_mingw with a custom command 00:01:42.454 [5/745] Generating lib/rte_kvargs_def with a custom command 00:01:42.454 [6/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:42.454 [7/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:42.454 [8/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:42.454 [9/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:42.454 [10/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:42.454 [11/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:42.454 [12/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:42.454 [13/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:42.454 [14/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:42.454 [15/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:42.454 [16/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:42.454 [17/745] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:42.454 [18/745] Linking static target lib/librte_kvargs.a 00:01:42.454 [19/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:42.454 [20/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:42.454 [21/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:42.454 [22/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:42.454 [23/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:42.454 [24/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:42.454 [25/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:42.454 [26/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:42.454 [27/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:42.454 [28/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:42.454 [29/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:42.454 [30/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:42.454 [31/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:42.716 [32/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_log.c.o 00:01:42.716 [33/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:42.716 [34/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:42.716 [35/745] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:42.716 [36/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:42.716 [37/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:42.716 [38/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:42.716 [39/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:42.716 [40/745] Generating lib/rte_eal_def with a custom command 00:01:42.716 [41/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:42.716 [42/745] Generating lib/rte_eal_mingw with a custom command 00:01:42.716 [43/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:42.716 [44/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:42.716 [45/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:42.716 [46/745] Generating lib/rte_ring_def with a custom command 00:01:42.716 [47/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:42.716 [48/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:42.716 [49/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:42.716 [50/745] Generating lib/rte_ring_mingw with a custom command 00:01:42.716 [51/745] Generating lib/rte_rcu_def with a custom command 00:01:42.716 [52/745] Generating lib/rte_rcu_mingw with a custom command 00:01:42.716 [53/745] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:42.716 [54/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:42.716 [55/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:42.716 [56/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:42.716 [57/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:42.716 [58/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:42.716 [59/745] Generating lib/rte_mempool_def with a custom command 00:01:42.716 [60/745] Generating lib/rte_mempool_mingw with a custom command 00:01:42.716 [61/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_log.c.o 00:01:42.716 [62/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:42.716 [63/745] Generating lib/rte_mbuf_def with a custom command 00:01:42.716 [64/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:42.716 [65/745] Generating lib/rte_mbuf_mingw with a custom command 00:01:42.716 [66/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:42.716 [67/745] Generating lib/rte_net_def with a custom command 00:01:42.716 [68/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:42.716 [69/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:42.716 [70/745] Generating lib/rte_meter_def with a custom command 00:01:42.716 [71/745] Generating lib/rte_net_mingw with a custom command 00:01:42.716 [72/745] Generating lib/rte_meter_mingw with a custom command 00:01:42.716 [73/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:42.716 [74/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:42.716 [75/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:42.716 [76/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:42.716 [77/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:42.981 [78/745] Generating lib/rte_ethdev_def with a custom command 00:01:42.981 [79/745] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.981 [80/745] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:42.981 [81/745] Generating lib/rte_ethdev_mingw with a custom command 00:01:42.981 [82/745] Linking static target lib/librte_ring.a 00:01:42.981 [83/745] Linking target lib/librte_kvargs.so.23.0 00:01:42.981 [84/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:42.981 [85/745] Generating lib/rte_pci_def with a custom command 00:01:42.981 [86/745] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:42.981 [87/745] Linking static target lib/librte_meter.a 00:01:42.981 [88/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:42.981 [89/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:42.981 [90/745] Generating lib/rte_pci_mingw with a custom command 00:01:42.981 [91/745] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:42.981 [92/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:42.981 [93/745] Linking static target lib/librte_pci.a 00:01:43.246 [94/745] Generating symbol file lib/librte_kvargs.so.23.0.p/librte_kvargs.so.23.0.symbols 00:01:43.246 [95/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:43.246 [96/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:43.246 [97/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:43.246 [98/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:43.246 [99/745] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.246 [100/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:43.246 [101/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:43.246 [102/745] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.506 [103/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:43.506 [104/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:43.506 [105/745] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.506 [106/745] Generating lib/rte_cmdline_def with a custom command 00:01:43.506 [107/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:43.506 [108/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:43.506 [109/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:43.507 [110/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:43.507 [111/745] Generating lib/rte_cmdline_mingw with a custom command 00:01:43.507 [112/745] Linking static target lib/librte_telemetry.a 00:01:43.507 [113/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:43.507 [114/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:43.507 [115/745] Generating lib/rte_metrics_def with a custom command 00:01:43.507 [116/745] Generating lib/rte_metrics_mingw with a custom command 00:01:43.507 [117/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:43.507 [118/745] Generating lib/rte_hash_def with a custom command 00:01:43.507 [119/745] Generating lib/rte_hash_mingw with a custom command 00:01:43.507 [120/745] Generating lib/rte_timer_def with a custom command 00:01:43.507 [121/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:43.507 [122/745] Generating lib/rte_timer_mingw with a custom command 00:01:43.769 [123/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:43.769 [124/745] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:43.769 [125/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:43.769 [126/745] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:43.769 [127/745] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:43.769 [128/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:43.769 [129/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:43.769 [130/745] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:43.769 [131/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:44.034 [132/745] Generating lib/rte_acl_def with a custom command 00:01:44.034 [133/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:44.034 [134/745] Generating lib/rte_acl_mingw with a custom command 00:01:44.034 [135/745] Generating lib/rte_bbdev_def with a custom command 00:01:44.034 [136/745] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:44.034 [137/745] Generating lib/rte_bbdev_mingw with a custom command 00:01:44.034 [138/745] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.034 [139/745] Generating lib/rte_bitratestats_def with a custom command 00:01:44.034 [140/745] Generating lib/rte_bitratestats_mingw with a custom command 00:01:44.034 [141/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:44.034 [142/745] Linking target lib/librte_telemetry.so.23.0 00:01:44.034 [143/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:44.034 [144/745] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:44.034 [145/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:44.034 [146/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:44.034 [147/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:44.034 [148/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:44.034 [149/745] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:44.296 [150/745] Generating lib/rte_bpf_def with a custom command 00:01:44.296 [151/745] Generating lib/rte_bpf_mingw with a custom command 00:01:44.296 [152/745] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:44.296 [153/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:44.296 [154/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:44.296 [155/745] Generating lib/rte_cfgfile_mingw with a custom command 00:01:44.296 [156/745] Generating lib/rte_cfgfile_def with a custom command 00:01:44.296 [157/745] Generating symbol file lib/librte_telemetry.so.23.0.p/librte_telemetry.so.23.0.symbols 00:01:44.296 [158/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:44.296 [159/745] Generating lib/rte_compressdev_def with a custom command 00:01:44.296 [160/745] Generating lib/rte_compressdev_mingw with a custom command 00:01:44.296 [161/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:44.296 [162/745] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:44.296 [163/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:44.296 [164/745] Linking static target lib/librte_rcu.a 00:01:44.296 [165/745] Generating lib/rte_cryptodev_mingw with a custom command 00:01:44.296 [166/745] Generating lib/rte_cryptodev_def with a custom command 00:01:44.296 [167/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:44.296 [168/745] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:44.296 [169/745] Linking static target lib/librte_timer.a 00:01:44.296 [170/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:44.296 [171/745] Generating lib/rte_distributor_def with a custom command 00:01:44.557 [172/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:44.557 [173/745] Linking static target lib/librte_cmdline.a 00:01:44.557 [174/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:44.557 [175/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:44.557 [176/745] Generating lib/rte_distributor_mingw with a custom command 00:01:44.557 [177/745] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:44.557 [178/745] Generating lib/rte_efd_def with a custom command 00:01:44.557 [179/745] Linking static target lib/librte_net.a 00:01:44.557 [180/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:44.557 [181/745] Generating lib/rte_efd_mingw with a custom command 00:01:44.557 [182/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:44.816 [183/745] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:44.816 [184/745] Linking static target lib/librte_metrics.a 00:01:44.816 [185/745] Linking static target lib/librte_cfgfile.a 00:01:44.816 [186/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:44.816 [187/745] Linking static target lib/librte_mempool.a 00:01:44.816 [188/745] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.816 [189/745] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:44.816 [190/745] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.816 [191/745] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.089 [192/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:45.089 [193/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:45.089 [194/745] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:45.089 [195/745] Generating lib/rte_eventdev_def with a custom command 00:01:45.089 [196/745] Linking static target lib/librte_eal.a 00:01:45.089 [197/745] Generating lib/rte_eventdev_mingw with a custom command 00:01:45.089 [198/745] Generating lib/rte_gpudev_def with a custom command 00:01:45.089 [199/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:45.089 [200/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:45.089 [201/745] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:45.089 [202/745] Linking static target lib/librte_bitratestats.a 00:01:45.089 [203/745] Generating lib/rte_gpudev_mingw with a custom command 00:01:45.089 [204/745] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.347 [205/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:45.347 [206/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:45.347 [207/745] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:45.347 [208/745] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.347 [209/745] Generating lib/rte_gro_def with a custom command 00:01:45.347 [210/745] Generating lib/rte_gro_mingw with a custom command 00:01:45.348 [211/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:45.348 [212/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:45.611 [213/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:45.611 [214/745] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.611 [215/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:45.611 [216/745] Generating lib/rte_gso_def with a custom command 00:01:45.611 [217/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:45.611 [218/745] Generating lib/rte_gso_mingw with a custom command 00:01:45.611 [219/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:45.611 [220/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:45.877 [221/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:45.877 [222/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:45.877 [223/745] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.877 [224/745] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:45.877 [225/745] Linking static target lib/librte_bbdev.a 00:01:45.877 [226/745] Generating lib/rte_ip_frag_def with a custom command 00:01:45.877 [227/745] Generating lib/rte_ip_frag_mingw with a custom command 00:01:45.877 [228/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:45.877 [229/745] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.877 [230/745] Generating lib/rte_jobstats_def with a custom command 00:01:45.877 [231/745] Generating lib/rte_jobstats_mingw with a custom command 00:01:45.877 [232/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:45.878 [233/745] Generating lib/rte_latencystats_def with a custom command 00:01:45.878 [234/745] Generating lib/rte_latencystats_mingw with a custom command 00:01:45.878 [235/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:45.878 [236/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:45.878 [237/745] Linking static target lib/librte_compressdev.a 00:01:46.138 [238/745] Generating lib/rte_lpm_def with a custom command 00:01:46.138 [239/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:46.138 [240/745] Generating lib/rte_lpm_mingw with a custom command 00:01:46.138 [241/745] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:46.138 [242/745] Linking static target lib/librte_jobstats.a 00:01:46.138 [243/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:46.397 [244/745] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:46.397 [245/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:46.397 [246/745] Linking static target lib/librte_distributor.a 00:01:46.397 [247/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:46.661 [248/745] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:46.661 [249/745] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:46.661 [250/745] Generating lib/rte_member_def with a custom command 00:01:46.661 [251/745] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.661 [252/745] Generating lib/rte_member_mingw with a custom command 00:01:46.661 [253/745] Generating lib/rte_pcapng_def with a custom command 00:01:46.661 [254/745] Generating lib/rte_pcapng_mingw with a custom command 00:01:46.661 [255/745] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.661 [256/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:46.661 [257/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:46.661 [258/745] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:46.661 [259/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:46.921 [260/745] Linking static target lib/librte_bpf.a 00:01:46.921 [261/745] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:46.921 [262/745] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:46.921 [263/745] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:46.921 [264/745] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:46.921 [265/745] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:46.921 [266/745] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:46.921 [267/745] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:46.921 [268/745] Linking static target lib/librte_gpudev.a 00:01:46.921 [269/745] Generating lib/rte_power_def with a custom command 00:01:46.921 [270/745] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.921 [271/745] Generating lib/rte_power_mingw with a custom command 00:01:46.921 [272/745] Generating lib/rte_rawdev_def with a custom command 00:01:46.921 [273/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:46.921 [274/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:46.921 [275/745] Generating lib/rte_rawdev_mingw with a custom command 00:01:46.921 [276/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:46.921 [277/745] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:46.921 [278/745] Linking static target lib/librte_gro.a 00:01:46.921 [279/745] Generating lib/rte_regexdev_def with a custom command 00:01:46.921 [280/745] Generating lib/rte_regexdev_mingw with a custom command 00:01:46.921 [281/745] Generating lib/rte_dmadev_def with a custom command 00:01:46.921 [282/745] Generating lib/rte_dmadev_mingw with a custom command 00:01:47.181 [283/745] Generating lib/rte_rib_def with a custom command 00:01:47.181 [284/745] Generating lib/rte_rib_mingw with a custom command 00:01:47.181 [285/745] Generating lib/rte_reorder_def with a custom command 00:01:47.181 [286/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:47.181 [287/745] Generating lib/rte_reorder_mingw with a custom command 00:01:47.181 [288/745] Compiling C object lib/librte_power.a.p/power_rte_power_empty_poll.c.o 00:01:47.181 [289/745] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.445 [290/745] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.445 [291/745] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.445 [292/745] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:47.445 [293/745] Generating lib/rte_sched_def with a custom command 00:01:47.445 [294/745] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:47.445 [295/745] Generating lib/rte_sched_mingw with a custom command 00:01:47.445 [296/745] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:47.445 [297/745] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:47.445 [298/745] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:47.445 [299/745] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:47.445 [300/745] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:47.445 [301/745] Generating lib/rte_security_def with a custom command 00:01:47.445 [302/745] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:47.445 [303/745] Linking static target lib/librte_latencystats.a 00:01:47.445 [304/745] Generating lib/rte_security_mingw with a custom command 00:01:47.445 [305/745] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:47.445 [306/745] Generating lib/rte_stack_mingw with a custom command 00:01:47.445 [307/745] Generating lib/rte_stack_def with a custom command 00:01:47.445 [308/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:47.705 [309/745] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:47.705 [310/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:47.705 [311/745] Linking static target lib/librte_rawdev.a 00:01:47.705 [312/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:47.705 [313/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:47.705 [314/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:47.705 [315/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:47.705 [316/745] Linking static target lib/librte_stack.a 00:01:47.705 [317/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:47.705 [318/745] Generating lib/rte_vhost_def with a custom command 00:01:47.705 [319/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:47.705 [320/745] Generating lib/rte_vhost_mingw with a custom command 00:01:47.705 [321/745] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:47.705 [322/745] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:47.706 [323/745] Linking static target lib/librte_dmadev.a 00:01:47.706 [324/745] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.971 [325/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:47.971 [326/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:47.971 [327/745] Linking static target lib/librte_ip_frag.a 00:01:47.971 [328/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:47.971 [329/745] Generating lib/rte_ipsec_def with a custom command 00:01:47.971 [330/745] Generating lib/rte_ipsec_mingw with a custom command 00:01:47.971 [331/745] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.971 [332/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:48.240 [333/745] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.240 [334/745] Compiling C object lib/librte_power.a.p/power_rte_power_intel_uncore.c.o 00:01:48.240 [335/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:48.240 [336/745] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.240 [337/745] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.240 [338/745] Generating lib/rte_fib_def with a custom command 00:01:48.240 [339/745] Generating lib/rte_fib_mingw with a custom command 00:01:48.506 [340/745] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:48.506 [341/745] Linking static target lib/librte_gso.a 00:01:48.506 [342/745] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:48.506 [343/745] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:48.506 [344/745] Linking static target lib/librte_regexdev.a 00:01:48.506 [345/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:48.506 [346/745] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.767 [347/745] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:48.767 [348/745] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.767 [349/745] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:48.767 [350/745] Linking static target lib/librte_efd.a 00:01:48.767 [351/745] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:48.767 [352/745] Linking static target lib/librte_pcapng.a 00:01:49.034 [353/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:49.034 [354/745] Linking static target lib/librte_lpm.a 00:01:49.034 [355/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:49.034 [356/745] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:49.034 [357/745] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:49.034 [358/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:49.034 [359/745] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:49.034 [360/745] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:49.034 [361/745] Linking static target lib/librte_reorder.a 00:01:49.034 [362/745] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.034 [363/745] Generating lib/rte_port_def with a custom command 00:01:49.295 [364/745] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:49.295 [365/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:49.295 [366/745] Generating lib/rte_port_mingw with a custom command 00:01:49.295 [367/745] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:49.295 [368/745] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:49.295 [369/745] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:49.295 [370/745] Generating lib/rte_pdump_mingw with a custom command 00:01:49.295 [371/745] Generating lib/rte_pdump_def with a custom command 00:01:49.295 [372/745] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:49.295 [373/745] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:49.295 [374/745] Linking static target lib/acl/libavx2_tmp.a 00:01:49.295 [375/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:49.295 [376/745] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.295 [377/745] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:49.295 [378/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:49.295 [379/745] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:49.295 [380/745] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:49.557 [381/745] Linking static target lib/librte_security.a 00:01:49.557 [382/745] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.557 [383/745] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.557 [384/745] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:49.557 [385/745] Linking static target lib/librte_power.a 00:01:49.557 [386/745] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:49.557 [387/745] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.817 [388/745] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:49.817 [389/745] Linking static target lib/librte_hash.a 00:01:49.817 [390/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:49.817 [391/745] Linking static target lib/librte_rib.a 00:01:49.817 [392/745] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:49.817 [393/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:49.817 [394/745] Linking static target lib/acl/libavx512_tmp.a 00:01:49.817 [395/745] Linking static target lib/librte_acl.a 00:01:49.817 [396/745] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:49.817 [397/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:50.083 [398/745] Generating lib/rte_table_def with a custom command 00:01:50.083 [399/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:50.083 [400/745] Linking static target lib/librte_ethdev.a 00:01:50.083 [401/745] Generating lib/rte_table_mingw with a custom command 00:01:50.083 [402/745] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.344 [403/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:50.344 [404/745] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.344 [405/745] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.605 [406/745] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:50.605 [407/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:50.605 [408/745] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:50.605 [409/745] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:50.605 [410/745] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:50.605 [411/745] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:50.605 [412/745] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:50.605 [413/745] Generating lib/rte_pipeline_def with a custom command 00:01:50.605 [414/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:50.605 [415/745] Generating lib/rte_pipeline_mingw with a custom command 00:01:50.605 [416/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:50.605 [417/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:50.605 [418/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:50.605 [419/745] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:50.605 [420/745] Generating lib/rte_graph_def with a custom command 00:01:50.873 [421/745] Linking static target lib/librte_fib.a 00:01:50.873 [422/745] Linking static target lib/librte_mbuf.a 00:01:50.873 [423/745] Generating lib/rte_graph_mingw with a custom command 00:01:50.873 [424/745] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.873 [425/745] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.873 [426/745] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:50.873 [427/745] Linking static target lib/librte_member.a 00:01:50.873 [428/745] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:50.873 [429/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:51.133 [430/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:51.133 [431/745] Linking static target lib/librte_eventdev.a 00:01:51.133 [432/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:51.133 [433/745] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:51.133 [434/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:51.133 [435/745] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:51.133 [436/745] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:51.133 [437/745] Generating lib/rte_node_def with a custom command 00:01:51.133 [438/745] Generating lib/rte_node_mingw with a custom command 00:01:51.133 [439/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:51.133 [440/745] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.398 [441/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:51.398 [442/745] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:51.398 [443/745] Generating drivers/rte_bus_pci_def with a custom command 00:01:51.398 [444/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:51.398 [445/745] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:51.398 [446/745] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.398 [447/745] Linking static target lib/librte_sched.a 00:01:51.398 [448/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:51.398 [449/745] Generating drivers/rte_bus_pci_mingw with a custom command 00:01:51.398 [450/745] Generating drivers/rte_bus_vdev_def with a custom command 00:01:51.398 [451/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:51.398 [452/745] Generating drivers/rte_bus_vdev_mingw with a custom command 00:01:51.661 [453/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:51.661 [454/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:51.661 [455/745] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.661 [456/745] Generating drivers/rte_mempool_ring_def with a custom command 00:01:51.661 [457/745] Generating drivers/rte_mempool_ring_mingw with a custom command 00:01:51.661 [458/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:51.661 [459/745] Linking static target lib/librte_cryptodev.a 00:01:51.661 [460/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:51.661 [461/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:51.661 [462/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:51.661 [463/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:51.926 [464/745] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:51.926 [465/745] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:51.926 [466/745] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:51.926 [467/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:51.926 [468/745] Linking static target lib/librte_pdump.a 00:01:51.926 [469/745] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:51.926 [470/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:51.926 [471/745] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:51.926 [472/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:51.926 [473/745] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:51.926 [474/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:51.926 [475/745] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:52.190 [476/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:52.190 [477/745] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.190 [478/745] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:52.190 [479/745] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:52.190 [480/745] Generating drivers/rte_net_i40e_def with a custom command 00:01:52.190 [481/745] Generating drivers/rte_net_i40e_mingw with a custom command 00:01:52.190 [482/745] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:52.190 [483/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:52.452 [484/745] Linking static target lib/librte_table.a 00:01:52.452 [485/745] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:52.452 [486/745] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:52.452 [487/745] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.452 [488/745] Linking static target drivers/librte_bus_vdev.a 00:01:52.452 [489/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:52.453 [490/745] Compiling C object drivers/librte_bus_vdev.so.23.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:52.453 [491/745] Linking static target lib/librte_ipsec.a 00:01:52.453 [492/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:52.717 [493/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:52.717 [494/745] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:52.717 [495/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:52.717 [496/745] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.717 [497/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:52.980 [498/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:52.980 [499/745] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:52.980 [500/745] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.980 [501/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:52.980 [502/745] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:52.980 [503/745] Linking static target lib/librte_graph.a 00:01:52.980 [504/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:52.980 [505/745] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:52.980 [506/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:52.980 [507/745] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:52.980 [508/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:52.980 [509/745] Compiling C object drivers/librte_bus_pci.so.23.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:53.246 [510/745] Linking static target drivers/librte_bus_pci.a 00:01:53.246 [511/745] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:53.513 [512/745] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.513 [513/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:53.513 [514/745] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:53.778 [515/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:53.778 [516/745] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.778 [517/745] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:53.778 [518/745] Linking static target lib/librte_port.a 00:01:53.778 [519/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:54.042 [520/745] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.042 [521/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:54.042 [522/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:54.042 [523/745] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:54.042 [524/745] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:54.309 [525/745] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:54.309 [526/745] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:54.309 [527/745] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.576 [528/745] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:54.576 [529/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:54.576 [530/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:54.576 [531/745] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:54.576 [532/745] Compiling C object drivers/librte_mempool_ring.so.23.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:54.576 [533/745] Linking static target drivers/librte_mempool_ring.a 00:01:54.576 [534/745] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:54.576 [535/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:54.576 [536/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:54.867 [537/745] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:54.867 [538/745] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.867 [539/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:54.867 [540/745] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.867 [541/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:55.490 [542/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:55.490 [543/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:55.490 [544/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:55.490 [545/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:55.490 [546/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:55.490 [547/745] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:55.490 [548/745] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:55.764 [549/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:55.764 [550/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:55.764 [551/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:56.023 [552/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:56.023 [553/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:56.023 [554/745] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:56.023 [555/745] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:56.288 [556/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:56.288 [557/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:56.554 [558/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:56.554 [559/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:56.815 [560/745] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:56.815 [561/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:56.815 [562/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:56.815 [563/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:56.815 [564/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:56.815 [565/745] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:56.815 [566/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:57.076 [567/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:57.076 [568/745] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.076 [569/745] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:57.076 [570/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:57.076 [571/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:57.076 [572/745] Linking target lib/librte_eal.so.23.0 00:01:57.339 [573/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:57.339 [574/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:57.339 [575/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:57.339 [576/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:57.339 [577/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:57.339 [578/745] Generating symbol file lib/librte_eal.so.23.0.p/librte_eal.so.23.0.symbols 00:01:57.602 [579/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:57.602 [580/745] Linking target lib/librte_ring.so.23.0 00:01:57.602 [581/745] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.602 [582/745] Linking target lib/librte_meter.so.23.0 00:01:57.602 [583/745] Linking target lib/librte_pci.so.23.0 00:01:57.602 [584/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:57.602 [585/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:57.602 [586/745] Linking target lib/librte_timer.so.23.0 00:01:57.602 [587/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:57.602 [588/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:57.602 [589/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:57.602 [590/745] Generating symbol file lib/librte_ring.so.23.0.p/librte_ring.so.23.0.symbols 00:01:57.867 [591/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:57.867 [592/745] Linking target lib/librte_acl.so.23.0 00:01:57.867 [593/745] Generating symbol file lib/librte_meter.so.23.0.p/librte_meter.so.23.0.symbols 00:01:57.867 [594/745] Linking target lib/librte_jobstats.so.23.0 00:01:57.867 [595/745] Linking target lib/librte_cfgfile.so.23.0 00:01:57.867 [596/745] Linking target lib/librte_rawdev.so.23.0 00:01:57.867 [597/745] Linking target lib/librte_rcu.so.23.0 00:01:57.867 [598/745] Generating symbol file lib/librte_pci.so.23.0.p/librte_pci.so.23.0.symbols 00:01:57.867 [599/745] Linking target lib/librte_mempool.so.23.0 00:01:57.867 [600/745] Linking target lib/librte_dmadev.so.23.0 00:01:57.867 [601/745] Linking target lib/librte_stack.so.23.0 00:01:57.867 [602/745] Linking target lib/librte_graph.so.23.0 00:01:57.867 [603/745] Linking target drivers/librte_bus_vdev.so.23.0 00:01:57.867 [604/745] Linking target drivers/librte_bus_pci.so.23.0 00:01:57.867 [605/745] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:57.867 [606/745] Generating symbol file lib/librte_timer.so.23.0.p/librte_timer.so.23.0.symbols 00:01:57.867 [607/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:01:57.867 [608/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:58.131 [609/745] Generating symbol file lib/librte_acl.so.23.0.p/librte_acl.so.23.0.symbols 00:01:58.131 [610/745] Generating symbol file lib/librte_rcu.so.23.0.p/librte_rcu.so.23.0.symbols 00:01:58.131 [611/745] Generating symbol file drivers/librte_bus_vdev.so.23.0.p/librte_bus_vdev.so.23.0.symbols 00:01:58.131 [612/745] Generating symbol file lib/librte_mempool.so.23.0.p/librte_mempool.so.23.0.symbols 00:01:58.131 [613/745] Generating symbol file lib/librte_graph.so.23.0.p/librte_graph.so.23.0.symbols 00:01:58.131 [614/745] Generating symbol file lib/librte_dmadev.so.23.0.p/librte_dmadev.so.23.0.symbols 00:01:58.131 [615/745] Generating symbol file drivers/librte_bus_pci.so.23.0.p/librte_bus_pci.so.23.0.symbols 00:01:58.131 [616/745] Linking target lib/librte_rib.so.23.0 00:01:58.131 [617/745] Linking target drivers/librte_mempool_ring.so.23.0 00:01:58.131 [618/745] Linking target lib/librte_mbuf.so.23.0 00:01:58.394 [619/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:58.394 [620/745] Generating symbol file lib/librte_rib.so.23.0.p/librte_rib.so.23.0.symbols 00:01:58.394 [621/745] Generating symbol file lib/librte_mbuf.so.23.0.p/librte_mbuf.so.23.0.symbols 00:01:58.394 [622/745] Linking target lib/librte_fib.so.23.0 00:01:58.394 [623/745] Linking target lib/librte_net.so.23.0 00:01:58.654 [624/745] Linking target lib/librte_bbdev.so.23.0 00:01:58.654 [625/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:58.654 [626/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:58.654 [627/745] Linking target lib/librte_compressdev.so.23.0 00:01:58.654 [628/745] Linking target lib/librte_distributor.so.23.0 00:01:58.654 [629/745] Linking target lib/librte_cryptodev.so.23.0 00:01:58.654 [630/745] Linking target lib/librte_gpudev.so.23.0 00:01:58.654 [631/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:58.654 [632/745] Generating symbol file lib/librte_net.so.23.0.p/librte_net.so.23.0.symbols 00:01:58.654 [633/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:58.654 [634/745] Linking target lib/librte_regexdev.so.23.0 00:01:58.654 [635/745] Linking target lib/librte_reorder.so.23.0 00:01:58.654 [636/745] Linking target lib/librte_sched.so.23.0 00:01:58.917 [637/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:01:58.917 [638/745] Linking target lib/librte_cmdline.so.23.0 00:01:58.917 [639/745] Linking target lib/librte_ethdev.so.23.0 00:01:58.917 [640/745] Linking target lib/librte_hash.so.23.0 00:01:58.917 [641/745] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:58.917 [642/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:58.917 [643/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:01:58.917 [644/745] Generating symbol file lib/librte_cryptodev.so.23.0.p/librte_cryptodev.so.23.0.symbols 00:01:58.917 [645/745] Linking target lib/librte_security.so.23.0 00:01:58.917 [646/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:58.917 [647/745] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:58.917 [648/745] Generating symbol file lib/librte_sched.so.23.0.p/librte_sched.so.23.0.symbols 00:01:58.917 [649/745] Generating symbol file lib/librte_hash.so.23.0.p/librte_hash.so.23.0.symbols 00:01:58.917 [650/745] Generating symbol file lib/librte_ethdev.so.23.0.p/librte_ethdev.so.23.0.symbols 00:01:59.177 [651/745] Linking target lib/librte_lpm.so.23.0 00:01:59.177 [652/745] Linking target lib/librte_member.so.23.0 00:01:59.177 [653/745] Linking target lib/librte_efd.so.23.0 00:01:59.177 [654/745] Linking target lib/librte_gso.so.23.0 00:01:59.177 [655/745] Linking target lib/librte_gro.so.23.0 00:01:59.177 [656/745] Linking target lib/librte_pcapng.so.23.0 00:01:59.177 [657/745] Linking target lib/librte_metrics.so.23.0 00:01:59.177 [658/745] Linking target lib/librte_bpf.so.23.0 00:01:59.177 [659/745] Linking target lib/librte_ip_frag.so.23.0 00:01:59.177 [660/745] Linking target lib/librte_power.so.23.0 00:01:59.177 [661/745] Linking target lib/librte_eventdev.so.23.0 00:01:59.177 [662/745] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:01:59.177 [663/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:59.177 [664/745] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:01:59.177 [665/745] Generating symbol file lib/librte_security.so.23.0.p/librte_security.so.23.0.symbols 00:01:59.177 [666/745] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:59.177 [667/745] Generating symbol file lib/librte_lpm.so.23.0.p/librte_lpm.so.23.0.symbols 00:01:59.436 [668/745] Generating symbol file lib/librte_ip_frag.so.23.0.p/librte_ip_frag.so.23.0.symbols 00:01:59.436 [669/745] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:01:59.436 [670/745] Linking target lib/librte_ipsec.so.23.0 00:01:59.436 [671/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:01:59.436 [672/745] Generating symbol file lib/librte_metrics.so.23.0.p/librte_metrics.so.23.0.symbols 00:01:59.436 [673/745] Generating symbol file lib/librte_bpf.so.23.0.p/librte_bpf.so.23.0.symbols 00:01:59.436 [674/745] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:59.436 [675/745] Generating symbol file lib/librte_eventdev.so.23.0.p/librte_eventdev.so.23.0.symbols 00:01:59.436 [676/745] Generating symbol file lib/librte_pcapng.so.23.0.p/librte_pcapng.so.23.0.symbols 00:01:59.436 [677/745] Linking target lib/librte_latencystats.so.23.0 00:01:59.436 [678/745] Linking target lib/librte_bitratestats.so.23.0 00:01:59.436 [679/745] Linking target lib/librte_pdump.so.23.0 00:01:59.436 [680/745] Linking target lib/librte_port.so.23.0 00:01:59.436 [681/745] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:59.436 [682/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:01:59.694 [683/745] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:01:59.694 [684/745] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:01:59.694 [685/745] Generating symbol file lib/librte_port.so.23.0.p/librte_port.so.23.0.symbols 00:01:59.694 [686/745] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:01:59.694 [687/745] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:59.694 [688/745] Linking target lib/librte_table.so.23.0 00:01:59.694 [689/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:01:59.694 [690/745] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:01:59.694 [691/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:59.953 [692/745] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:01:59.953 [693/745] Generating symbol file lib/librte_table.so.23.0.p/librte_table.so.23.0.symbols 00:02:00.211 [694/745] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:02:00.211 [695/745] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:02:00.211 [696/745] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:02:00.470 [697/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:02:00.470 [698/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:02:00.729 [699/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:02:00.729 [700/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:02:00.987 [701/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:02:00.987 [702/745] Linking static target drivers/libtmp_rte_net_i40e.a 00:02:01.246 [703/745] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:02:01.246 [704/745] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:02:01.505 [705/745] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:02:01.505 [706/745] Compiling C object drivers/librte_net_i40e.so.23.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:02:01.505 [707/745] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:02:01.505 [708/745] Linking static target drivers/librte_net_i40e.a 00:02:01.764 [709/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:02:01.764 [710/745] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:02:02.021 [711/745] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.022 [712/745] Linking target drivers/librte_net_i40e.so.23.0 00:02:02.957 [713/745] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:02:02.957 [714/745] Linking static target lib/librte_node.a 00:02:02.957 [715/745] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.957 [716/745] Linking target lib/librte_node.so.23.0 00:02:03.217 [717/745] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:02:04.153 [718/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:02:04.412 [719/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:02:12.529 [720/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:44.636 [721/745] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:44.636 [722/745] Linking static target lib/librte_vhost.a 00:02:44.636 [723/745] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:44.636 [724/745] Linking target lib/librte_vhost.so.23.0 00:02:54.631 [725/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:54.631 [726/745] Linking static target lib/librte_pipeline.a 00:02:54.631 [727/745] Linking target app/dpdk-test-cmdline 00:02:54.631 [728/745] Linking target app/dpdk-dumpcap 00:02:54.631 [729/745] Linking target app/dpdk-test-pipeline 00:02:54.631 [730/745] Linking target app/dpdk-test-regex 00:02:54.631 [731/745] Linking target app/dpdk-test-flow-perf 00:02:54.631 [732/745] Linking target app/dpdk-test-sad 00:02:54.631 [733/745] Linking target app/dpdk-test-fib 00:02:54.631 [734/745] Linking target app/dpdk-test-security-perf 00:02:54.631 [735/745] Linking target app/dpdk-test-bbdev 00:02:54.631 [736/745] Linking target app/dpdk-test-eventdev 00:02:54.631 [737/745] Linking target app/dpdk-pdump 00:02:54.631 [738/745] Linking target app/dpdk-test-acl 00:02:54.631 [739/745] Linking target app/dpdk-test-gpudev 00:02:54.631 [740/745] Linking target app/dpdk-proc-info 00:02:54.631 [741/745] Linking target app/dpdk-test-crypto-perf 00:02:54.631 [742/745] Linking target app/dpdk-test-compress-perf 00:02:54.631 [743/745] Linking target app/dpdk-testpmd 00:02:55.573 [744/745] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:55.834 [745/745] Linking target lib/librte_pipeline.so.23.0 00:02:55.834 16:38:41 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:55.834 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:55.834 [0/1] Installing files. 00:02:56.099 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.099 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/flow_classify.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/ipv4_rules_file.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:56.100 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:56.101 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.102 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.103 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/kni.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:56.104 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:56.366 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:56.366 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.366 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.367 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.941 Installing lib/librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.941 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.941 Installing lib/librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.941 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.941 Installing drivers/librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:56.941 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.941 Installing drivers/librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:56.941 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.941 Installing drivers/librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:56.941 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.941 Installing drivers/librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:56.941 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.941 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.941 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.941 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.941 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:56.941 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:56.941 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:56.941 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:56.941 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:56.941 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:56.941 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:56.941 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:56.941 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:56.941 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:56.941 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.942 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.943 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.944 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_empty_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_intel_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.945 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:56.946 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:56.946 Installing symlink pointing to librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.23 00:02:56.946 Installing symlink pointing to librte_kvargs.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:56.946 Installing symlink pointing to librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.23 00:02:56.946 Installing symlink pointing to librte_telemetry.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:56.946 Installing symlink pointing to librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.23 00:02:56.946 Installing symlink pointing to librte_eal.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:56.946 Installing symlink pointing to librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.23 00:02:56.946 Installing symlink pointing to librte_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:56.946 Installing symlink pointing to librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.23 00:02:56.946 Installing symlink pointing to librte_rcu.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:56.946 Installing symlink pointing to librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.23 00:02:56.946 Installing symlink pointing to librte_mempool.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:56.946 Installing symlink pointing to librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.23 00:02:56.946 Installing symlink pointing to librte_mbuf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:56.946 Installing symlink pointing to librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.23 00:02:56.946 Installing symlink pointing to librte_net.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:56.946 Installing symlink pointing to librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.23 00:02:56.946 Installing symlink pointing to librte_meter.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:56.946 Installing symlink pointing to librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.23 00:02:56.946 Installing symlink pointing to librte_ethdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:56.946 Installing symlink pointing to librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.23 00:02:56.946 Installing symlink pointing to librte_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:56.946 Installing symlink pointing to librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.23 00:02:56.946 Installing symlink pointing to librte_cmdline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:56.946 Installing symlink pointing to librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.23 00:02:56.946 Installing symlink pointing to librte_metrics.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:56.946 Installing symlink pointing to librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.23 00:02:56.946 Installing symlink pointing to librte_hash.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:56.946 Installing symlink pointing to librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.23 00:02:56.946 Installing symlink pointing to librte_timer.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:56.946 Installing symlink pointing to librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.23 00:02:56.946 Installing symlink pointing to librte_acl.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:56.946 Installing symlink pointing to librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.23 00:02:56.946 Installing symlink pointing to librte_bbdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:56.946 Installing symlink pointing to librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.23 00:02:56.946 Installing symlink pointing to librte_bitratestats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:56.946 Installing symlink pointing to librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.23 00:02:56.946 Installing symlink pointing to librte_bpf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:56.947 Installing symlink pointing to librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.23 00:02:56.947 Installing symlink pointing to librte_cfgfile.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:56.947 Installing symlink pointing to librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.23 00:02:56.947 Installing symlink pointing to librte_compressdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:56.947 Installing symlink pointing to librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.23 00:02:56.947 Installing symlink pointing to librte_cryptodev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:56.947 Installing symlink pointing to librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.23 00:02:56.947 Installing symlink pointing to librte_distributor.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:56.947 Installing symlink pointing to librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.23 00:02:56.947 Installing symlink pointing to librte_efd.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:56.947 Installing symlink pointing to librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.23 00:02:56.947 Installing symlink pointing to librte_eventdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:56.947 Installing symlink pointing to librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.23 00:02:56.947 Installing symlink pointing to librte_gpudev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:56.947 Installing symlink pointing to librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.23 00:02:56.947 Installing symlink pointing to librte_gro.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:56.947 Installing symlink pointing to librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.23 00:02:56.947 Installing symlink pointing to librte_gso.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:56.947 Installing symlink pointing to librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.23 00:02:56.947 Installing symlink pointing to librte_ip_frag.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:56.947 Installing symlink pointing to librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.23 00:02:56.947 Installing symlink pointing to librte_jobstats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:56.947 Installing symlink pointing to librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.23 00:02:56.947 Installing symlink pointing to librte_latencystats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:56.947 Installing symlink pointing to librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.23 00:02:56.947 Installing symlink pointing to librte_lpm.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:56.947 Installing symlink pointing to librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.23 00:02:56.947 Installing symlink pointing to librte_member.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:56.947 Installing symlink pointing to librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.23 00:02:56.947 Installing symlink pointing to librte_pcapng.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:56.947 Installing symlink pointing to librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.23 00:02:56.947 Installing symlink pointing to librte_power.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:56.947 Installing symlink pointing to librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.23 00:02:56.947 Installing symlink pointing to librte_rawdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:56.947 Installing symlink pointing to librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.23 00:02:56.947 Installing symlink pointing to librte_regexdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:56.947 Installing symlink pointing to librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.23 00:02:56.947 Installing symlink pointing to librte_dmadev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:56.947 Installing symlink pointing to librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.23 00:02:56.947 Installing symlink pointing to librte_rib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:56.947 Installing symlink pointing to librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.23 00:02:56.947 Installing symlink pointing to librte_reorder.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:56.947 Installing symlink pointing to librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.23 00:02:56.947 Installing symlink pointing to librte_sched.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:56.947 Installing symlink pointing to librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.23 00:02:56.947 Installing symlink pointing to librte_security.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:56.947 Installing symlink pointing to librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.23 00:02:56.947 Installing symlink pointing to librte_stack.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:56.947 Installing symlink pointing to librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.23 00:02:56.947 Installing symlink pointing to librte_vhost.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:56.947 Installing symlink pointing to librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.23 00:02:56.947 Installing symlink pointing to librte_ipsec.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:56.947 Installing symlink pointing to librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.23 00:02:56.947 Installing symlink pointing to librte_fib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:56.947 Installing symlink pointing to librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.23 00:02:56.947 Installing symlink pointing to librte_port.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:56.947 Installing symlink pointing to librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.23 00:02:56.947 Installing symlink pointing to librte_pdump.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:56.947 Installing symlink pointing to librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.23 00:02:56.947 Installing symlink pointing to librte_table.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:56.948 Installing symlink pointing to librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.23 00:02:56.948 Installing symlink pointing to librte_pipeline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:56.948 Installing symlink pointing to librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.23 00:02:56.948 Installing symlink pointing to librte_graph.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:56.948 Installing symlink pointing to librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.23 00:02:56.948 Installing symlink pointing to librte_node.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:56.948 Installing symlink pointing to librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23 00:02:56.948 Installing symlink pointing to librte_bus_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:02:56.948 Installing symlink pointing to librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23 00:02:56.948 Installing symlink pointing to librte_bus_vdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:02:56.948 Installing symlink pointing to librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23 00:02:56.948 Installing symlink pointing to librte_mempool_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:02:56.948 Installing symlink pointing to librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23 00:02:56.948 './librte_bus_pci.so' -> 'dpdk/pmds-23.0/librte_bus_pci.so' 00:02:56.948 './librte_bus_pci.so.23' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23' 00:02:56.948 './librte_bus_pci.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23.0' 00:02:56.948 './librte_bus_vdev.so' -> 'dpdk/pmds-23.0/librte_bus_vdev.so' 00:02:56.948 './librte_bus_vdev.so.23' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23' 00:02:56.948 './librte_bus_vdev.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23.0' 00:02:56.948 './librte_mempool_ring.so' -> 'dpdk/pmds-23.0/librte_mempool_ring.so' 00:02:56.948 './librte_mempool_ring.so.23' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23' 00:02:56.948 './librte_mempool_ring.so.23.0' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23.0' 00:02:56.948 './librte_net_i40e.so' -> 'dpdk/pmds-23.0/librte_net_i40e.so' 00:02:56.948 './librte_net_i40e.so.23' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23' 00:02:56.948 './librte_net_i40e.so.23.0' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23.0' 00:02:56.948 Installing symlink pointing to librte_net_i40e.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:02:56.948 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-23.0' 00:02:56.948 16:38:42 -- common/autobuild_common.sh@192 -- $ uname -s 00:02:56.948 16:38:42 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:56.948 16:38:42 -- common/autobuild_common.sh@203 -- $ cat 00:02:56.948 16:38:42 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:56.948 00:02:56.948 real 1m20.915s 00:02:56.948 user 14m22.662s 00:02:56.948 sys 1m49.736s 00:02:56.948 16:38:42 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:56.948 16:38:42 -- common/autotest_common.sh@10 -- $ set +x 00:02:56.948 ************************************ 00:02:56.948 END TEST build_native_dpdk 00:02:56.948 ************************************ 00:02:56.948 16:38:42 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:56.948 16:38:42 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:56.948 16:38:42 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:56.948 16:38:42 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:56.948 16:38:42 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:56.948 16:38:42 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:56.948 16:38:42 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:56.948 16:38:42 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:56.948 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:57.207 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.207 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.207 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:57.467 Using 'verbs' RDMA provider 00:03:07.737 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:03:17.765 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:03:17.765 Creating mk/config.mk...done. 00:03:17.765 Creating mk/cc.flags.mk...done. 00:03:17.765 Type 'make' to build. 00:03:17.765 16:39:01 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:03:17.765 16:39:01 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:03:17.765 16:39:01 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:03:17.765 16:39:01 -- common/autotest_common.sh@10 -- $ set +x 00:03:17.765 ************************************ 00:03:17.765 START TEST make 00:03:17.765 ************************************ 00:03:17.765 16:39:01 -- common/autotest_common.sh@1114 -- $ make -j48 00:03:17.765 make[1]: Nothing to be done for 'all'. 00:03:18.340 The Meson build system 00:03:18.340 Version: 1.5.0 00:03:18.340 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:18.340 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:18.340 Build type: native build 00:03:18.340 Project name: libvfio-user 00:03:18.340 Project version: 0.0.1 00:03:18.340 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:03:18.340 C linker for the host machine: gcc ld.bfd 2.40-14 00:03:18.340 Host machine cpu family: x86_64 00:03:18.340 Host machine cpu: x86_64 00:03:18.340 Run-time dependency threads found: YES 00:03:18.340 Library dl found: YES 00:03:18.340 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:03:18.340 Run-time dependency json-c found: YES 0.17 00:03:18.340 Run-time dependency cmocka found: YES 1.1.7 00:03:18.340 Program pytest-3 found: NO 00:03:18.340 Program flake8 found: NO 00:03:18.341 Program misspell-fixer found: NO 00:03:18.341 Program restructuredtext-lint found: NO 00:03:18.341 Program valgrind found: YES (/usr/bin/valgrind) 00:03:18.341 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:18.341 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:18.341 Compiler for C supports arguments -Wwrite-strings: YES 00:03:18.341 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:18.341 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:18.341 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:18.341 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:18.341 Build targets in project: 8 00:03:18.341 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:18.341 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:18.341 00:03:18.341 libvfio-user 0.0.1 00:03:18.341 00:03:18.341 User defined options 00:03:18.341 buildtype : debug 00:03:18.341 default_library: shared 00:03:18.341 libdir : /usr/local/lib 00:03:18.341 00:03:18.341 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:18.912 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:19.176 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:19.176 [2/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:19.176 [3/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:19.176 [4/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:19.176 [5/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:19.437 [6/37] Compiling C object samples/null.p/null.c.o 00:03:19.437 [7/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:19.437 [8/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:19.437 [9/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:19.437 [10/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:19.437 [11/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:19.437 [12/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:19.437 [13/37] Compiling C object samples/server.p/server.c.o 00:03:19.437 [14/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:19.437 [15/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:19.437 [16/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:19.437 [17/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:19.437 [18/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:19.437 [19/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:19.437 [20/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:19.437 [21/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:19.437 [22/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:19.437 [23/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:19.437 [24/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:19.437 [25/37] Compiling C object samples/client.p/client.c.o 00:03:19.437 [26/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:19.437 [27/37] Linking target samples/client 00:03:19.699 [28/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:19.699 [29/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:19.699 [30/37] Linking target lib/libvfio-user.so.0.0.1 00:03:19.699 [31/37] Linking target test/unit_tests 00:03:19.963 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:19.963 [33/37] Linking target samples/server 00:03:19.963 [34/37] Linking target samples/gpio-pci-idio-16 00:03:19.963 [35/37] Linking target samples/lspci 00:03:19.963 [36/37] Linking target samples/null 00:03:19.963 [37/37] Linking target samples/shadow_ioeventfd_server 00:03:19.963 INFO: autodetecting backend as ninja 00:03:19.963 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:20.226 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:20.798 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:20.798 ninja: no work to do. 00:03:32.997 CC lib/ut/ut.o 00:03:32.997 CC lib/ut_mock/mock.o 00:03:32.997 CC lib/log/log.o 00:03:32.997 CC lib/log/log_flags.o 00:03:32.997 CC lib/log/log_deprecated.o 00:03:32.997 LIB libspdk_ut_mock.a 00:03:32.997 SO libspdk_ut_mock.so.5.0 00:03:32.997 LIB libspdk_ut.a 00:03:32.998 LIB libspdk_log.a 00:03:32.998 SO libspdk_ut.so.1.0 00:03:32.998 SO libspdk_log.so.6.1 00:03:32.998 SYMLINK libspdk_ut_mock.so 00:03:32.998 SYMLINK libspdk_ut.so 00:03:32.998 SYMLINK libspdk_log.so 00:03:32.998 CXX lib/trace_parser/trace.o 00:03:32.998 CC lib/ioat/ioat.o 00:03:32.998 CC lib/dma/dma.o 00:03:32.998 CC lib/util/base64.o 00:03:32.998 CC lib/util/bit_array.o 00:03:32.998 CC lib/util/cpuset.o 00:03:32.998 CC lib/util/crc16.o 00:03:32.998 CC lib/util/crc32.o 00:03:32.998 CC lib/util/crc32c.o 00:03:32.998 CC lib/util/crc32_ieee.o 00:03:32.998 CC lib/util/crc64.o 00:03:32.998 CC lib/util/dif.o 00:03:32.998 CC lib/util/fd.o 00:03:32.998 CC lib/util/file.o 00:03:32.998 CC lib/util/hexlify.o 00:03:32.998 CC lib/util/iov.o 00:03:32.998 CC lib/util/math.o 00:03:32.998 CC lib/util/pipe.o 00:03:32.998 CC lib/util/strerror_tls.o 00:03:32.998 CC lib/util/string.o 00:03:32.998 CC lib/util/uuid.o 00:03:32.998 CC lib/util/fd_group.o 00:03:32.998 CC lib/util/xor.o 00:03:32.998 CC lib/util/zipf.o 00:03:32.998 CC lib/vfio_user/host/vfio_user_pci.o 00:03:32.998 CC lib/vfio_user/host/vfio_user.o 00:03:32.998 LIB libspdk_dma.a 00:03:32.998 SO libspdk_dma.so.3.0 00:03:32.998 SYMLINK libspdk_dma.so 00:03:32.998 LIB libspdk_ioat.a 00:03:32.998 SO libspdk_ioat.so.6.0 00:03:32.998 SYMLINK libspdk_ioat.so 00:03:32.998 LIB libspdk_vfio_user.a 00:03:32.998 SO libspdk_vfio_user.so.4.0 00:03:32.998 SYMLINK libspdk_vfio_user.so 00:03:32.998 LIB libspdk_util.a 00:03:32.998 SO libspdk_util.so.8.0 00:03:32.998 SYMLINK libspdk_util.so 00:03:32.998 CC lib/idxd/idxd.o 00:03:32.998 CC lib/conf/conf.o 00:03:32.998 CC lib/json/json_parse.o 00:03:32.998 CC lib/vmd/vmd.o 00:03:32.998 CC lib/env_dpdk/env.o 00:03:32.998 CC lib/rdma/common.o 00:03:32.998 CC lib/vmd/led.o 00:03:32.998 CC lib/idxd/idxd_user.o 00:03:32.998 CC lib/json/json_util.o 00:03:32.998 CC lib/rdma/rdma_verbs.o 00:03:32.998 CC lib/env_dpdk/memory.o 00:03:32.998 CC lib/idxd/idxd_kernel.o 00:03:32.998 CC lib/env_dpdk/pci.o 00:03:32.998 CC lib/json/json_write.o 00:03:32.998 CC lib/env_dpdk/init.o 00:03:32.998 CC lib/env_dpdk/threads.o 00:03:32.998 CC lib/env_dpdk/pci_ioat.o 00:03:32.998 CC lib/env_dpdk/pci_virtio.o 00:03:32.998 CC lib/env_dpdk/pci_vmd.o 00:03:32.998 CC lib/env_dpdk/pci_idxd.o 00:03:32.998 CC lib/env_dpdk/pci_event.o 00:03:32.998 CC lib/env_dpdk/sigbus_handler.o 00:03:32.998 CC lib/env_dpdk/pci_dpdk.o 00:03:32.998 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:32.998 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:32.998 LIB libspdk_trace_parser.a 00:03:32.998 SO libspdk_trace_parser.so.4.0 00:03:32.998 SYMLINK libspdk_trace_parser.so 00:03:32.998 LIB libspdk_rdma.a 00:03:32.998 LIB libspdk_json.a 00:03:32.998 LIB libspdk_conf.a 00:03:32.998 SO libspdk_rdma.so.5.0 00:03:32.998 SO libspdk_conf.so.5.0 00:03:32.998 SO libspdk_json.so.5.1 00:03:32.998 SYMLINK libspdk_conf.so 00:03:32.998 SYMLINK libspdk_rdma.so 00:03:32.998 SYMLINK libspdk_json.so 00:03:32.998 CC lib/jsonrpc/jsonrpc_server.o 00:03:32.998 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:32.998 CC lib/jsonrpc/jsonrpc_client.o 00:03:32.998 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:32.998 LIB libspdk_idxd.a 00:03:32.998 SO libspdk_idxd.so.11.0 00:03:33.258 SYMLINK libspdk_idxd.so 00:03:33.258 LIB libspdk_vmd.a 00:03:33.258 SO libspdk_vmd.so.5.0 00:03:33.258 SYMLINK libspdk_vmd.so 00:03:33.258 LIB libspdk_jsonrpc.a 00:03:33.258 SO libspdk_jsonrpc.so.5.1 00:03:33.258 SYMLINK libspdk_jsonrpc.so 00:03:33.517 CC lib/rpc/rpc.o 00:03:33.517 LIB libspdk_rpc.a 00:03:33.775 SO libspdk_rpc.so.5.0 00:03:33.775 SYMLINK libspdk_rpc.so 00:03:33.775 CC lib/trace/trace.o 00:03:33.775 CC lib/notify/notify.o 00:03:33.775 CC lib/trace/trace_flags.o 00:03:33.775 CC lib/notify/notify_rpc.o 00:03:33.775 CC lib/sock/sock.o 00:03:33.775 CC lib/trace/trace_rpc.o 00:03:33.775 CC lib/sock/sock_rpc.o 00:03:34.033 LIB libspdk_notify.a 00:03:34.033 SO libspdk_notify.so.5.0 00:03:34.033 LIB libspdk_trace.a 00:03:34.033 SYMLINK libspdk_notify.so 00:03:34.033 SO libspdk_trace.so.9.0 00:03:34.033 SYMLINK libspdk_trace.so 00:03:34.292 LIB libspdk_sock.a 00:03:34.292 SO libspdk_sock.so.8.0 00:03:34.292 CC lib/thread/thread.o 00:03:34.292 CC lib/thread/iobuf.o 00:03:34.292 SYMLINK libspdk_sock.so 00:03:34.292 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:34.292 CC lib/nvme/nvme_ctrlr.o 00:03:34.292 CC lib/nvme/nvme_fabric.o 00:03:34.292 CC lib/nvme/nvme_ns_cmd.o 00:03:34.292 CC lib/nvme/nvme_ns.o 00:03:34.292 CC lib/nvme/nvme_pcie_common.o 00:03:34.292 CC lib/nvme/nvme_pcie.o 00:03:34.292 CC lib/nvme/nvme_qpair.o 00:03:34.292 CC lib/nvme/nvme.o 00:03:34.292 CC lib/nvme/nvme_quirks.o 00:03:34.292 CC lib/nvme/nvme_transport.o 00:03:34.292 CC lib/nvme/nvme_discovery.o 00:03:34.292 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:34.292 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:34.292 CC lib/nvme/nvme_tcp.o 00:03:34.292 CC lib/nvme/nvme_opal.o 00:03:34.292 CC lib/nvme/nvme_io_msg.o 00:03:34.292 CC lib/nvme/nvme_poll_group.o 00:03:34.292 CC lib/nvme/nvme_zns.o 00:03:34.292 CC lib/nvme/nvme_cuse.o 00:03:34.292 CC lib/nvme/nvme_vfio_user.o 00:03:34.292 CC lib/nvme/nvme_rdma.o 00:03:34.551 LIB libspdk_env_dpdk.a 00:03:34.551 SO libspdk_env_dpdk.so.13.0 00:03:34.810 SYMLINK libspdk_env_dpdk.so 00:03:35.744 LIB libspdk_thread.a 00:03:36.003 SO libspdk_thread.so.9.0 00:03:36.003 SYMLINK libspdk_thread.so 00:03:36.003 CC lib/init/json_config.o 00:03:36.003 CC lib/init/subsystem.o 00:03:36.003 CC lib/init/subsystem_rpc.o 00:03:36.003 CC lib/blob/blobstore.o 00:03:36.003 CC lib/accel/accel.o 00:03:36.003 CC lib/blob/request.o 00:03:36.003 CC lib/accel/accel_rpc.o 00:03:36.003 CC lib/init/rpc.o 00:03:36.003 CC lib/blob/zeroes.o 00:03:36.003 CC lib/vfu_tgt/tgt_endpoint.o 00:03:36.003 CC lib/accel/accel_sw.o 00:03:36.003 CC lib/blob/blob_bs_dev.o 00:03:36.003 CC lib/virtio/virtio.o 00:03:36.003 CC lib/vfu_tgt/tgt_rpc.o 00:03:36.003 CC lib/virtio/virtio_vhost_user.o 00:03:36.003 CC lib/virtio/virtio_vfio_user.o 00:03:36.003 CC lib/virtio/virtio_pci.o 00:03:36.261 LIB libspdk_init.a 00:03:36.261 SO libspdk_init.so.4.0 00:03:36.520 SYMLINK libspdk_init.so 00:03:36.520 LIB libspdk_virtio.a 00:03:36.520 LIB libspdk_vfu_tgt.a 00:03:36.520 SO libspdk_vfu_tgt.so.2.0 00:03:36.520 SO libspdk_virtio.so.6.0 00:03:36.520 SYMLINK libspdk_vfu_tgt.so 00:03:36.520 SYMLINK libspdk_virtio.so 00:03:36.520 CC lib/event/app.o 00:03:36.520 CC lib/event/reactor.o 00:03:36.520 CC lib/event/log_rpc.o 00:03:36.520 CC lib/event/app_rpc.o 00:03:36.520 CC lib/event/scheduler_static.o 00:03:36.778 LIB libspdk_nvme.a 00:03:36.778 SO libspdk_nvme.so.12.0 00:03:37.036 LIB libspdk_event.a 00:03:37.036 SO libspdk_event.so.12.0 00:03:37.036 SYMLINK libspdk_event.so 00:03:37.036 SYMLINK libspdk_nvme.so 00:03:37.036 LIB libspdk_accel.a 00:03:37.036 SO libspdk_accel.so.14.0 00:03:37.294 SYMLINK libspdk_accel.so 00:03:37.294 CC lib/bdev/bdev.o 00:03:37.295 CC lib/bdev/bdev_rpc.o 00:03:37.295 CC lib/bdev/bdev_zone.o 00:03:37.295 CC lib/bdev/part.o 00:03:37.295 CC lib/bdev/scsi_nvme.o 00:03:39.195 LIB libspdk_blob.a 00:03:39.195 SO libspdk_blob.so.10.1 00:03:39.195 SYMLINK libspdk_blob.so 00:03:39.195 CC lib/blobfs/blobfs.o 00:03:39.195 CC lib/blobfs/tree.o 00:03:39.195 CC lib/lvol/lvol.o 00:03:39.761 LIB libspdk_bdev.a 00:03:39.761 LIB libspdk_blobfs.a 00:03:39.761 SO libspdk_blobfs.so.9.0 00:03:39.761 SO libspdk_bdev.so.14.0 00:03:39.761 SYMLINK libspdk_blobfs.so 00:03:40.023 SYMLINK libspdk_bdev.so 00:03:40.023 LIB libspdk_lvol.a 00:03:40.023 SO libspdk_lvol.so.9.1 00:03:40.023 SYMLINK libspdk_lvol.so 00:03:40.023 CC lib/nbd/nbd.o 00:03:40.023 CC lib/scsi/dev.o 00:03:40.023 CC lib/scsi/lun.o 00:03:40.023 CC lib/nbd/nbd_rpc.o 00:03:40.023 CC lib/scsi/port.o 00:03:40.023 CC lib/ublk/ublk.o 00:03:40.023 CC lib/scsi/scsi.o 00:03:40.023 CC lib/nvmf/ctrlr.o 00:03:40.023 CC lib/ftl/ftl_core.o 00:03:40.023 CC lib/ublk/ublk_rpc.o 00:03:40.023 CC lib/scsi/scsi_bdev.o 00:03:40.023 CC lib/ftl/ftl_init.o 00:03:40.023 CC lib/scsi/scsi_pr.o 00:03:40.023 CC lib/nvmf/ctrlr_discovery.o 00:03:40.023 CC lib/scsi/scsi_rpc.o 00:03:40.023 CC lib/ftl/ftl_layout.o 00:03:40.023 CC lib/nvmf/ctrlr_bdev.o 00:03:40.023 CC lib/scsi/task.o 00:03:40.023 CC lib/ftl/ftl_debug.o 00:03:40.023 CC lib/nvmf/subsystem.o 00:03:40.023 CC lib/ftl/ftl_io.o 00:03:40.023 CC lib/nvmf/nvmf.o 00:03:40.023 CC lib/ftl/ftl_sb.o 00:03:40.023 CC lib/nvmf/nvmf_rpc.o 00:03:40.023 CC lib/ftl/ftl_l2p.o 00:03:40.023 CC lib/nvmf/transport.o 00:03:40.023 CC lib/ftl/ftl_l2p_flat.o 00:03:40.023 CC lib/nvmf/tcp.o 00:03:40.023 CC lib/nvmf/vfio_user.o 00:03:40.023 CC lib/nvmf/rdma.o 00:03:40.023 CC lib/ftl/ftl_nv_cache.o 00:03:40.023 CC lib/ftl/ftl_band.o 00:03:40.023 CC lib/ftl/ftl_band_ops.o 00:03:40.023 CC lib/ftl/ftl_writer.o 00:03:40.023 CC lib/ftl/ftl_rq.o 00:03:40.023 CC lib/ftl/ftl_l2p_cache.o 00:03:40.023 CC lib/ftl/ftl_reloc.o 00:03:40.023 CC lib/ftl/ftl_p2l.o 00:03:40.023 CC lib/ftl/mngt/ftl_mngt.o 00:03:40.023 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:40.023 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:40.023 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:40.023 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:40.023 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:40.023 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:40.023 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:40.023 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:40.023 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:40.285 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:40.285 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:40.285 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:40.285 CC lib/ftl/utils/ftl_conf.o 00:03:40.285 CC lib/ftl/utils/ftl_md.o 00:03:40.553 CC lib/ftl/utils/ftl_mempool.o 00:03:40.553 CC lib/ftl/utils/ftl_bitmap.o 00:03:40.553 CC lib/ftl/utils/ftl_property.o 00:03:40.553 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:40.553 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:40.553 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:40.553 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:40.553 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:40.553 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:40.553 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:40.553 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:40.553 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:40.553 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:40.553 CC lib/ftl/base/ftl_base_dev.o 00:03:40.553 CC lib/ftl/base/ftl_base_bdev.o 00:03:40.553 CC lib/ftl/ftl_trace.o 00:03:40.811 LIB libspdk_nbd.a 00:03:40.811 SO libspdk_nbd.so.6.0 00:03:40.811 SYMLINK libspdk_nbd.so 00:03:40.811 LIB libspdk_scsi.a 00:03:41.070 SO libspdk_scsi.so.8.0 00:03:41.070 LIB libspdk_ublk.a 00:03:41.070 SO libspdk_ublk.so.2.0 00:03:41.070 SYMLINK libspdk_scsi.so 00:03:41.070 SYMLINK libspdk_ublk.so 00:03:41.070 CC lib/vhost/vhost.o 00:03:41.070 CC lib/iscsi/conn.o 00:03:41.070 CC lib/iscsi/init_grp.o 00:03:41.070 CC lib/vhost/vhost_rpc.o 00:03:41.070 CC lib/iscsi/iscsi.o 00:03:41.070 CC lib/vhost/vhost_scsi.o 00:03:41.070 CC lib/iscsi/md5.o 00:03:41.070 CC lib/vhost/vhost_blk.o 00:03:41.070 CC lib/iscsi/param.o 00:03:41.070 CC lib/vhost/rte_vhost_user.o 00:03:41.070 CC lib/iscsi/portal_grp.o 00:03:41.070 CC lib/iscsi/tgt_node.o 00:03:41.070 CC lib/iscsi/iscsi_subsystem.o 00:03:41.070 CC lib/iscsi/iscsi_rpc.o 00:03:41.070 CC lib/iscsi/task.o 00:03:41.329 LIB libspdk_ftl.a 00:03:41.587 SO libspdk_ftl.so.8.0 00:03:41.845 SYMLINK libspdk_ftl.so 00:03:42.411 LIB libspdk_vhost.a 00:03:42.411 SO libspdk_vhost.so.7.1 00:03:42.411 SYMLINK libspdk_vhost.so 00:03:42.670 LIB libspdk_nvmf.a 00:03:42.670 LIB libspdk_iscsi.a 00:03:42.670 SO libspdk_nvmf.so.17.0 00:03:42.670 SO libspdk_iscsi.so.7.0 00:03:42.670 SYMLINK libspdk_nvmf.so 00:03:42.670 SYMLINK libspdk_iscsi.so 00:03:42.928 CC module/vfu_device/vfu_virtio.o 00:03:42.928 CC module/vfu_device/vfu_virtio_blk.o 00:03:42.928 CC module/vfu_device/vfu_virtio_scsi.o 00:03:42.928 CC module/vfu_device/vfu_virtio_rpc.o 00:03:42.928 CC module/env_dpdk/env_dpdk_rpc.o 00:03:42.928 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:42.929 CC module/blob/bdev/blob_bdev.o 00:03:42.929 CC module/accel/error/accel_error.o 00:03:42.929 CC module/sock/posix/posix.o 00:03:42.929 CC module/accel/error/accel_error_rpc.o 00:03:42.929 CC module/scheduler/gscheduler/gscheduler.o 00:03:42.929 CC module/accel/ioat/accel_ioat.o 00:03:42.929 CC module/accel/ioat/accel_ioat_rpc.o 00:03:42.929 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:42.929 CC module/accel/iaa/accel_iaa.o 00:03:42.929 CC module/accel/dsa/accel_dsa.o 00:03:42.929 CC module/accel/iaa/accel_iaa_rpc.o 00:03:42.929 CC module/accel/dsa/accel_dsa_rpc.o 00:03:43.187 LIB libspdk_env_dpdk_rpc.a 00:03:43.187 SO libspdk_env_dpdk_rpc.so.5.0 00:03:43.187 SYMLINK libspdk_env_dpdk_rpc.so 00:03:43.187 LIB libspdk_scheduler_gscheduler.a 00:03:43.187 LIB libspdk_scheduler_dpdk_governor.a 00:03:43.187 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:43.187 SO libspdk_scheduler_gscheduler.so.3.0 00:03:43.187 LIB libspdk_accel_error.a 00:03:43.187 LIB libspdk_accel_ioat.a 00:03:43.187 LIB libspdk_scheduler_dynamic.a 00:03:43.187 SO libspdk_accel_error.so.1.0 00:03:43.187 LIB libspdk_accel_iaa.a 00:03:43.187 SO libspdk_accel_ioat.so.5.0 00:03:43.187 SYMLINK libspdk_scheduler_gscheduler.so 00:03:43.187 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:43.187 SO libspdk_scheduler_dynamic.so.3.0 00:03:43.187 SO libspdk_accel_iaa.so.2.0 00:03:43.187 LIB libspdk_accel_dsa.a 00:03:43.187 SYMLINK libspdk_accel_error.so 00:03:43.187 SYMLINK libspdk_accel_ioat.so 00:03:43.187 SYMLINK libspdk_scheduler_dynamic.so 00:03:43.187 LIB libspdk_blob_bdev.a 00:03:43.187 SO libspdk_accel_dsa.so.4.0 00:03:43.449 SYMLINK libspdk_accel_iaa.so 00:03:43.449 SO libspdk_blob_bdev.so.10.1 00:03:43.449 SYMLINK libspdk_accel_dsa.so 00:03:43.449 SYMLINK libspdk_blob_bdev.so 00:03:43.449 CC module/bdev/nvme/bdev_nvme.o 00:03:43.449 CC module/bdev/error/vbdev_error.o 00:03:43.449 CC module/bdev/gpt/gpt.o 00:03:43.449 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:43.449 CC module/bdev/null/bdev_null.o 00:03:43.449 CC module/bdev/error/vbdev_error_rpc.o 00:03:43.449 CC module/bdev/malloc/bdev_malloc.o 00:03:43.449 CC module/blobfs/bdev/blobfs_bdev.o 00:03:43.449 CC module/bdev/delay/vbdev_delay.o 00:03:43.449 CC module/bdev/nvme/nvme_rpc.o 00:03:43.449 CC module/bdev/null/bdev_null_rpc.o 00:03:43.449 CC module/bdev/gpt/vbdev_gpt.o 00:03:43.449 CC module/bdev/split/vbdev_split.o 00:03:43.449 CC module/bdev/passthru/vbdev_passthru.o 00:03:43.449 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:43.449 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:43.449 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:43.449 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:43.449 CC module/bdev/nvme/bdev_mdns_client.o 00:03:43.449 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:43.449 CC module/bdev/split/vbdev_split_rpc.o 00:03:43.449 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:43.449 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:43.449 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:43.449 CC module/bdev/nvme/vbdev_opal.o 00:03:43.449 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:43.449 CC module/bdev/lvol/vbdev_lvol.o 00:03:43.449 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:43.449 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:43.449 CC module/bdev/raid/bdev_raid.o 00:03:43.449 CC module/bdev/aio/bdev_aio.o 00:03:43.449 CC module/bdev/iscsi/bdev_iscsi.o 00:03:43.449 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:43.449 CC module/bdev/ftl/bdev_ftl.o 00:03:43.449 CC module/bdev/raid/bdev_raid_rpc.o 00:03:43.449 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:43.449 CC module/bdev/raid/bdev_raid_sb.o 00:03:43.449 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:43.449 CC module/bdev/aio/bdev_aio_rpc.o 00:03:43.449 CC module/bdev/raid/raid0.o 00:03:43.449 CC module/bdev/raid/raid1.o 00:03:43.449 CC module/bdev/raid/concat.o 00:03:43.707 LIB libspdk_vfu_device.a 00:03:43.707 SO libspdk_vfu_device.so.2.0 00:03:43.965 SYMLINK libspdk_vfu_device.so 00:03:43.965 LIB libspdk_blobfs_bdev.a 00:03:43.965 LIB libspdk_sock_posix.a 00:03:43.979 SO libspdk_blobfs_bdev.so.5.0 00:03:43.979 LIB libspdk_bdev_passthru.a 00:03:43.979 SO libspdk_sock_posix.so.5.0 00:03:43.979 SO libspdk_bdev_passthru.so.5.0 00:03:43.979 LIB libspdk_bdev_gpt.a 00:03:43.979 LIB libspdk_bdev_split.a 00:03:43.979 SO libspdk_bdev_gpt.so.5.0 00:03:43.979 SYMLINK libspdk_blobfs_bdev.so 00:03:43.979 SO libspdk_bdev_split.so.5.0 00:03:43.979 SYMLINK libspdk_bdev_passthru.so 00:03:43.979 LIB libspdk_bdev_null.a 00:03:43.979 SYMLINK libspdk_sock_posix.so 00:03:43.979 LIB libspdk_bdev_error.a 00:03:43.979 LIB libspdk_bdev_ftl.a 00:03:43.979 SYMLINK libspdk_bdev_gpt.so 00:03:43.979 SO libspdk_bdev_null.so.5.0 00:03:43.979 SO libspdk_bdev_error.so.5.0 00:03:43.979 SO libspdk_bdev_ftl.so.5.0 00:03:43.979 SYMLINK libspdk_bdev_split.so 00:03:43.979 LIB libspdk_bdev_zone_block.a 00:03:44.237 LIB libspdk_bdev_aio.a 00:03:44.237 SO libspdk_bdev_zone_block.so.5.0 00:03:44.237 SYMLINK libspdk_bdev_null.so 00:03:44.237 SO libspdk_bdev_aio.so.5.0 00:03:44.237 SYMLINK libspdk_bdev_error.so 00:03:44.237 SYMLINK libspdk_bdev_ftl.so 00:03:44.237 LIB libspdk_bdev_delay.a 00:03:44.237 SO libspdk_bdev_delay.so.5.0 00:03:44.237 SYMLINK libspdk_bdev_zone_block.so 00:03:44.237 SYMLINK libspdk_bdev_aio.so 00:03:44.237 LIB libspdk_bdev_iscsi.a 00:03:44.237 LIB libspdk_bdev_malloc.a 00:03:44.237 SO libspdk_bdev_iscsi.so.5.0 00:03:44.237 SYMLINK libspdk_bdev_delay.so 00:03:44.237 SO libspdk_bdev_malloc.so.5.0 00:03:44.237 SYMLINK libspdk_bdev_iscsi.so 00:03:44.237 SYMLINK libspdk_bdev_malloc.so 00:03:44.237 LIB libspdk_bdev_lvol.a 00:03:44.237 LIB libspdk_bdev_virtio.a 00:03:44.237 SO libspdk_bdev_lvol.so.5.0 00:03:44.495 SO libspdk_bdev_virtio.so.5.0 00:03:44.495 SYMLINK libspdk_bdev_lvol.so 00:03:44.495 SYMLINK libspdk_bdev_virtio.so 00:03:44.753 LIB libspdk_bdev_raid.a 00:03:44.753 SO libspdk_bdev_raid.so.5.0 00:03:44.753 SYMLINK libspdk_bdev_raid.so 00:03:46.127 LIB libspdk_bdev_nvme.a 00:03:46.127 SO libspdk_bdev_nvme.so.6.0 00:03:46.127 SYMLINK libspdk_bdev_nvme.so 00:03:46.386 CC module/event/subsystems/scheduler/scheduler.o 00:03:46.386 CC module/event/subsystems/iobuf/iobuf.o 00:03:46.386 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:46.386 CC module/event/subsystems/vmd/vmd.o 00:03:46.386 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:46.386 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:46.386 CC module/event/subsystems/sock/sock.o 00:03:46.386 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:46.386 LIB libspdk_event_sock.a 00:03:46.386 LIB libspdk_event_vhost_blk.a 00:03:46.386 LIB libspdk_event_scheduler.a 00:03:46.386 LIB libspdk_event_vmd.a 00:03:46.386 LIB libspdk_event_vfu_tgt.a 00:03:46.386 LIB libspdk_event_iobuf.a 00:03:46.386 SO libspdk_event_sock.so.4.0 00:03:46.386 SO libspdk_event_vhost_blk.so.2.0 00:03:46.386 SO libspdk_event_scheduler.so.3.0 00:03:46.386 SO libspdk_event_vfu_tgt.so.2.0 00:03:46.386 SO libspdk_event_vmd.so.5.0 00:03:46.644 SO libspdk_event_iobuf.so.2.0 00:03:46.644 SYMLINK libspdk_event_sock.so 00:03:46.644 SYMLINK libspdk_event_vhost_blk.so 00:03:46.644 SYMLINK libspdk_event_scheduler.so 00:03:46.644 SYMLINK libspdk_event_vfu_tgt.so 00:03:46.644 SYMLINK libspdk_event_vmd.so 00:03:46.644 SYMLINK libspdk_event_iobuf.so 00:03:46.644 CC module/event/subsystems/accel/accel.o 00:03:46.902 LIB libspdk_event_accel.a 00:03:46.902 SO libspdk_event_accel.so.5.0 00:03:46.902 SYMLINK libspdk_event_accel.so 00:03:46.902 CC module/event/subsystems/bdev/bdev.o 00:03:47.160 LIB libspdk_event_bdev.a 00:03:47.160 SO libspdk_event_bdev.so.5.0 00:03:47.160 SYMLINK libspdk_event_bdev.so 00:03:47.418 CC module/event/subsystems/scsi/scsi.o 00:03:47.418 CC module/event/subsystems/ublk/ublk.o 00:03:47.418 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:47.418 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:47.418 CC module/event/subsystems/nbd/nbd.o 00:03:47.418 LIB libspdk_event_ublk.a 00:03:47.418 LIB libspdk_event_nbd.a 00:03:47.418 LIB libspdk_event_scsi.a 00:03:47.418 SO libspdk_event_ublk.so.2.0 00:03:47.418 SO libspdk_event_nbd.so.5.0 00:03:47.677 SO libspdk_event_scsi.so.5.0 00:03:47.677 SYMLINK libspdk_event_nbd.so 00:03:47.677 SYMLINK libspdk_event_ublk.so 00:03:47.677 SYMLINK libspdk_event_scsi.so 00:03:47.677 LIB libspdk_event_nvmf.a 00:03:47.677 SO libspdk_event_nvmf.so.5.0 00:03:47.677 SYMLINK libspdk_event_nvmf.so 00:03:47.677 CC module/event/subsystems/iscsi/iscsi.o 00:03:47.677 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:47.935 LIB libspdk_event_vhost_scsi.a 00:03:47.935 LIB libspdk_event_iscsi.a 00:03:47.935 SO libspdk_event_vhost_scsi.so.2.0 00:03:47.935 SO libspdk_event_iscsi.so.5.0 00:03:47.935 SYMLINK libspdk_event_vhost_scsi.so 00:03:47.935 SYMLINK libspdk_event_iscsi.so 00:03:47.935 SO libspdk.so.5.0 00:03:47.935 SYMLINK libspdk.so 00:03:48.199 CXX app/trace/trace.o 00:03:48.199 CC app/trace_record/trace_record.o 00:03:48.199 CC app/spdk_lspci/spdk_lspci.o 00:03:48.199 CC app/spdk_nvme_identify/identify.o 00:03:48.199 CC app/spdk_nvme_perf/perf.o 00:03:48.199 CC app/spdk_nvme_discover/discovery_aer.o 00:03:48.199 CC app/spdk_top/spdk_top.o 00:03:48.199 CC test/rpc_client/rpc_client_test.o 00:03:48.199 TEST_HEADER include/spdk/accel.h 00:03:48.199 TEST_HEADER include/spdk/accel_module.h 00:03:48.199 TEST_HEADER include/spdk/assert.h 00:03:48.199 TEST_HEADER include/spdk/barrier.h 00:03:48.199 TEST_HEADER include/spdk/base64.h 00:03:48.199 TEST_HEADER include/spdk/bdev.h 00:03:48.199 TEST_HEADER include/spdk/bdev_module.h 00:03:48.199 TEST_HEADER include/spdk/bdev_zone.h 00:03:48.199 TEST_HEADER include/spdk/bit_array.h 00:03:48.199 TEST_HEADER include/spdk/bit_pool.h 00:03:48.199 TEST_HEADER include/spdk/blob_bdev.h 00:03:48.199 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:48.199 TEST_HEADER include/spdk/blobfs.h 00:03:48.199 TEST_HEADER include/spdk/blob.h 00:03:48.199 TEST_HEADER include/spdk/conf.h 00:03:48.199 TEST_HEADER include/spdk/config.h 00:03:48.199 CC app/spdk_dd/spdk_dd.o 00:03:48.199 TEST_HEADER include/spdk/cpuset.h 00:03:48.199 TEST_HEADER include/spdk/crc16.h 00:03:48.199 TEST_HEADER include/spdk/crc32.h 00:03:48.199 CC app/iscsi_tgt/iscsi_tgt.o 00:03:48.199 TEST_HEADER include/spdk/crc64.h 00:03:48.199 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:48.199 TEST_HEADER include/spdk/dif.h 00:03:48.199 TEST_HEADER include/spdk/dma.h 00:03:48.199 TEST_HEADER include/spdk/endian.h 00:03:48.199 CC app/vhost/vhost.o 00:03:48.199 CC app/nvmf_tgt/nvmf_main.o 00:03:48.199 TEST_HEADER include/spdk/env_dpdk.h 00:03:48.199 CC test/nvme/reset/reset.o 00:03:48.199 CC examples/vmd/led/led.o 00:03:48.199 TEST_HEADER include/spdk/env.h 00:03:48.199 CC test/nvme/sgl/sgl.o 00:03:48.199 CC test/thread/poller_perf/poller_perf.o 00:03:48.199 CC test/app/jsoncat/jsoncat.o 00:03:48.199 CC examples/util/zipf/zipf.o 00:03:48.199 TEST_HEADER include/spdk/event.h 00:03:48.199 CC test/nvme/aer/aer.o 00:03:48.199 CC test/nvme/err_injection/err_injection.o 00:03:48.199 CC test/app/stub/stub.o 00:03:48.199 CC test/event/event_perf/event_perf.o 00:03:48.199 CC examples/vmd/lsvmd/lsvmd.o 00:03:48.199 CC examples/sock/hello_world/hello_sock.o 00:03:48.199 TEST_HEADER include/spdk/fd_group.h 00:03:48.199 CC examples/idxd/perf/perf.o 00:03:48.199 TEST_HEADER include/spdk/fd.h 00:03:48.199 TEST_HEADER include/spdk/file.h 00:03:48.199 CC app/fio/nvme/fio_plugin.o 00:03:48.200 TEST_HEADER include/spdk/ftl.h 00:03:48.200 TEST_HEADER include/spdk/gpt_spec.h 00:03:48.200 CC test/nvme/e2edp/nvme_dp.o 00:03:48.200 CC examples/ioat/perf/perf.o 00:03:48.200 CC test/app/histogram_perf/histogram_perf.o 00:03:48.200 CC examples/nvme/hello_world/hello_world.o 00:03:48.200 TEST_HEADER include/spdk/hexlify.h 00:03:48.200 CC examples/accel/perf/accel_perf.o 00:03:48.200 TEST_HEADER include/spdk/histogram_data.h 00:03:48.200 CC test/nvme/overhead/overhead.o 00:03:48.200 TEST_HEADER include/spdk/idxd.h 00:03:48.200 CC app/spdk_tgt/spdk_tgt.o 00:03:48.200 TEST_HEADER include/spdk/idxd_spec.h 00:03:48.462 TEST_HEADER include/spdk/init.h 00:03:48.462 TEST_HEADER include/spdk/ioat.h 00:03:48.462 TEST_HEADER include/spdk/ioat_spec.h 00:03:48.462 TEST_HEADER include/spdk/iscsi_spec.h 00:03:48.462 TEST_HEADER include/spdk/json.h 00:03:48.462 TEST_HEADER include/spdk/jsonrpc.h 00:03:48.462 TEST_HEADER include/spdk/likely.h 00:03:48.462 TEST_HEADER include/spdk/log.h 00:03:48.462 TEST_HEADER include/spdk/lvol.h 00:03:48.462 CC examples/blob/hello_world/hello_blob.o 00:03:48.462 CC test/blobfs/mkfs/mkfs.o 00:03:48.462 TEST_HEADER include/spdk/memory.h 00:03:48.462 CC examples/bdev/hello_world/hello_bdev.o 00:03:48.462 TEST_HEADER include/spdk/mmio.h 00:03:48.462 CC test/bdev/bdevio/bdevio.o 00:03:48.462 CC examples/bdev/bdevperf/bdevperf.o 00:03:48.462 CC examples/nvmf/nvmf/nvmf.o 00:03:48.462 CC test/accel/dif/dif.o 00:03:48.462 TEST_HEADER include/spdk/nbd.h 00:03:48.462 TEST_HEADER include/spdk/notify.h 00:03:48.462 CC examples/thread/thread/thread_ex.o 00:03:48.462 CC test/app/bdev_svc/bdev_svc.o 00:03:48.462 TEST_HEADER include/spdk/nvme.h 00:03:48.462 TEST_HEADER include/spdk/nvme_intel.h 00:03:48.462 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:48.462 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:48.462 TEST_HEADER include/spdk/nvme_spec.h 00:03:48.462 CC test/env/mem_callbacks/mem_callbacks.o 00:03:48.462 TEST_HEADER include/spdk/nvme_zns.h 00:03:48.462 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:48.462 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:48.462 CC test/dma/test_dma/test_dma.o 00:03:48.462 TEST_HEADER include/spdk/nvmf.h 00:03:48.462 TEST_HEADER include/spdk/nvmf_spec.h 00:03:48.462 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:48.462 CC test/lvol/esnap/esnap.o 00:03:48.462 TEST_HEADER include/spdk/nvmf_transport.h 00:03:48.462 TEST_HEADER include/spdk/opal.h 00:03:48.462 TEST_HEADER include/spdk/opal_spec.h 00:03:48.462 TEST_HEADER include/spdk/pci_ids.h 00:03:48.462 TEST_HEADER include/spdk/pipe.h 00:03:48.462 TEST_HEADER include/spdk/queue.h 00:03:48.462 TEST_HEADER include/spdk/reduce.h 00:03:48.462 TEST_HEADER include/spdk/rpc.h 00:03:48.462 TEST_HEADER include/spdk/scheduler.h 00:03:48.462 TEST_HEADER include/spdk/scsi.h 00:03:48.462 TEST_HEADER include/spdk/scsi_spec.h 00:03:48.462 TEST_HEADER include/spdk/sock.h 00:03:48.462 TEST_HEADER include/spdk/stdinc.h 00:03:48.462 TEST_HEADER include/spdk/string.h 00:03:48.462 TEST_HEADER include/spdk/thread.h 00:03:48.462 TEST_HEADER include/spdk/trace.h 00:03:48.462 TEST_HEADER include/spdk/trace_parser.h 00:03:48.462 LINK spdk_lspci 00:03:48.462 TEST_HEADER include/spdk/tree.h 00:03:48.462 TEST_HEADER include/spdk/ublk.h 00:03:48.462 TEST_HEADER include/spdk/util.h 00:03:48.462 TEST_HEADER include/spdk/uuid.h 00:03:48.462 TEST_HEADER include/spdk/version.h 00:03:48.462 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:48.462 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:48.462 TEST_HEADER include/spdk/vhost.h 00:03:48.462 TEST_HEADER include/spdk/vmd.h 00:03:48.462 TEST_HEADER include/spdk/xor.h 00:03:48.462 TEST_HEADER include/spdk/zipf.h 00:03:48.462 CXX test/cpp_headers/accel.o 00:03:48.462 LINK rpc_client_test 00:03:48.462 LINK jsoncat 00:03:48.462 LINK lsvmd 00:03:48.728 LINK led 00:03:48.728 LINK spdk_nvme_discover 00:03:48.728 LINK poller_perf 00:03:48.728 LINK event_perf 00:03:48.728 LINK zipf 00:03:48.728 LINK histogram_perf 00:03:48.728 LINK interrupt_tgt 00:03:48.728 LINK nvmf_tgt 00:03:48.728 LINK stub 00:03:48.728 LINK vhost 00:03:48.728 LINK err_injection 00:03:48.728 LINK spdk_trace_record 00:03:48.728 LINK iscsi_tgt 00:03:48.728 LINK bdev_svc 00:03:48.728 LINK ioat_perf 00:03:48.728 LINK spdk_tgt 00:03:48.728 LINK mkfs 00:03:48.728 LINK hello_world 00:03:48.728 LINK hello_sock 00:03:48.728 LINK mem_callbacks 00:03:48.728 LINK reset 00:03:48.728 LINK sgl 00:03:48.728 LINK hello_blob 00:03:48.728 LINK hello_bdev 00:03:48.728 LINK aer 00:03:48.995 LINK nvme_dp 00:03:48.995 LINK thread 00:03:48.995 LINK overhead 00:03:48.995 CC test/env/vtophys/vtophys.o 00:03:48.995 CXX test/cpp_headers/accel_module.o 00:03:48.995 CXX test/cpp_headers/assert.o 00:03:48.995 LINK nvmf 00:03:48.995 LINK idxd_perf 00:03:48.995 CC examples/nvme/reconnect/reconnect.o 00:03:48.995 LINK spdk_dd 00:03:48.995 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:48.995 CC test/event/reactor/reactor.o 00:03:48.995 CC test/nvme/startup/startup.o 00:03:48.995 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:48.995 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:48.995 CC examples/ioat/verify/verify.o 00:03:48.995 LINK spdk_trace 00:03:48.995 CXX test/cpp_headers/barrier.o 00:03:48.995 LINK bdevio 00:03:48.995 CC examples/blob/cli/blobcli.o 00:03:48.995 LINK dif 00:03:48.995 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:48.995 CC test/env/memory/memory_ut.o 00:03:49.261 CC examples/nvme/arbitration/arbitration.o 00:03:49.261 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:49.261 CXX test/cpp_headers/base64.o 00:03:49.261 CC test/event/reactor_perf/reactor_perf.o 00:03:49.261 LINK test_dma 00:03:49.261 CC examples/nvme/hotplug/hotplug.o 00:03:49.261 CC app/fio/bdev/fio_plugin.o 00:03:49.261 LINK vtophys 00:03:49.261 CXX test/cpp_headers/bdev.o 00:03:49.262 CC test/nvme/reserve/reserve.o 00:03:49.262 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:49.262 LINK accel_perf 00:03:49.262 LINK nvme_fuzz 00:03:49.262 CXX test/cpp_headers/bdev_module.o 00:03:49.262 CXX test/cpp_headers/bdev_zone.o 00:03:49.262 CXX test/cpp_headers/bit_array.o 00:03:49.262 CC test/env/pci/pci_ut.o 00:03:49.262 CC examples/nvme/abort/abort.o 00:03:49.262 CXX test/cpp_headers/bit_pool.o 00:03:49.262 CC test/event/app_repeat/app_repeat.o 00:03:49.262 CC test/nvme/simple_copy/simple_copy.o 00:03:49.262 LINK reactor 00:03:49.262 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:49.262 CXX test/cpp_headers/blob_bdev.o 00:03:49.262 LINK env_dpdk_post_init 00:03:49.262 CC test/event/scheduler/scheduler.o 00:03:49.262 CC test/nvme/connect_stress/connect_stress.o 00:03:49.262 CXX test/cpp_headers/blobfs_bdev.o 00:03:49.262 CC test/nvme/boot_partition/boot_partition.o 00:03:49.262 LINK spdk_nvme 00:03:49.262 LINK startup 00:03:49.528 CC test/nvme/compliance/nvme_compliance.o 00:03:49.528 LINK reactor_perf 00:03:49.528 LINK verify 00:03:49.528 CC test/nvme/fused_ordering/fused_ordering.o 00:03:49.528 CXX test/cpp_headers/blobfs.o 00:03:49.528 CXX test/cpp_headers/blob.o 00:03:49.528 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:49.528 CXX test/cpp_headers/conf.o 00:03:49.528 CXX test/cpp_headers/config.o 00:03:49.528 CXX test/cpp_headers/cpuset.o 00:03:49.528 CXX test/cpp_headers/crc16.o 00:03:49.528 CC test/nvme/fdp/fdp.o 00:03:49.528 CXX test/cpp_headers/crc32.o 00:03:49.528 CXX test/cpp_headers/crc64.o 00:03:49.528 LINK cmb_copy 00:03:49.528 CXX test/cpp_headers/dif.o 00:03:49.528 CC test/nvme/cuse/cuse.o 00:03:49.528 LINK app_repeat 00:03:49.528 CXX test/cpp_headers/dma.o 00:03:49.528 LINK reserve 00:03:49.528 CXX test/cpp_headers/endian.o 00:03:49.528 CXX test/cpp_headers/env_dpdk.o 00:03:49.528 CXX test/cpp_headers/env.o 00:03:49.528 CXX test/cpp_headers/event.o 00:03:49.528 CXX test/cpp_headers/fd_group.o 00:03:49.791 LINK pmr_persistence 00:03:49.791 LINK reconnect 00:03:49.791 LINK hotplug 00:03:49.791 CXX test/cpp_headers/fd.o 00:03:49.791 LINK boot_partition 00:03:49.791 CXX test/cpp_headers/file.o 00:03:49.791 LINK spdk_nvme_perf 00:03:49.791 CXX test/cpp_headers/ftl.o 00:03:49.791 LINK connect_stress 00:03:49.791 CXX test/cpp_headers/gpt_spec.o 00:03:49.791 LINK spdk_nvme_identify 00:03:49.791 LINK simple_copy 00:03:49.791 CXX test/cpp_headers/hexlify.o 00:03:49.791 LINK arbitration 00:03:49.791 LINK scheduler 00:03:49.791 LINK bdevperf 00:03:49.791 CXX test/cpp_headers/histogram_data.o 00:03:49.791 CXX test/cpp_headers/idxd.o 00:03:49.791 CXX test/cpp_headers/idxd_spec.o 00:03:49.791 LINK doorbell_aers 00:03:49.791 LINK fused_ordering 00:03:49.792 CXX test/cpp_headers/init.o 00:03:49.792 CXX test/cpp_headers/ioat.o 00:03:49.792 CXX test/cpp_headers/ioat_spec.o 00:03:49.792 LINK spdk_top 00:03:49.792 CXX test/cpp_headers/iscsi_spec.o 00:03:50.056 CXX test/cpp_headers/json.o 00:03:50.056 LINK vhost_fuzz 00:03:50.056 CXX test/cpp_headers/jsonrpc.o 00:03:50.056 CXX test/cpp_headers/likely.o 00:03:50.056 CXX test/cpp_headers/log.o 00:03:50.056 CXX test/cpp_headers/lvol.o 00:03:50.056 CXX test/cpp_headers/memory.o 00:03:50.056 CXX test/cpp_headers/mmio.o 00:03:50.056 CXX test/cpp_headers/nbd.o 00:03:50.056 CXX test/cpp_headers/notify.o 00:03:50.056 CXX test/cpp_headers/nvme.o 00:03:50.056 LINK abort 00:03:50.056 CXX test/cpp_headers/nvme_intel.o 00:03:50.056 CXX test/cpp_headers/nvme_ocssd.o 00:03:50.056 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:50.056 LINK pci_ut 00:03:50.056 LINK nvme_compliance 00:03:50.056 CXX test/cpp_headers/nvme_spec.o 00:03:50.056 CXX test/cpp_headers/nvme_zns.o 00:03:50.056 CXX test/cpp_headers/nvmf_cmd.o 00:03:50.056 LINK nvme_manage 00:03:50.056 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:50.056 CXX test/cpp_headers/nvmf.o 00:03:50.056 LINK memory_ut 00:03:50.056 CXX test/cpp_headers/nvmf_spec.o 00:03:50.056 LINK blobcli 00:03:50.056 CXX test/cpp_headers/nvmf_transport.o 00:03:50.056 CXX test/cpp_headers/opal.o 00:03:50.056 CXX test/cpp_headers/opal_spec.o 00:03:50.056 CXX test/cpp_headers/pci_ids.o 00:03:50.056 CXX test/cpp_headers/pipe.o 00:03:50.056 LINK spdk_bdev 00:03:50.056 CXX test/cpp_headers/queue.o 00:03:50.056 CXX test/cpp_headers/reduce.o 00:03:50.323 LINK fdp 00:03:50.323 CXX test/cpp_headers/rpc.o 00:03:50.323 CXX test/cpp_headers/scheduler.o 00:03:50.323 CXX test/cpp_headers/scsi_spec.o 00:03:50.323 CXX test/cpp_headers/scsi.o 00:03:50.323 CXX test/cpp_headers/sock.o 00:03:50.323 CXX test/cpp_headers/stdinc.o 00:03:50.323 CXX test/cpp_headers/string.o 00:03:50.323 CXX test/cpp_headers/thread.o 00:03:50.323 CXX test/cpp_headers/trace.o 00:03:50.323 CXX test/cpp_headers/trace_parser.o 00:03:50.323 CXX test/cpp_headers/tree.o 00:03:50.323 CXX test/cpp_headers/ublk.o 00:03:50.323 CXX test/cpp_headers/util.o 00:03:50.323 CXX test/cpp_headers/uuid.o 00:03:50.323 CXX test/cpp_headers/version.o 00:03:50.323 CXX test/cpp_headers/vfio_user_pci.o 00:03:50.323 CXX test/cpp_headers/vfio_user_spec.o 00:03:50.323 CXX test/cpp_headers/vhost.o 00:03:50.323 CXX test/cpp_headers/vmd.o 00:03:50.323 CXX test/cpp_headers/xor.o 00:03:50.323 CXX test/cpp_headers/zipf.o 00:03:51.258 LINK cuse 00:03:51.258 LINK iscsi_fuzz 00:03:53.789 LINK esnap 00:03:54.047 00:03:54.047 real 0m37.812s 00:03:54.047 user 7m14.073s 00:03:54.047 sys 1m37.444s 00:03:54.047 16:39:39 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:54.047 16:39:39 -- common/autotest_common.sh@10 -- $ set +x 00:03:54.047 ************************************ 00:03:54.047 END TEST make 00:03:54.047 ************************************ 00:03:54.308 16:39:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:54.308 16:39:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:54.308 16:39:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:54.308 16:39:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:54.308 16:39:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:54.308 16:39:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:54.308 16:39:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:54.308 16:39:39 -- scripts/common.sh@335 -- # IFS=.-: 00:03:54.308 16:39:39 -- scripts/common.sh@335 -- # read -ra ver1 00:03:54.308 16:39:39 -- scripts/common.sh@336 -- # IFS=.-: 00:03:54.308 16:39:39 -- scripts/common.sh@336 -- # read -ra ver2 00:03:54.308 16:39:39 -- scripts/common.sh@337 -- # local 'op=<' 00:03:54.308 16:39:39 -- scripts/common.sh@339 -- # ver1_l=2 00:03:54.308 16:39:39 -- scripts/common.sh@340 -- # ver2_l=1 00:03:54.308 16:39:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:54.308 16:39:39 -- scripts/common.sh@343 -- # case "$op" in 00:03:54.308 16:39:39 -- scripts/common.sh@344 -- # : 1 00:03:54.308 16:39:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:54.308 16:39:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:54.308 16:39:39 -- scripts/common.sh@364 -- # decimal 1 00:03:54.308 16:39:39 -- scripts/common.sh@352 -- # local d=1 00:03:54.308 16:39:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:54.308 16:39:39 -- scripts/common.sh@354 -- # echo 1 00:03:54.308 16:39:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:54.308 16:39:39 -- scripts/common.sh@365 -- # decimal 2 00:03:54.308 16:39:39 -- scripts/common.sh@352 -- # local d=2 00:03:54.308 16:39:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:54.308 16:39:39 -- scripts/common.sh@354 -- # echo 2 00:03:54.308 16:39:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:54.308 16:39:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:54.308 16:39:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:54.308 16:39:39 -- scripts/common.sh@367 -- # return 0 00:03:54.308 16:39:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:54.308 16:39:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:54.308 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:54.308 --rc genhtml_branch_coverage=1 00:03:54.308 --rc genhtml_function_coverage=1 00:03:54.308 --rc genhtml_legend=1 00:03:54.308 --rc geninfo_all_blocks=1 00:03:54.308 --rc geninfo_unexecuted_blocks=1 00:03:54.308 00:03:54.308 ' 00:03:54.308 16:39:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:54.308 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:54.308 --rc genhtml_branch_coverage=1 00:03:54.308 --rc genhtml_function_coverage=1 00:03:54.308 --rc genhtml_legend=1 00:03:54.308 --rc geninfo_all_blocks=1 00:03:54.308 --rc geninfo_unexecuted_blocks=1 00:03:54.308 00:03:54.308 ' 00:03:54.308 16:39:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:54.308 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:54.308 --rc genhtml_branch_coverage=1 00:03:54.308 --rc genhtml_function_coverage=1 00:03:54.308 --rc genhtml_legend=1 00:03:54.308 --rc geninfo_all_blocks=1 00:03:54.308 --rc geninfo_unexecuted_blocks=1 00:03:54.308 00:03:54.308 ' 00:03:54.308 16:39:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:54.308 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:54.308 --rc genhtml_branch_coverage=1 00:03:54.308 --rc genhtml_function_coverage=1 00:03:54.308 --rc genhtml_legend=1 00:03:54.308 --rc geninfo_all_blocks=1 00:03:54.308 --rc geninfo_unexecuted_blocks=1 00:03:54.308 00:03:54.308 ' 00:03:54.308 16:39:39 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:54.308 16:39:39 -- nvmf/common.sh@7 -- # uname -s 00:03:54.308 16:39:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:54.308 16:39:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:54.308 16:39:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:54.308 16:39:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:54.308 16:39:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:54.308 16:39:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:54.308 16:39:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:54.308 16:39:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:54.308 16:39:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:54.308 16:39:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:54.308 16:39:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:54.308 16:39:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:54.308 16:39:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:54.308 16:39:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:54.308 16:39:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:54.308 16:39:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:54.308 16:39:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:54.308 16:39:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:54.308 16:39:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:54.309 16:39:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:54.309 16:39:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:54.309 16:39:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:54.309 16:39:39 -- paths/export.sh@5 -- # export PATH 00:03:54.309 16:39:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:54.309 16:39:39 -- nvmf/common.sh@46 -- # : 0 00:03:54.309 16:39:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:54.309 16:39:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:54.309 16:39:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:54.309 16:39:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:54.309 16:39:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:54.309 16:39:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:54.309 16:39:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:54.309 16:39:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:54.309 16:39:39 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:54.309 16:39:39 -- spdk/autotest.sh@32 -- # uname -s 00:03:54.309 16:39:39 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:54.309 16:39:39 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:54.309 16:39:39 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:54.309 16:39:39 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:54.309 16:39:39 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:54.309 16:39:39 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:54.309 16:39:39 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:54.309 16:39:39 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:54.309 16:39:39 -- spdk/autotest.sh@48 -- # udevadm_pid=1043560 00:03:54.309 16:39:39 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:54.309 16:39:39 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:54.309 16:39:39 -- spdk/autotest.sh@54 -- # echo 1043562 00:03:54.309 16:39:39 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:54.309 16:39:39 -- spdk/autotest.sh@56 -- # echo 1043563 00:03:54.309 16:39:39 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:54.309 16:39:39 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:54.309 16:39:39 -- spdk/autotest.sh@60 -- # echo 1043564 00:03:54.309 16:39:39 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:54.309 16:39:39 -- spdk/autotest.sh@62 -- # echo 1043565 00:03:54.309 16:39:39 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:54.309 16:39:39 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:54.309 16:39:39 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:54.309 16:39:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:54.309 16:39:39 -- common/autotest_common.sh@10 -- # set +x 00:03:54.309 16:39:39 -- spdk/autotest.sh@70 -- # create_test_list 00:03:54.309 16:39:39 -- common/autotest_common.sh@746 -- # xtrace_disable 00:03:54.309 16:39:39 -- common/autotest_common.sh@10 -- # set +x 00:03:54.309 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:54.309 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:54.309 16:39:39 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:54.309 16:39:39 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:54.309 16:39:39 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:54.309 16:39:39 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:54.309 16:39:39 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:54.309 16:39:39 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:54.309 16:39:39 -- common/autotest_common.sh@1450 -- # uname 00:03:54.309 16:39:39 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:03:54.309 16:39:39 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:54.309 16:39:39 -- common/autotest_common.sh@1470 -- # uname 00:03:54.309 16:39:39 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:03:54.309 16:39:39 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:03:54.309 16:39:39 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:54.309 lcov: LCOV version 1.15 00:03:54.309 16:39:40 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:03:57.688 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:03:57.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:03:57.688 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:03:57.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:57.688 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:03:57.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:29.802 16:40:12 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:29.802 16:40:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:29.802 16:40:12 -- common/autotest_common.sh@10 -- # set +x 00:04:29.802 16:40:12 -- spdk/autotest.sh@89 -- # rm -f 00:04:29.802 16:40:12 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:29.802 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:29.802 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:29.802 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:29.802 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:29.802 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:29.802 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:29.803 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:29.803 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:29.803 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:29.803 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:29.803 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:29.803 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:29.803 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:29.803 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:29.803 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:29.803 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:29.803 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:29.803 16:40:14 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:29.803 16:40:14 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:29.803 16:40:14 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:29.803 16:40:14 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:29.803 16:40:14 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:29.803 16:40:14 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:29.803 16:40:14 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:29.803 16:40:14 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:29.803 16:40:14 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:29.803 16:40:14 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:29.803 16:40:14 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:29.803 16:40:14 -- spdk/autotest.sh@108 -- # grep -v p 00:04:29.803 16:40:14 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:29.803 16:40:14 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:29.803 16:40:14 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:29.803 16:40:14 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:29.803 16:40:14 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:29.803 No valid GPT data, bailing 00:04:29.803 16:40:14 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:29.803 16:40:14 -- scripts/common.sh@393 -- # pt= 00:04:29.803 16:40:14 -- scripts/common.sh@394 -- # return 1 00:04:29.803 16:40:14 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:29.803 1+0 records in 00:04:29.803 1+0 records out 00:04:29.803 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00237002 s, 442 MB/s 00:04:29.803 16:40:14 -- spdk/autotest.sh@116 -- # sync 00:04:29.803 16:40:14 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:29.803 16:40:14 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:29.803 16:40:14 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:30.744 16:40:16 -- spdk/autotest.sh@122 -- # uname -s 00:04:30.744 16:40:16 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:30.744 16:40:16 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:30.744 16:40:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.744 16:40:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.744 16:40:16 -- common/autotest_common.sh@10 -- # set +x 00:04:30.744 ************************************ 00:04:30.744 START TEST setup.sh 00:04:30.744 ************************************ 00:04:30.744 16:40:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:30.744 * Looking for test storage... 00:04:30.744 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:30.744 16:40:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:30.744 16:40:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:30.744 16:40:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:30.744 16:40:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:30.744 16:40:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:30.744 16:40:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:30.744 16:40:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:30.744 16:40:16 -- scripts/common.sh@335 -- # IFS=.-: 00:04:30.744 16:40:16 -- scripts/common.sh@335 -- # read -ra ver1 00:04:30.744 16:40:16 -- scripts/common.sh@336 -- # IFS=.-: 00:04:30.744 16:40:16 -- scripts/common.sh@336 -- # read -ra ver2 00:04:30.744 16:40:16 -- scripts/common.sh@337 -- # local 'op=<' 00:04:30.744 16:40:16 -- scripts/common.sh@339 -- # ver1_l=2 00:04:30.744 16:40:16 -- scripts/common.sh@340 -- # ver2_l=1 00:04:30.744 16:40:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:30.744 16:40:16 -- scripts/common.sh@343 -- # case "$op" in 00:04:30.744 16:40:16 -- scripts/common.sh@344 -- # : 1 00:04:30.744 16:40:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:30.744 16:40:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:30.744 16:40:16 -- scripts/common.sh@364 -- # decimal 1 00:04:30.744 16:40:16 -- scripts/common.sh@352 -- # local d=1 00:04:30.744 16:40:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:30.744 16:40:16 -- scripts/common.sh@354 -- # echo 1 00:04:30.744 16:40:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:30.744 16:40:16 -- scripts/common.sh@365 -- # decimal 2 00:04:30.744 16:40:16 -- scripts/common.sh@352 -- # local d=2 00:04:30.744 16:40:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:30.744 16:40:16 -- scripts/common.sh@354 -- # echo 2 00:04:30.744 16:40:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:30.744 16:40:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:30.744 16:40:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:30.744 16:40:16 -- scripts/common.sh@367 -- # return 0 00:04:30.744 16:40:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:30.744 16:40:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:30.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.744 --rc genhtml_branch_coverage=1 00:04:30.744 --rc genhtml_function_coverage=1 00:04:30.744 --rc genhtml_legend=1 00:04:30.744 --rc geninfo_all_blocks=1 00:04:30.744 --rc geninfo_unexecuted_blocks=1 00:04:30.744 00:04:30.744 ' 00:04:30.744 16:40:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:30.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.744 --rc genhtml_branch_coverage=1 00:04:30.744 --rc genhtml_function_coverage=1 00:04:30.744 --rc genhtml_legend=1 00:04:30.744 --rc geninfo_all_blocks=1 00:04:30.744 --rc geninfo_unexecuted_blocks=1 00:04:30.744 00:04:30.744 ' 00:04:30.744 16:40:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:30.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.744 --rc genhtml_branch_coverage=1 00:04:30.744 --rc genhtml_function_coverage=1 00:04:30.744 --rc genhtml_legend=1 00:04:30.744 --rc geninfo_all_blocks=1 00:04:30.744 --rc geninfo_unexecuted_blocks=1 00:04:30.744 00:04:30.744 ' 00:04:30.744 16:40:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:30.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.744 --rc genhtml_branch_coverage=1 00:04:30.744 --rc genhtml_function_coverage=1 00:04:30.744 --rc genhtml_legend=1 00:04:30.744 --rc geninfo_all_blocks=1 00:04:30.744 --rc geninfo_unexecuted_blocks=1 00:04:30.744 00:04:30.744 ' 00:04:30.745 16:40:16 -- setup/test-setup.sh@10 -- # uname -s 00:04:30.745 16:40:16 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:30.745 16:40:16 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:30.745 16:40:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.745 16:40:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.745 16:40:16 -- common/autotest_common.sh@10 -- # set +x 00:04:30.745 ************************************ 00:04:30.745 START TEST acl 00:04:30.745 ************************************ 00:04:30.745 16:40:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:30.745 * Looking for test storage... 00:04:30.745 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:30.745 16:40:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:30.745 16:40:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:30.745 16:40:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:31.005 16:40:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:31.005 16:40:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:31.005 16:40:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:31.005 16:40:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:31.005 16:40:16 -- scripts/common.sh@335 -- # IFS=.-: 00:04:31.005 16:40:16 -- scripts/common.sh@335 -- # read -ra ver1 00:04:31.005 16:40:16 -- scripts/common.sh@336 -- # IFS=.-: 00:04:31.005 16:40:16 -- scripts/common.sh@336 -- # read -ra ver2 00:04:31.005 16:40:16 -- scripts/common.sh@337 -- # local 'op=<' 00:04:31.005 16:40:16 -- scripts/common.sh@339 -- # ver1_l=2 00:04:31.005 16:40:16 -- scripts/common.sh@340 -- # ver2_l=1 00:04:31.005 16:40:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:31.005 16:40:16 -- scripts/common.sh@343 -- # case "$op" in 00:04:31.005 16:40:16 -- scripts/common.sh@344 -- # : 1 00:04:31.005 16:40:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:31.005 16:40:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:31.005 16:40:16 -- scripts/common.sh@364 -- # decimal 1 00:04:31.005 16:40:16 -- scripts/common.sh@352 -- # local d=1 00:04:31.005 16:40:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:31.005 16:40:16 -- scripts/common.sh@354 -- # echo 1 00:04:31.005 16:40:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:31.005 16:40:16 -- scripts/common.sh@365 -- # decimal 2 00:04:31.005 16:40:16 -- scripts/common.sh@352 -- # local d=2 00:04:31.005 16:40:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:31.005 16:40:16 -- scripts/common.sh@354 -- # echo 2 00:04:31.005 16:40:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:31.005 16:40:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:31.005 16:40:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:31.005 16:40:16 -- scripts/common.sh@367 -- # return 0 00:04:31.005 16:40:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:31.005 16:40:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:31.005 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.005 --rc genhtml_branch_coverage=1 00:04:31.005 --rc genhtml_function_coverage=1 00:04:31.005 --rc genhtml_legend=1 00:04:31.005 --rc geninfo_all_blocks=1 00:04:31.005 --rc geninfo_unexecuted_blocks=1 00:04:31.005 00:04:31.005 ' 00:04:31.005 16:40:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:31.005 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.005 --rc genhtml_branch_coverage=1 00:04:31.005 --rc genhtml_function_coverage=1 00:04:31.005 --rc genhtml_legend=1 00:04:31.005 --rc geninfo_all_blocks=1 00:04:31.005 --rc geninfo_unexecuted_blocks=1 00:04:31.005 00:04:31.005 ' 00:04:31.005 16:40:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:31.005 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.005 --rc genhtml_branch_coverage=1 00:04:31.005 --rc genhtml_function_coverage=1 00:04:31.005 --rc genhtml_legend=1 00:04:31.005 --rc geninfo_all_blocks=1 00:04:31.005 --rc geninfo_unexecuted_blocks=1 00:04:31.005 00:04:31.005 ' 00:04:31.005 16:40:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:31.005 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.005 --rc genhtml_branch_coverage=1 00:04:31.005 --rc genhtml_function_coverage=1 00:04:31.005 --rc genhtml_legend=1 00:04:31.005 --rc geninfo_all_blocks=1 00:04:31.005 --rc geninfo_unexecuted_blocks=1 00:04:31.005 00:04:31.005 ' 00:04:31.005 16:40:16 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:31.005 16:40:16 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:31.005 16:40:16 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:31.005 16:40:16 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:31.005 16:40:16 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:31.005 16:40:16 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:31.005 16:40:16 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:31.005 16:40:16 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:31.005 16:40:16 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:31.005 16:40:16 -- setup/acl.sh@12 -- # devs=() 00:04:31.005 16:40:16 -- setup/acl.sh@12 -- # declare -a devs 00:04:31.005 16:40:16 -- setup/acl.sh@13 -- # drivers=() 00:04:31.005 16:40:16 -- setup/acl.sh@13 -- # declare -A drivers 00:04:31.005 16:40:16 -- setup/acl.sh@51 -- # setup reset 00:04:31.005 16:40:16 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:31.005 16:40:16 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:32.911 16:40:18 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:32.911 16:40:18 -- setup/acl.sh@16 -- # local dev driver 00:04:32.911 16:40:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.911 16:40:18 -- setup/acl.sh@15 -- # setup output status 00:04:32.911 16:40:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:32.911 16:40:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:33.849 Hugepages 00:04:33.849 node hugesize free / total 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 00:04:33.849 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # continue 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:33.849 16:40:19 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:33.849 16:40:19 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:33.849 16:40:19 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:33.849 16:40:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.849 16:40:19 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:33.849 16:40:19 -- setup/acl.sh@54 -- # run_test denied denied 00:04:33.849 16:40:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.849 16:40:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.849 16:40:19 -- common/autotest_common.sh@10 -- # set +x 00:04:33.849 ************************************ 00:04:33.849 START TEST denied 00:04:33.849 ************************************ 00:04:33.849 16:40:19 -- common/autotest_common.sh@1114 -- # denied 00:04:33.849 16:40:19 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:33.849 16:40:19 -- setup/acl.sh@38 -- # setup output config 00:04:33.849 16:40:19 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:33.849 16:40:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:33.849 16:40:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:35.753 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:35.753 16:40:20 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:35.753 16:40:20 -- setup/acl.sh@28 -- # local dev driver 00:04:35.753 16:40:20 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:35.753 16:40:20 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:35.753 16:40:20 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:35.753 16:40:20 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:35.753 16:40:20 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:35.753 16:40:20 -- setup/acl.sh@41 -- # setup reset 00:04:35.753 16:40:20 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:35.753 16:40:20 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:38.305 00:04:38.305 real 0m4.055s 00:04:38.305 user 0m1.140s 00:04:38.305 sys 0m1.978s 00:04:38.305 16:40:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.305 16:40:23 -- common/autotest_common.sh@10 -- # set +x 00:04:38.305 ************************************ 00:04:38.305 END TEST denied 00:04:38.305 ************************************ 00:04:38.305 16:40:23 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:38.305 16:40:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.305 16:40:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.305 16:40:23 -- common/autotest_common.sh@10 -- # set +x 00:04:38.305 ************************************ 00:04:38.305 START TEST allowed 00:04:38.305 ************************************ 00:04:38.305 16:40:23 -- common/autotest_common.sh@1114 -- # allowed 00:04:38.305 16:40:23 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:38.305 16:40:23 -- setup/acl.sh@45 -- # setup output config 00:04:38.305 16:40:23 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:38.305 16:40:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:38.305 16:40:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:40.213 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:40.213 16:40:25 -- setup/acl.sh@47 -- # verify 00:04:40.213 16:40:25 -- setup/acl.sh@28 -- # local dev driver 00:04:40.214 16:40:25 -- setup/acl.sh@48 -- # setup reset 00:04:40.214 16:40:25 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:40.214 16:40:25 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:42.120 00:04:42.120 real 0m4.047s 00:04:42.120 user 0m1.084s 00:04:42.120 sys 0m1.849s 00:04:42.120 16:40:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.120 16:40:27 -- common/autotest_common.sh@10 -- # set +x 00:04:42.120 ************************************ 00:04:42.120 END TEST allowed 00:04:42.120 ************************************ 00:04:42.120 00:04:42.120 real 0m11.144s 00:04:42.120 user 0m3.391s 00:04:42.120 sys 0m5.801s 00:04:42.120 16:40:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.120 16:40:27 -- common/autotest_common.sh@10 -- # set +x 00:04:42.120 ************************************ 00:04:42.120 END TEST acl 00:04:42.120 ************************************ 00:04:42.120 16:40:27 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:42.120 16:40:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.120 16:40:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.120 16:40:27 -- common/autotest_common.sh@10 -- # set +x 00:04:42.120 ************************************ 00:04:42.120 START TEST hugepages 00:04:42.120 ************************************ 00:04:42.120 16:40:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:42.120 * Looking for test storage... 00:04:42.120 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:42.120 16:40:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:42.120 16:40:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:42.120 16:40:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:42.120 16:40:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:42.120 16:40:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:42.120 16:40:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:42.120 16:40:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:42.120 16:40:27 -- scripts/common.sh@335 -- # IFS=.-: 00:04:42.120 16:40:27 -- scripts/common.sh@335 -- # read -ra ver1 00:04:42.120 16:40:27 -- scripts/common.sh@336 -- # IFS=.-: 00:04:42.120 16:40:27 -- scripts/common.sh@336 -- # read -ra ver2 00:04:42.120 16:40:27 -- scripts/common.sh@337 -- # local 'op=<' 00:04:42.120 16:40:27 -- scripts/common.sh@339 -- # ver1_l=2 00:04:42.120 16:40:27 -- scripts/common.sh@340 -- # ver2_l=1 00:04:42.120 16:40:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:42.120 16:40:27 -- scripts/common.sh@343 -- # case "$op" in 00:04:42.120 16:40:27 -- scripts/common.sh@344 -- # : 1 00:04:42.120 16:40:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:42.120 16:40:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:42.120 16:40:27 -- scripts/common.sh@364 -- # decimal 1 00:04:42.120 16:40:27 -- scripts/common.sh@352 -- # local d=1 00:04:42.120 16:40:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:42.120 16:40:27 -- scripts/common.sh@354 -- # echo 1 00:04:42.120 16:40:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:42.120 16:40:27 -- scripts/common.sh@365 -- # decimal 2 00:04:42.120 16:40:27 -- scripts/common.sh@352 -- # local d=2 00:04:42.120 16:40:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:42.120 16:40:27 -- scripts/common.sh@354 -- # echo 2 00:04:42.120 16:40:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:42.120 16:40:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:42.120 16:40:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:42.120 16:40:27 -- scripts/common.sh@367 -- # return 0 00:04:42.120 16:40:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:42.120 16:40:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:42.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.120 --rc genhtml_branch_coverage=1 00:04:42.120 --rc genhtml_function_coverage=1 00:04:42.120 --rc genhtml_legend=1 00:04:42.120 --rc geninfo_all_blocks=1 00:04:42.120 --rc geninfo_unexecuted_blocks=1 00:04:42.120 00:04:42.120 ' 00:04:42.120 16:40:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:42.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.120 --rc genhtml_branch_coverage=1 00:04:42.120 --rc genhtml_function_coverage=1 00:04:42.120 --rc genhtml_legend=1 00:04:42.120 --rc geninfo_all_blocks=1 00:04:42.120 --rc geninfo_unexecuted_blocks=1 00:04:42.120 00:04:42.120 ' 00:04:42.120 16:40:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:42.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.120 --rc genhtml_branch_coverage=1 00:04:42.120 --rc genhtml_function_coverage=1 00:04:42.120 --rc genhtml_legend=1 00:04:42.120 --rc geninfo_all_blocks=1 00:04:42.120 --rc geninfo_unexecuted_blocks=1 00:04:42.120 00:04:42.120 ' 00:04:42.120 16:40:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:42.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.120 --rc genhtml_branch_coverage=1 00:04:42.120 --rc genhtml_function_coverage=1 00:04:42.120 --rc genhtml_legend=1 00:04:42.120 --rc geninfo_all_blocks=1 00:04:42.120 --rc geninfo_unexecuted_blocks=1 00:04:42.120 00:04:42.120 ' 00:04:42.120 16:40:27 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:42.120 16:40:27 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:42.120 16:40:27 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:42.120 16:40:27 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:42.120 16:40:27 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:42.120 16:40:27 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:42.120 16:40:27 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:42.120 16:40:27 -- setup/common.sh@18 -- # local node= 00:04:42.120 16:40:27 -- setup/common.sh@19 -- # local var val 00:04:42.120 16:40:27 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.120 16:40:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.120 16:40:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.120 16:40:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.120 16:40:27 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.120 16:40:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.120 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.120 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.120 16:40:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 41961136 kB' 'MemAvailable: 45709392 kB' 'Buffers: 2708 kB' 'Cached: 11939456 kB' 'SwapCached: 0 kB' 'Active: 8637436 kB' 'Inactive: 3752664 kB' 'Active(anon): 8244380 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451284 kB' 'Mapped: 165060 kB' 'Shmem: 7796444 kB' 'KReclaimable: 192716 kB' 'Slab: 669680 kB' 'SReclaimable: 192716 kB' 'SUnreclaim: 476964 kB' 'KernelStack: 12800 kB' 'PageTables: 7796 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559288 kB' 'Committed_AS: 9302104 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:42.120 16:40:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.120 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.120 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.120 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.120 16:40:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.121 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.121 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # continue 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.122 16:40:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.122 16:40:27 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:42.122 16:40:27 -- setup/common.sh@33 -- # echo 2048 00:04:42.122 16:40:27 -- setup/common.sh@33 -- # return 0 00:04:42.122 16:40:27 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:42.122 16:40:27 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:42.122 16:40:27 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:42.122 16:40:27 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:42.122 16:40:27 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:42.122 16:40:27 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:42.122 16:40:27 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:42.122 16:40:27 -- setup/hugepages.sh@207 -- # get_nodes 00:04:42.122 16:40:27 -- setup/hugepages.sh@27 -- # local node 00:04:42.122 16:40:27 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:42.122 16:40:27 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:42.122 16:40:27 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:42.122 16:40:27 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:42.122 16:40:27 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:42.122 16:40:27 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:42.122 16:40:27 -- setup/hugepages.sh@208 -- # clear_hp 00:04:42.122 16:40:27 -- setup/hugepages.sh@37 -- # local node hp 00:04:42.122 16:40:27 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:42.122 16:40:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:42.122 16:40:27 -- setup/hugepages.sh@41 -- # echo 0 00:04:42.122 16:40:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:42.122 16:40:27 -- setup/hugepages.sh@41 -- # echo 0 00:04:42.122 16:40:27 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:42.122 16:40:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:42.122 16:40:27 -- setup/hugepages.sh@41 -- # echo 0 00:04:42.122 16:40:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:42.122 16:40:27 -- setup/hugepages.sh@41 -- # echo 0 00:04:42.122 16:40:27 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:42.122 16:40:27 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:42.122 16:40:27 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:42.122 16:40:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.122 16:40:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.122 16:40:27 -- common/autotest_common.sh@10 -- # set +x 00:04:42.122 ************************************ 00:04:42.122 START TEST default_setup 00:04:42.122 ************************************ 00:04:42.122 16:40:27 -- common/autotest_common.sh@1114 -- # default_setup 00:04:42.122 16:40:27 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:42.122 16:40:27 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:42.122 16:40:27 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:42.122 16:40:27 -- setup/hugepages.sh@51 -- # shift 00:04:42.122 16:40:27 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:42.122 16:40:27 -- setup/hugepages.sh@52 -- # local node_ids 00:04:42.122 16:40:27 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:42.122 16:40:27 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:42.122 16:40:27 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:42.122 16:40:27 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:42.122 16:40:27 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:42.122 16:40:27 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:42.122 16:40:27 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:42.122 16:40:27 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:42.122 16:40:27 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:42.122 16:40:27 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:42.122 16:40:27 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:42.122 16:40:27 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:42.122 16:40:27 -- setup/hugepages.sh@73 -- # return 0 00:04:42.122 16:40:27 -- setup/hugepages.sh@137 -- # setup output 00:04:42.122 16:40:27 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:42.122 16:40:27 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:43.500 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:43.500 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:43.500 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:43.500 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:43.500 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:43.500 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:43.500 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:43.500 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:43.500 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:43.500 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:43.500 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:43.500 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:43.500 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:43.500 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:43.500 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:43.500 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:44.442 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:44.706 16:40:30 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:44.706 16:40:30 -- setup/hugepages.sh@89 -- # local node 00:04:44.706 16:40:30 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:44.706 16:40:30 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:44.706 16:40:30 -- setup/hugepages.sh@92 -- # local surp 00:04:44.706 16:40:30 -- setup/hugepages.sh@93 -- # local resv 00:04:44.706 16:40:30 -- setup/hugepages.sh@94 -- # local anon 00:04:44.706 16:40:30 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:44.706 16:40:30 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:44.706 16:40:30 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:44.706 16:40:30 -- setup/common.sh@18 -- # local node= 00:04:44.706 16:40:30 -- setup/common.sh@19 -- # local var val 00:04:44.706 16:40:30 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.706 16:40:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.706 16:40:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.706 16:40:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.706 16:40:30 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.706 16:40:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.706 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.706 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.706 16:40:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44102248 kB' 'MemAvailable: 47850512 kB' 'Buffers: 2708 kB' 'Cached: 11939544 kB' 'SwapCached: 0 kB' 'Active: 8640344 kB' 'Inactive: 3752664 kB' 'Active(anon): 8247288 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453992 kB' 'Mapped: 164880 kB' 'Shmem: 7796532 kB' 'KReclaimable: 192732 kB' 'Slab: 669324 kB' 'SReclaimable: 192732 kB' 'SUnreclaim: 476592 kB' 'KernelStack: 12784 kB' 'PageTables: 7524 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9304696 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:44.706 16:40:30 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.706 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.706 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.706 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.706 16:40:30 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.706 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.706 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.706 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.706 16:40:30 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.706 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.706 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.707 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.707 16:40:30 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.708 16:40:30 -- setup/common.sh@33 -- # echo 0 00:04:44.708 16:40:30 -- setup/common.sh@33 -- # return 0 00:04:44.708 16:40:30 -- setup/hugepages.sh@97 -- # anon=0 00:04:44.708 16:40:30 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:44.708 16:40:30 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:44.708 16:40:30 -- setup/common.sh@18 -- # local node= 00:04:44.708 16:40:30 -- setup/common.sh@19 -- # local var val 00:04:44.708 16:40:30 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.708 16:40:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.708 16:40:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.708 16:40:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.708 16:40:30 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.708 16:40:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44103184 kB' 'MemAvailable: 47851448 kB' 'Buffers: 2708 kB' 'Cached: 11939544 kB' 'SwapCached: 0 kB' 'Active: 8641036 kB' 'Inactive: 3752664 kB' 'Active(anon): 8247980 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454780 kB' 'Mapped: 165012 kB' 'Shmem: 7796532 kB' 'KReclaimable: 192732 kB' 'Slab: 669376 kB' 'SReclaimable: 192732 kB' 'SUnreclaim: 476644 kB' 'KernelStack: 12800 kB' 'PageTables: 7732 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9304344 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.708 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.708 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.709 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.709 16:40:30 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.710 16:40:30 -- setup/common.sh@33 -- # echo 0 00:04:44.710 16:40:30 -- setup/common.sh@33 -- # return 0 00:04:44.710 16:40:30 -- setup/hugepages.sh@99 -- # surp=0 00:04:44.710 16:40:30 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:44.710 16:40:30 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:44.710 16:40:30 -- setup/common.sh@18 -- # local node= 00:04:44.710 16:40:30 -- setup/common.sh@19 -- # local var val 00:04:44.710 16:40:30 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.710 16:40:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.710 16:40:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.710 16:40:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.710 16:40:30 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.710 16:40:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44101384 kB' 'MemAvailable: 47849648 kB' 'Buffers: 2708 kB' 'Cached: 11939564 kB' 'SwapCached: 0 kB' 'Active: 8642108 kB' 'Inactive: 3752664 kB' 'Active(anon): 8249052 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455772 kB' 'Mapped: 165404 kB' 'Shmem: 7796552 kB' 'KReclaimable: 192732 kB' 'Slab: 669376 kB' 'SReclaimable: 192732 kB' 'SUnreclaim: 476644 kB' 'KernelStack: 12720 kB' 'PageTables: 7428 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9306768 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.710 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.710 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.711 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.711 16:40:30 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.711 16:40:30 -- setup/common.sh@33 -- # echo 0 00:04:44.711 16:40:30 -- setup/common.sh@33 -- # return 0 00:04:44.711 16:40:30 -- setup/hugepages.sh@100 -- # resv=0 00:04:44.711 16:40:30 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:44.711 nr_hugepages=1024 00:04:44.711 16:40:30 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:44.711 resv_hugepages=0 00:04:44.711 16:40:30 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:44.711 surplus_hugepages=0 00:04:44.711 16:40:30 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:44.711 anon_hugepages=0 00:04:44.711 16:40:30 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:44.711 16:40:30 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:44.711 16:40:30 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:44.711 16:40:30 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:44.712 16:40:30 -- setup/common.sh@18 -- # local node= 00:04:44.712 16:40:30 -- setup/common.sh@19 -- # local var val 00:04:44.712 16:40:30 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.712 16:40:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.712 16:40:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.712 16:40:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.712 16:40:30 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.712 16:40:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44095844 kB' 'MemAvailable: 47844104 kB' 'Buffers: 2708 kB' 'Cached: 11939572 kB' 'SwapCached: 0 kB' 'Active: 8645340 kB' 'Inactive: 3752664 kB' 'Active(anon): 8252284 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459008 kB' 'Mapped: 165320 kB' 'Shmem: 7796560 kB' 'KReclaimable: 192724 kB' 'Slab: 669356 kB' 'SReclaimable: 192724 kB' 'SUnreclaim: 476632 kB' 'KernelStack: 12784 kB' 'PageTables: 7600 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9310864 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198284 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.712 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.712 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.713 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.713 16:40:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.713 16:40:30 -- setup/common.sh@33 -- # echo 1024 00:04:44.713 16:40:30 -- setup/common.sh@33 -- # return 0 00:04:44.713 16:40:30 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:44.714 16:40:30 -- setup/hugepages.sh@112 -- # get_nodes 00:04:44.714 16:40:30 -- setup/hugepages.sh@27 -- # local node 00:04:44.714 16:40:30 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:44.714 16:40:30 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:44.714 16:40:30 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:44.714 16:40:30 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:44.714 16:40:30 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:44.714 16:40:30 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:44.714 16:40:30 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:44.714 16:40:30 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:44.714 16:40:30 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:44.714 16:40:30 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:44.714 16:40:30 -- setup/common.sh@18 -- # local node=0 00:04:44.714 16:40:30 -- setup/common.sh@19 -- # local var val 00:04:44.714 16:40:30 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.714 16:40:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.714 16:40:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:44.714 16:40:30 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:44.714 16:40:30 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.714 16:40:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 26617096 kB' 'MemUsed: 6257828 kB' 'SwapCached: 0 kB' 'Active: 2771256 kB' 'Inactive: 109492 kB' 'Active(anon): 2621872 kB' 'Inactive(anon): 0 kB' 'Active(file): 149384 kB' 'Inactive(file): 109492 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2678788 kB' 'Mapped: 60008 kB' 'AnonPages: 205088 kB' 'Shmem: 2419912 kB' 'KernelStack: 7864 kB' 'PageTables: 4508 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 120412 kB' 'Slab: 423340 kB' 'SReclaimable: 120412 kB' 'SUnreclaim: 302928 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.714 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.714 16:40:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # continue 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.715 16:40:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.715 16:40:30 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.715 16:40:30 -- setup/common.sh@33 -- # echo 0 00:04:44.715 16:40:30 -- setup/common.sh@33 -- # return 0 00:04:44.715 16:40:30 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:44.715 16:40:30 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:44.715 16:40:30 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:44.715 16:40:30 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:44.715 16:40:30 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:44.715 node0=1024 expecting 1024 00:04:44.715 16:40:30 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:44.715 00:04:44.715 real 0m2.577s 00:04:44.715 user 0m0.701s 00:04:44.715 sys 0m0.960s 00:04:44.715 16:40:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:44.715 16:40:30 -- common/autotest_common.sh@10 -- # set +x 00:04:44.715 ************************************ 00:04:44.715 END TEST default_setup 00:04:44.715 ************************************ 00:04:44.715 16:40:30 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:44.715 16:40:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:44.715 16:40:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.715 16:40:30 -- common/autotest_common.sh@10 -- # set +x 00:04:44.715 ************************************ 00:04:44.715 START TEST per_node_1G_alloc 00:04:44.715 ************************************ 00:04:44.715 16:40:30 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:44.715 16:40:30 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:44.715 16:40:30 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:44.715 16:40:30 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:44.715 16:40:30 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:44.715 16:40:30 -- setup/hugepages.sh@51 -- # shift 00:04:44.715 16:40:30 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:44.715 16:40:30 -- setup/hugepages.sh@52 -- # local node_ids 00:04:44.715 16:40:30 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:44.715 16:40:30 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:44.715 16:40:30 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:44.715 16:40:30 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:44.715 16:40:30 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:44.715 16:40:30 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:44.715 16:40:30 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:44.715 16:40:30 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:44.715 16:40:30 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:44.715 16:40:30 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:44.715 16:40:30 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:44.715 16:40:30 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:44.715 16:40:30 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:44.715 16:40:30 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:44.715 16:40:30 -- setup/hugepages.sh@73 -- # return 0 00:04:44.715 16:40:30 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:44.715 16:40:30 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:44.715 16:40:30 -- setup/hugepages.sh@146 -- # setup output 00:04:44.715 16:40:30 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:44.715 16:40:30 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:46.102 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:46.102 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:46.102 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:46.102 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:46.102 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:46.102 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:46.102 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:46.102 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:46.102 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:46.103 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:46.103 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:46.103 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:46.103 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:46.103 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:46.103 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:46.103 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:46.103 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:46.103 16:40:31 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:46.103 16:40:31 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:46.103 16:40:31 -- setup/hugepages.sh@89 -- # local node 00:04:46.103 16:40:31 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:46.103 16:40:31 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:46.103 16:40:31 -- setup/hugepages.sh@92 -- # local surp 00:04:46.103 16:40:31 -- setup/hugepages.sh@93 -- # local resv 00:04:46.103 16:40:31 -- setup/hugepages.sh@94 -- # local anon 00:04:46.103 16:40:31 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:46.103 16:40:31 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:46.103 16:40:31 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:46.103 16:40:31 -- setup/common.sh@18 -- # local node= 00:04:46.103 16:40:31 -- setup/common.sh@19 -- # local var val 00:04:46.103 16:40:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.103 16:40:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.103 16:40:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.103 16:40:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.103 16:40:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.103 16:40:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44083588 kB' 'MemAvailable: 47831848 kB' 'Buffers: 2708 kB' 'Cached: 11939636 kB' 'SwapCached: 0 kB' 'Active: 8639992 kB' 'Inactive: 3752664 kB' 'Active(anon): 8246936 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453624 kB' 'Mapped: 164940 kB' 'Shmem: 7796624 kB' 'KReclaimable: 192724 kB' 'Slab: 669328 kB' 'SReclaimable: 192724 kB' 'SUnreclaim: 476604 kB' 'KernelStack: 12768 kB' 'PageTables: 7500 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9304916 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.103 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.103 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.104 16:40:31 -- setup/common.sh@33 -- # echo 0 00:04:46.104 16:40:31 -- setup/common.sh@33 -- # return 0 00:04:46.104 16:40:31 -- setup/hugepages.sh@97 -- # anon=0 00:04:46.104 16:40:31 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:46.104 16:40:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:46.104 16:40:31 -- setup/common.sh@18 -- # local node= 00:04:46.104 16:40:31 -- setup/common.sh@19 -- # local var val 00:04:46.104 16:40:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.104 16:40:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.104 16:40:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.104 16:40:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.104 16:40:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.104 16:40:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44083344 kB' 'MemAvailable: 47831604 kB' 'Buffers: 2708 kB' 'Cached: 11939636 kB' 'SwapCached: 0 kB' 'Active: 8640420 kB' 'Inactive: 3752664 kB' 'Active(anon): 8247364 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454100 kB' 'Mapped: 165016 kB' 'Shmem: 7796624 kB' 'KReclaimable: 192724 kB' 'Slab: 669372 kB' 'SReclaimable: 192724 kB' 'SUnreclaim: 476648 kB' 'KernelStack: 12768 kB' 'PageTables: 7500 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9304928 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.104 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.104 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.105 16:40:31 -- setup/common.sh@33 -- # echo 0 00:04:46.105 16:40:31 -- setup/common.sh@33 -- # return 0 00:04:46.105 16:40:31 -- setup/hugepages.sh@99 -- # surp=0 00:04:46.105 16:40:31 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:46.105 16:40:31 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:46.105 16:40:31 -- setup/common.sh@18 -- # local node= 00:04:46.105 16:40:31 -- setup/common.sh@19 -- # local var val 00:04:46.105 16:40:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.105 16:40:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.105 16:40:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.105 16:40:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.105 16:40:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.105 16:40:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44084240 kB' 'MemAvailable: 47832500 kB' 'Buffers: 2708 kB' 'Cached: 11939636 kB' 'SwapCached: 0 kB' 'Active: 8639564 kB' 'Inactive: 3752664 kB' 'Active(anon): 8246508 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453180 kB' 'Mapped: 164924 kB' 'Shmem: 7796624 kB' 'KReclaimable: 192724 kB' 'Slab: 669368 kB' 'SReclaimable: 192724 kB' 'SUnreclaim: 476644 kB' 'KernelStack: 12784 kB' 'PageTables: 7492 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9304944 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.105 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.105 16:40:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.106 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.106 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.107 16:40:31 -- setup/common.sh@33 -- # echo 0 00:04:46.107 16:40:31 -- setup/common.sh@33 -- # return 0 00:04:46.107 16:40:31 -- setup/hugepages.sh@100 -- # resv=0 00:04:46.107 16:40:31 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:46.107 nr_hugepages=1024 00:04:46.107 16:40:31 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:46.107 resv_hugepages=0 00:04:46.107 16:40:31 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:46.107 surplus_hugepages=0 00:04:46.107 16:40:31 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:46.107 anon_hugepages=0 00:04:46.107 16:40:31 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:46.107 16:40:31 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:46.107 16:40:31 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:46.107 16:40:31 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:46.107 16:40:31 -- setup/common.sh@18 -- # local node= 00:04:46.107 16:40:31 -- setup/common.sh@19 -- # local var val 00:04:46.107 16:40:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.107 16:40:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.107 16:40:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.107 16:40:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.107 16:40:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.107 16:40:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44083936 kB' 'MemAvailable: 47832196 kB' 'Buffers: 2708 kB' 'Cached: 11939636 kB' 'SwapCached: 0 kB' 'Active: 8639748 kB' 'Inactive: 3752664 kB' 'Active(anon): 8246692 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453400 kB' 'Mapped: 164924 kB' 'Shmem: 7796624 kB' 'KReclaimable: 192724 kB' 'Slab: 669368 kB' 'SReclaimable: 192724 kB' 'SUnreclaim: 476644 kB' 'KernelStack: 12816 kB' 'PageTables: 7588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9304956 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.107 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.107 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.108 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.108 16:40:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.369 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.369 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.370 16:40:31 -- setup/common.sh@33 -- # echo 1024 00:04:46.370 16:40:31 -- setup/common.sh@33 -- # return 0 00:04:46.370 16:40:31 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:46.370 16:40:31 -- setup/hugepages.sh@112 -- # get_nodes 00:04:46.370 16:40:31 -- setup/hugepages.sh@27 -- # local node 00:04:46.370 16:40:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:46.370 16:40:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:46.370 16:40:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:46.370 16:40:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:46.370 16:40:31 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:46.370 16:40:31 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:46.370 16:40:31 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:46.370 16:40:31 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:46.370 16:40:31 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:46.370 16:40:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:46.370 16:40:31 -- setup/common.sh@18 -- # local node=0 00:04:46.370 16:40:31 -- setup/common.sh@19 -- # local var val 00:04:46.370 16:40:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.370 16:40:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.370 16:40:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:46.370 16:40:31 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:46.370 16:40:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.370 16:40:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27651516 kB' 'MemUsed: 5223408 kB' 'SwapCached: 0 kB' 'Active: 2766464 kB' 'Inactive: 109492 kB' 'Active(anon): 2617080 kB' 'Inactive(anon): 0 kB' 'Active(file): 149384 kB' 'Inactive(file): 109492 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2678812 kB' 'Mapped: 60036 kB' 'AnonPages: 200420 kB' 'Shmem: 2419936 kB' 'KernelStack: 7880 kB' 'PageTables: 4484 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 120412 kB' 'Slab: 423368 kB' 'SReclaimable: 120412 kB' 'SUnreclaim: 302956 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.370 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.370 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@33 -- # echo 0 00:04:46.371 16:40:31 -- setup/common.sh@33 -- # return 0 00:04:46.371 16:40:31 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:46.371 16:40:31 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:46.371 16:40:31 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:46.371 16:40:31 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:46.371 16:40:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:46.371 16:40:31 -- setup/common.sh@18 -- # local node=1 00:04:46.371 16:40:31 -- setup/common.sh@19 -- # local var val 00:04:46.371 16:40:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.371 16:40:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.371 16:40:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:46.371 16:40:31 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:46.371 16:40:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.371 16:40:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660752 kB' 'MemFree: 16432672 kB' 'MemUsed: 11228080 kB' 'SwapCached: 0 kB' 'Active: 5873192 kB' 'Inactive: 3643172 kB' 'Active(anon): 5629520 kB' 'Inactive(anon): 0 kB' 'Active(file): 243672 kB' 'Inactive(file): 3643172 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9263588 kB' 'Mapped: 104888 kB' 'AnonPages: 252848 kB' 'Shmem: 5376744 kB' 'KernelStack: 4920 kB' 'PageTables: 3052 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 72312 kB' 'Slab: 246000 kB' 'SReclaimable: 72312 kB' 'SUnreclaim: 173688 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.371 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.371 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # continue 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.372 16:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.372 16:40:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.372 16:40:31 -- setup/common.sh@33 -- # echo 0 00:04:46.372 16:40:31 -- setup/common.sh@33 -- # return 0 00:04:46.372 16:40:31 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:46.372 16:40:31 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:46.372 16:40:31 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:46.372 16:40:31 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:46.372 16:40:31 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:46.372 node0=512 expecting 512 00:04:46.372 16:40:31 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:46.372 16:40:31 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:46.372 16:40:31 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:46.372 16:40:31 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:46.372 node1=512 expecting 512 00:04:46.372 16:40:31 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:46.372 00:04:46.372 real 0m1.499s 00:04:46.372 user 0m0.614s 00:04:46.372 sys 0m0.851s 00:04:46.372 16:40:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.372 16:40:31 -- common/autotest_common.sh@10 -- # set +x 00:04:46.372 ************************************ 00:04:46.372 END TEST per_node_1G_alloc 00:04:46.372 ************************************ 00:04:46.372 16:40:31 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:46.372 16:40:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:46.372 16:40:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.372 16:40:31 -- common/autotest_common.sh@10 -- # set +x 00:04:46.372 ************************************ 00:04:46.372 START TEST even_2G_alloc 00:04:46.372 ************************************ 00:04:46.372 16:40:31 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:46.372 16:40:31 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:46.372 16:40:31 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:46.372 16:40:31 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:46.372 16:40:31 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:46.372 16:40:31 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:46.372 16:40:31 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:46.372 16:40:31 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:46.372 16:40:31 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:46.372 16:40:31 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:46.372 16:40:31 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:46.372 16:40:31 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:46.372 16:40:31 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:46.372 16:40:31 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:46.372 16:40:31 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:46.372 16:40:31 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:46.372 16:40:31 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:46.372 16:40:31 -- setup/hugepages.sh@83 -- # : 512 00:04:46.372 16:40:31 -- setup/hugepages.sh@84 -- # : 1 00:04:46.372 16:40:31 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:46.372 16:40:31 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:46.372 16:40:31 -- setup/hugepages.sh@83 -- # : 0 00:04:46.372 16:40:31 -- setup/hugepages.sh@84 -- # : 0 00:04:46.372 16:40:31 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:46.372 16:40:31 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:46.372 16:40:31 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:46.372 16:40:31 -- setup/hugepages.sh@153 -- # setup output 00:04:46.372 16:40:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:46.372 16:40:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:47.757 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:47.757 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:47.757 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:47.757 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:47.757 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:47.757 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:47.757 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:47.757 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:47.757 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:47.757 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:47.757 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:47.757 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:47.757 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:47.757 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:47.757 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:47.757 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:47.757 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:47.757 16:40:33 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:47.757 16:40:33 -- setup/hugepages.sh@89 -- # local node 00:04:47.757 16:40:33 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:47.757 16:40:33 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:47.757 16:40:33 -- setup/hugepages.sh@92 -- # local surp 00:04:47.757 16:40:33 -- setup/hugepages.sh@93 -- # local resv 00:04:47.757 16:40:33 -- setup/hugepages.sh@94 -- # local anon 00:04:47.757 16:40:33 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:47.757 16:40:33 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:47.757 16:40:33 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:47.757 16:40:33 -- setup/common.sh@18 -- # local node= 00:04:47.757 16:40:33 -- setup/common.sh@19 -- # local var val 00:04:47.757 16:40:33 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.757 16:40:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.757 16:40:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.757 16:40:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.757 16:40:33 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.757 16:40:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.757 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.757 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44073584 kB' 'MemAvailable: 47821840 kB' 'Buffers: 2708 kB' 'Cached: 11939724 kB' 'SwapCached: 0 kB' 'Active: 8640288 kB' 'Inactive: 3752664 kB' 'Active(anon): 8247232 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453740 kB' 'Mapped: 164928 kB' 'Shmem: 7796712 kB' 'KReclaimable: 192716 kB' 'Slab: 669428 kB' 'SReclaimable: 192716 kB' 'SUnreclaim: 476712 kB' 'KernelStack: 12784 kB' 'PageTables: 7496 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9305136 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.758 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.758 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.759 16:40:33 -- setup/common.sh@33 -- # echo 0 00:04:47.759 16:40:33 -- setup/common.sh@33 -- # return 0 00:04:47.759 16:40:33 -- setup/hugepages.sh@97 -- # anon=0 00:04:47.759 16:40:33 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:47.759 16:40:33 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.759 16:40:33 -- setup/common.sh@18 -- # local node= 00:04:47.759 16:40:33 -- setup/common.sh@19 -- # local var val 00:04:47.759 16:40:33 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.759 16:40:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.759 16:40:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.759 16:40:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.759 16:40:33 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.759 16:40:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44074772 kB' 'MemAvailable: 47823028 kB' 'Buffers: 2708 kB' 'Cached: 11939728 kB' 'SwapCached: 0 kB' 'Active: 8640156 kB' 'Inactive: 3752664 kB' 'Active(anon): 8247100 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453644 kB' 'Mapped: 164896 kB' 'Shmem: 7796716 kB' 'KReclaimable: 192716 kB' 'Slab: 669468 kB' 'SReclaimable: 192716 kB' 'SUnreclaim: 476752 kB' 'KernelStack: 12816 kB' 'PageTables: 7588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9305148 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.759 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.759 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.760 16:40:33 -- setup/common.sh@33 -- # echo 0 00:04:47.760 16:40:33 -- setup/common.sh@33 -- # return 0 00:04:47.760 16:40:33 -- setup/hugepages.sh@99 -- # surp=0 00:04:47.760 16:40:33 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:47.760 16:40:33 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:47.760 16:40:33 -- setup/common.sh@18 -- # local node= 00:04:47.760 16:40:33 -- setup/common.sh@19 -- # local var val 00:04:47.760 16:40:33 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.760 16:40:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.760 16:40:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.760 16:40:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.760 16:40:33 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.760 16:40:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44075208 kB' 'MemAvailable: 47823464 kB' 'Buffers: 2708 kB' 'Cached: 11939740 kB' 'SwapCached: 0 kB' 'Active: 8640156 kB' 'Inactive: 3752664 kB' 'Active(anon): 8247100 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453636 kB' 'Mapped: 164896 kB' 'Shmem: 7796728 kB' 'KReclaimable: 192716 kB' 'Slab: 669468 kB' 'SReclaimable: 192716 kB' 'SUnreclaim: 476752 kB' 'KernelStack: 12816 kB' 'PageTables: 7588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9305164 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.760 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.760 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.761 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.761 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.762 16:40:33 -- setup/common.sh@33 -- # echo 0 00:04:47.762 16:40:33 -- setup/common.sh@33 -- # return 0 00:04:47.762 16:40:33 -- setup/hugepages.sh@100 -- # resv=0 00:04:47.762 16:40:33 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:47.762 nr_hugepages=1024 00:04:47.762 16:40:33 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:47.762 resv_hugepages=0 00:04:47.762 16:40:33 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:47.762 surplus_hugepages=0 00:04:47.762 16:40:33 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:47.762 anon_hugepages=0 00:04:47.762 16:40:33 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:47.762 16:40:33 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:47.762 16:40:33 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:47.762 16:40:33 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:47.762 16:40:33 -- setup/common.sh@18 -- # local node= 00:04:47.762 16:40:33 -- setup/common.sh@19 -- # local var val 00:04:47.762 16:40:33 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.762 16:40:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.762 16:40:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.762 16:40:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.762 16:40:33 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.762 16:40:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44076156 kB' 'MemAvailable: 47824412 kB' 'Buffers: 2708 kB' 'Cached: 11939752 kB' 'SwapCached: 0 kB' 'Active: 8640132 kB' 'Inactive: 3752664 kB' 'Active(anon): 8247076 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453604 kB' 'Mapped: 164460 kB' 'Shmem: 7796740 kB' 'KReclaimable: 192716 kB' 'Slab: 669468 kB' 'SReclaimable: 192716 kB' 'SUnreclaim: 476752 kB' 'KernelStack: 12800 kB' 'PageTables: 7540 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9293176 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.762 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.762 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.763 16:40:33 -- setup/common.sh@33 -- # echo 1024 00:04:47.763 16:40:33 -- setup/common.sh@33 -- # return 0 00:04:47.763 16:40:33 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:47.763 16:40:33 -- setup/hugepages.sh@112 -- # get_nodes 00:04:47.763 16:40:33 -- setup/hugepages.sh@27 -- # local node 00:04:47.763 16:40:33 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:47.763 16:40:33 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:47.763 16:40:33 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:47.763 16:40:33 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:47.763 16:40:33 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:47.763 16:40:33 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:47.763 16:40:33 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:47.763 16:40:33 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:47.763 16:40:33 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:47.763 16:40:33 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.763 16:40:33 -- setup/common.sh@18 -- # local node=0 00:04:47.763 16:40:33 -- setup/common.sh@19 -- # local var val 00:04:47.763 16:40:33 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.763 16:40:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.763 16:40:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:47.763 16:40:33 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:47.763 16:40:33 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.763 16:40:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27641104 kB' 'MemUsed: 5233820 kB' 'SwapCached: 0 kB' 'Active: 2766700 kB' 'Inactive: 109492 kB' 'Active(anon): 2617316 kB' 'Inactive(anon): 0 kB' 'Active(file): 149384 kB' 'Inactive(file): 109492 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2678820 kB' 'Mapped: 59144 kB' 'AnonPages: 200556 kB' 'Shmem: 2419944 kB' 'KernelStack: 7832 kB' 'PageTables: 4272 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 120412 kB' 'Slab: 423372 kB' 'SReclaimable: 120412 kB' 'SUnreclaim: 302960 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.763 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.763 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@33 -- # echo 0 00:04:47.764 16:40:33 -- setup/common.sh@33 -- # return 0 00:04:47.764 16:40:33 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:47.764 16:40:33 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:47.764 16:40:33 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:47.764 16:40:33 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:47.764 16:40:33 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.764 16:40:33 -- setup/common.sh@18 -- # local node=1 00:04:47.764 16:40:33 -- setup/common.sh@19 -- # local var val 00:04:47.764 16:40:33 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.764 16:40:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.764 16:40:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:47.764 16:40:33 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:47.764 16:40:33 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.764 16:40:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.764 16:40:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660752 kB' 'MemFree: 16435052 kB' 'MemUsed: 11225700 kB' 'SwapCached: 0 kB' 'Active: 5871548 kB' 'Inactive: 3643172 kB' 'Active(anon): 5627876 kB' 'Inactive(anon): 0 kB' 'Active(file): 243672 kB' 'Inactive(file): 3643172 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9263668 kB' 'Mapped: 104748 kB' 'AnonPages: 251124 kB' 'Shmem: 5376824 kB' 'KernelStack: 4920 kB' 'PageTables: 3008 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 72296 kB' 'Slab: 246056 kB' 'SReclaimable: 72296 kB' 'SUnreclaim: 173760 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.764 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.764 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # continue 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.765 16:40:33 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.765 16:40:33 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.765 16:40:33 -- setup/common.sh@33 -- # echo 0 00:04:47.765 16:40:33 -- setup/common.sh@33 -- # return 0 00:04:47.765 16:40:33 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:47.765 16:40:33 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:47.765 16:40:33 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:47.765 16:40:33 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:47.765 16:40:33 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:47.765 node0=512 expecting 512 00:04:47.765 16:40:33 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:47.765 16:40:33 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:47.765 16:40:33 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:47.765 16:40:33 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:47.765 node1=512 expecting 512 00:04:47.765 16:40:33 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:47.765 00:04:47.765 real 0m1.554s 00:04:47.765 user 0m0.606s 00:04:47.765 sys 0m0.906s 00:04:47.765 16:40:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:47.765 16:40:33 -- common/autotest_common.sh@10 -- # set +x 00:04:47.765 ************************************ 00:04:47.765 END TEST even_2G_alloc 00:04:47.765 ************************************ 00:04:48.025 16:40:33 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:48.025 16:40:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:48.025 16:40:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:48.025 16:40:33 -- common/autotest_common.sh@10 -- # set +x 00:04:48.025 ************************************ 00:04:48.025 START TEST odd_alloc 00:04:48.025 ************************************ 00:04:48.025 16:40:33 -- common/autotest_common.sh@1114 -- # odd_alloc 00:04:48.025 16:40:33 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:48.025 16:40:33 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:48.025 16:40:33 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:48.025 16:40:33 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:48.025 16:40:33 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:48.025 16:40:33 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:48.025 16:40:33 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:48.025 16:40:33 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:48.025 16:40:33 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:48.025 16:40:33 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:48.025 16:40:33 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:48.025 16:40:33 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:48.025 16:40:33 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:48.025 16:40:33 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:48.025 16:40:33 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:48.025 16:40:33 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:48.025 16:40:33 -- setup/hugepages.sh@83 -- # : 513 00:04:48.025 16:40:33 -- setup/hugepages.sh@84 -- # : 1 00:04:48.025 16:40:33 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:48.025 16:40:33 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:48.025 16:40:33 -- setup/hugepages.sh@83 -- # : 0 00:04:48.025 16:40:33 -- setup/hugepages.sh@84 -- # : 0 00:04:48.025 16:40:33 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:48.025 16:40:33 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:48.025 16:40:33 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:48.025 16:40:33 -- setup/hugepages.sh@160 -- # setup output 00:04:48.025 16:40:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:48.025 16:40:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:48.962 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:48.962 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:48.962 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:48.962 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:48.962 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:48.962 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:48.962 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:48.962 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:48.962 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:48.962 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:49.226 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:49.226 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:49.226 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:49.226 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:49.226 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:49.226 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:49.226 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:49.226 16:40:34 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:49.226 16:40:34 -- setup/hugepages.sh@89 -- # local node 00:04:49.226 16:40:34 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:49.226 16:40:34 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:49.226 16:40:34 -- setup/hugepages.sh@92 -- # local surp 00:04:49.226 16:40:34 -- setup/hugepages.sh@93 -- # local resv 00:04:49.226 16:40:34 -- setup/hugepages.sh@94 -- # local anon 00:04:49.226 16:40:34 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:49.226 16:40:34 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:49.226 16:40:34 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:49.226 16:40:34 -- setup/common.sh@18 -- # local node= 00:04:49.226 16:40:34 -- setup/common.sh@19 -- # local var val 00:04:49.226 16:40:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.226 16:40:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.226 16:40:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.226 16:40:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.226 16:40:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.226 16:40:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44091024 kB' 'MemAvailable: 47839276 kB' 'Buffers: 2708 kB' 'Cached: 11939816 kB' 'SwapCached: 0 kB' 'Active: 8638732 kB' 'Inactive: 3752664 kB' 'Active(anon): 8245676 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452260 kB' 'Mapped: 163988 kB' 'Shmem: 7796804 kB' 'KReclaimable: 192708 kB' 'Slab: 668952 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476244 kB' 'KernelStack: 12784 kB' 'PageTables: 7324 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 9293356 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.226 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.226 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.227 16:40:34 -- setup/common.sh@33 -- # echo 0 00:04:49.227 16:40:34 -- setup/common.sh@33 -- # return 0 00:04:49.227 16:40:34 -- setup/hugepages.sh@97 -- # anon=0 00:04:49.227 16:40:34 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:49.227 16:40:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:49.227 16:40:34 -- setup/common.sh@18 -- # local node= 00:04:49.227 16:40:34 -- setup/common.sh@19 -- # local var val 00:04:49.227 16:40:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.227 16:40:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.227 16:40:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.227 16:40:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.227 16:40:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.227 16:40:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44092128 kB' 'MemAvailable: 47840380 kB' 'Buffers: 2708 kB' 'Cached: 11939816 kB' 'SwapCached: 0 kB' 'Active: 8639504 kB' 'Inactive: 3752664 kB' 'Active(anon): 8246448 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452968 kB' 'Mapped: 163988 kB' 'Shmem: 7796804 kB' 'KReclaimable: 192708 kB' 'Slab: 668968 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476260 kB' 'KernelStack: 12800 kB' 'PageTables: 7348 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 9293368 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.227 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.227 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.228 16:40:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.228 16:40:34 -- setup/common.sh@33 -- # echo 0 00:04:49.228 16:40:34 -- setup/common.sh@33 -- # return 0 00:04:49.228 16:40:34 -- setup/hugepages.sh@99 -- # surp=0 00:04:49.228 16:40:34 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:49.228 16:40:34 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:49.228 16:40:34 -- setup/common.sh@18 -- # local node= 00:04:49.228 16:40:34 -- setup/common.sh@19 -- # local var val 00:04:49.228 16:40:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.228 16:40:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.228 16:40:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.228 16:40:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.228 16:40:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.228 16:40:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.228 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44093120 kB' 'MemAvailable: 47841372 kB' 'Buffers: 2708 kB' 'Cached: 11939832 kB' 'SwapCached: 0 kB' 'Active: 8640572 kB' 'Inactive: 3752664 kB' 'Active(anon): 8247516 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453968 kB' 'Mapped: 164340 kB' 'Shmem: 7796820 kB' 'KReclaimable: 192708 kB' 'Slab: 668964 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476256 kB' 'KernelStack: 12736 kB' 'PageTables: 7040 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 9296720 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.229 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.229 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.230 16:40:34 -- setup/common.sh@33 -- # echo 0 00:04:49.230 16:40:34 -- setup/common.sh@33 -- # return 0 00:04:49.230 16:40:34 -- setup/hugepages.sh@100 -- # resv=0 00:04:49.230 16:40:34 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:49.230 nr_hugepages=1025 00:04:49.230 16:40:34 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:49.230 resv_hugepages=0 00:04:49.230 16:40:34 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:49.230 surplus_hugepages=0 00:04:49.230 16:40:34 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:49.230 anon_hugepages=0 00:04:49.230 16:40:34 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:49.230 16:40:34 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:49.230 16:40:34 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:49.230 16:40:34 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:49.230 16:40:34 -- setup/common.sh@18 -- # local node= 00:04:49.230 16:40:34 -- setup/common.sh@19 -- # local var val 00:04:49.230 16:40:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.230 16:40:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.230 16:40:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.230 16:40:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.230 16:40:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.230 16:40:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44089972 kB' 'MemAvailable: 47838224 kB' 'Buffers: 2708 kB' 'Cached: 11939844 kB' 'SwapCached: 0 kB' 'Active: 8643928 kB' 'Inactive: 3752664 kB' 'Active(anon): 8250872 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457460 kB' 'Mapped: 164620 kB' 'Shmem: 7796832 kB' 'KReclaimable: 192708 kB' 'Slab: 668960 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476252 kB' 'KernelStack: 12816 kB' 'PageTables: 7320 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 9299520 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198348 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.230 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.230 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.231 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.231 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.493 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.493 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.494 16:40:34 -- setup/common.sh@33 -- # echo 1025 00:04:49.494 16:40:34 -- setup/common.sh@33 -- # return 0 00:04:49.494 16:40:34 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:49.494 16:40:34 -- setup/hugepages.sh@112 -- # get_nodes 00:04:49.494 16:40:34 -- setup/hugepages.sh@27 -- # local node 00:04:49.494 16:40:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:49.494 16:40:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:49.494 16:40:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:49.494 16:40:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:49.494 16:40:34 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:49.494 16:40:34 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:49.494 16:40:34 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:49.494 16:40:34 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:49.494 16:40:34 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:49.494 16:40:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:49.494 16:40:34 -- setup/common.sh@18 -- # local node=0 00:04:49.494 16:40:34 -- setup/common.sh@19 -- # local var val 00:04:49.494 16:40:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.494 16:40:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.494 16:40:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:49.494 16:40:34 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:49.494 16:40:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.494 16:40:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27645076 kB' 'MemUsed: 5229848 kB' 'SwapCached: 0 kB' 'Active: 2768668 kB' 'Inactive: 109492 kB' 'Active(anon): 2619284 kB' 'Inactive(anon): 0 kB' 'Active(file): 149384 kB' 'Inactive(file): 109492 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2678828 kB' 'Mapped: 59144 kB' 'AnonPages: 202608 kB' 'Shmem: 2419952 kB' 'KernelStack: 7784 kB' 'PageTables: 4256 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 120412 kB' 'Slab: 423120 kB' 'SReclaimable: 120412 kB' 'SUnreclaim: 302708 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.494 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.494 16:40:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:34 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@33 -- # echo 0 00:04:49.495 16:40:35 -- setup/common.sh@33 -- # return 0 00:04:49.495 16:40:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:49.495 16:40:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:49.495 16:40:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:49.495 16:40:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:49.495 16:40:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:49.495 16:40:35 -- setup/common.sh@18 -- # local node=1 00:04:49.495 16:40:35 -- setup/common.sh@19 -- # local var val 00:04:49.495 16:40:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.495 16:40:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.495 16:40:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:49.495 16:40:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:49.495 16:40:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.495 16:40:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660752 kB' 'MemFree: 16445052 kB' 'MemUsed: 11215700 kB' 'SwapCached: 0 kB' 'Active: 5870744 kB' 'Inactive: 3643172 kB' 'Active(anon): 5627072 kB' 'Inactive(anon): 0 kB' 'Active(file): 243672 kB' 'Inactive(file): 3643172 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9263752 kB' 'Mapped: 105196 kB' 'AnonPages: 250284 kB' 'Shmem: 5376908 kB' 'KernelStack: 5000 kB' 'PageTables: 2964 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 72296 kB' 'Slab: 245840 kB' 'SReclaimable: 72296 kB' 'SUnreclaim: 173544 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.495 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.495 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # continue 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.496 16:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.496 16:40:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.496 16:40:35 -- setup/common.sh@33 -- # echo 0 00:04:49.496 16:40:35 -- setup/common.sh@33 -- # return 0 00:04:49.496 16:40:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:49.496 16:40:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:49.496 16:40:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:49.496 16:40:35 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:49.496 node0=512 expecting 513 00:04:49.496 16:40:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:49.496 16:40:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:49.496 16:40:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:49.496 16:40:35 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:49.496 node1=513 expecting 512 00:04:49.496 16:40:35 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:49.496 00:04:49.496 real 0m1.520s 00:04:49.496 user 0m0.619s 00:04:49.496 sys 0m0.865s 00:04:49.496 16:40:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.496 16:40:35 -- common/autotest_common.sh@10 -- # set +x 00:04:49.496 ************************************ 00:04:49.496 END TEST odd_alloc 00:04:49.496 ************************************ 00:04:49.496 16:40:35 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:49.496 16:40:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:49.496 16:40:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:49.496 16:40:35 -- common/autotest_common.sh@10 -- # set +x 00:04:49.496 ************************************ 00:04:49.496 START TEST custom_alloc 00:04:49.496 ************************************ 00:04:49.496 16:40:35 -- common/autotest_common.sh@1114 -- # custom_alloc 00:04:49.496 16:40:35 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:49.496 16:40:35 -- setup/hugepages.sh@169 -- # local node 00:04:49.496 16:40:35 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:49.496 16:40:35 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:49.496 16:40:35 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:49.496 16:40:35 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:49.496 16:40:35 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:49.496 16:40:35 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:49.496 16:40:35 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:49.496 16:40:35 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:49.496 16:40:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:49.496 16:40:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:49.496 16:40:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:49.496 16:40:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:49.496 16:40:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:49.496 16:40:35 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:49.496 16:40:35 -- setup/hugepages.sh@83 -- # : 256 00:04:49.496 16:40:35 -- setup/hugepages.sh@84 -- # : 1 00:04:49.496 16:40:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:49.496 16:40:35 -- setup/hugepages.sh@83 -- # : 0 00:04:49.496 16:40:35 -- setup/hugepages.sh@84 -- # : 0 00:04:49.496 16:40:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:49.496 16:40:35 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:49.496 16:40:35 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:49.496 16:40:35 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:49.496 16:40:35 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:49.496 16:40:35 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:49.496 16:40:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:49.496 16:40:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:49.496 16:40:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:49.496 16:40:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:49.496 16:40:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:49.496 16:40:35 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:49.496 16:40:35 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:49.496 16:40:35 -- setup/hugepages.sh@78 -- # return 0 00:04:49.496 16:40:35 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:49.496 16:40:35 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:49.496 16:40:35 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:49.496 16:40:35 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:49.496 16:40:35 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:49.496 16:40:35 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:49.496 16:40:35 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:49.496 16:40:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:49.496 16:40:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:49.496 16:40:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:49.496 16:40:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:49.496 16:40:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:49.496 16:40:35 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:49.496 16:40:35 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:49.497 16:40:35 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:49.497 16:40:35 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:49.497 16:40:35 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:49.497 16:40:35 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:49.497 16:40:35 -- setup/hugepages.sh@78 -- # return 0 00:04:49.497 16:40:35 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:49.497 16:40:35 -- setup/hugepages.sh@187 -- # setup output 00:04:49.497 16:40:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:49.497 16:40:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:50.886 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:50.886 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:50.886 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:50.886 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:50.886 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:50.886 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:50.886 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:50.886 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:50.886 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:50.886 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:50.886 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:50.886 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:50.886 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:50.886 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:50.886 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:50.886 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:50.886 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:50.886 16:40:36 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:50.886 16:40:36 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:50.886 16:40:36 -- setup/hugepages.sh@89 -- # local node 00:04:50.886 16:40:36 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:50.886 16:40:36 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:50.886 16:40:36 -- setup/hugepages.sh@92 -- # local surp 00:04:50.886 16:40:36 -- setup/hugepages.sh@93 -- # local resv 00:04:50.886 16:40:36 -- setup/hugepages.sh@94 -- # local anon 00:04:50.886 16:40:36 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:50.886 16:40:36 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:50.886 16:40:36 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:50.886 16:40:36 -- setup/common.sh@18 -- # local node= 00:04:50.886 16:40:36 -- setup/common.sh@19 -- # local var val 00:04:50.886 16:40:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.886 16:40:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.886 16:40:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.886 16:40:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.886 16:40:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.886 16:40:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.886 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.886 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.886 16:40:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43039872 kB' 'MemAvailable: 46788124 kB' 'Buffers: 2708 kB' 'Cached: 11939920 kB' 'SwapCached: 0 kB' 'Active: 8638964 kB' 'Inactive: 3752664 kB' 'Active(anon): 8245908 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452272 kB' 'Mapped: 164008 kB' 'Shmem: 7796908 kB' 'KReclaimable: 192708 kB' 'Slab: 668948 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476240 kB' 'KernelStack: 12816 kB' 'PageTables: 7268 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 9293588 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:50.886 16:40:36 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.886 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.886 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.886 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.886 16:40:36 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.886 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.886 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.886 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.887 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.887 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.888 16:40:36 -- setup/common.sh@33 -- # echo 0 00:04:50.888 16:40:36 -- setup/common.sh@33 -- # return 0 00:04:50.888 16:40:36 -- setup/hugepages.sh@97 -- # anon=0 00:04:50.888 16:40:36 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:50.888 16:40:36 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.888 16:40:36 -- setup/common.sh@18 -- # local node= 00:04:50.888 16:40:36 -- setup/common.sh@19 -- # local var val 00:04:50.888 16:40:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.888 16:40:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.888 16:40:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.888 16:40:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.888 16:40:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.888 16:40:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43041124 kB' 'MemAvailable: 46789376 kB' 'Buffers: 2708 kB' 'Cached: 11939924 kB' 'SwapCached: 0 kB' 'Active: 8638540 kB' 'Inactive: 3752664 kB' 'Active(anon): 8245484 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451872 kB' 'Mapped: 164004 kB' 'Shmem: 7796912 kB' 'KReclaimable: 192708 kB' 'Slab: 668948 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476240 kB' 'KernelStack: 12832 kB' 'PageTables: 7300 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 9293600 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.888 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.888 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.889 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.889 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.890 16:40:36 -- setup/common.sh@33 -- # echo 0 00:04:50.890 16:40:36 -- setup/common.sh@33 -- # return 0 00:04:50.890 16:40:36 -- setup/hugepages.sh@99 -- # surp=0 00:04:50.890 16:40:36 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:50.890 16:40:36 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:50.890 16:40:36 -- setup/common.sh@18 -- # local node= 00:04:50.890 16:40:36 -- setup/common.sh@19 -- # local var val 00:04:50.890 16:40:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.890 16:40:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.890 16:40:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.890 16:40:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.890 16:40:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.890 16:40:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43041416 kB' 'MemAvailable: 46789668 kB' 'Buffers: 2708 kB' 'Cached: 11939936 kB' 'SwapCached: 0 kB' 'Active: 8638620 kB' 'Inactive: 3752664 kB' 'Active(anon): 8245564 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451920 kB' 'Mapped: 163928 kB' 'Shmem: 7796924 kB' 'KReclaimable: 192708 kB' 'Slab: 668876 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476168 kB' 'KernelStack: 12832 kB' 'PageTables: 7284 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 9293616 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.890 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.890 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.891 16:40:36 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.891 16:40:36 -- setup/common.sh@33 -- # echo 0 00:04:50.891 16:40:36 -- setup/common.sh@33 -- # return 0 00:04:50.891 16:40:36 -- setup/hugepages.sh@100 -- # resv=0 00:04:50.891 16:40:36 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:50.891 nr_hugepages=1536 00:04:50.891 16:40:36 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:50.891 resv_hugepages=0 00:04:50.891 16:40:36 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:50.891 surplus_hugepages=0 00:04:50.891 16:40:36 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:50.891 anon_hugepages=0 00:04:50.891 16:40:36 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:50.891 16:40:36 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:50.891 16:40:36 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:50.891 16:40:36 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:50.891 16:40:36 -- setup/common.sh@18 -- # local node= 00:04:50.891 16:40:36 -- setup/common.sh@19 -- # local var val 00:04:50.891 16:40:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.891 16:40:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.891 16:40:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.891 16:40:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.891 16:40:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.891 16:40:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.891 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43041720 kB' 'MemAvailable: 46789972 kB' 'Buffers: 2708 kB' 'Cached: 11939948 kB' 'SwapCached: 0 kB' 'Active: 8638648 kB' 'Inactive: 3752664 kB' 'Active(anon): 8245592 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451928 kB' 'Mapped: 163928 kB' 'Shmem: 7796936 kB' 'KReclaimable: 192708 kB' 'Slab: 668876 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476168 kB' 'KernelStack: 12832 kB' 'PageTables: 7284 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 9293632 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.892 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.892 16:40:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.893 16:40:36 -- setup/common.sh@33 -- # echo 1536 00:04:50.893 16:40:36 -- setup/common.sh@33 -- # return 0 00:04:50.893 16:40:36 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:50.893 16:40:36 -- setup/hugepages.sh@112 -- # get_nodes 00:04:50.893 16:40:36 -- setup/hugepages.sh@27 -- # local node 00:04:50.893 16:40:36 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:50.893 16:40:36 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:50.893 16:40:36 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:50.893 16:40:36 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:50.893 16:40:36 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:50.893 16:40:36 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:50.893 16:40:36 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:50.893 16:40:36 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:50.893 16:40:36 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:50.893 16:40:36 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.893 16:40:36 -- setup/common.sh@18 -- # local node=0 00:04:50.893 16:40:36 -- setup/common.sh@19 -- # local var val 00:04:50.893 16:40:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.893 16:40:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.893 16:40:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:50.893 16:40:36 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:50.893 16:40:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.893 16:40:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27650760 kB' 'MemUsed: 5224164 kB' 'SwapCached: 0 kB' 'Active: 2767836 kB' 'Inactive: 109492 kB' 'Active(anon): 2618452 kB' 'Inactive(anon): 0 kB' 'Active(file): 149384 kB' 'Inactive(file): 109492 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2678836 kB' 'Mapped: 59160 kB' 'AnonPages: 201664 kB' 'Shmem: 2419960 kB' 'KernelStack: 7816 kB' 'PageTables: 4216 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 120412 kB' 'Slab: 423032 kB' 'SReclaimable: 120412 kB' 'SUnreclaim: 302620 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.893 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.893 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.894 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.894 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@33 -- # echo 0 00:04:50.895 16:40:36 -- setup/common.sh@33 -- # return 0 00:04:50.895 16:40:36 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:50.895 16:40:36 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:50.895 16:40:36 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:50.895 16:40:36 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:50.895 16:40:36 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.895 16:40:36 -- setup/common.sh@18 -- # local node=1 00:04:50.895 16:40:36 -- setup/common.sh@19 -- # local var val 00:04:50.895 16:40:36 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.895 16:40:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.895 16:40:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:50.895 16:40:36 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:50.895 16:40:36 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.895 16:40:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660752 kB' 'MemFree: 15391096 kB' 'MemUsed: 12269656 kB' 'SwapCached: 0 kB' 'Active: 5870900 kB' 'Inactive: 3643172 kB' 'Active(anon): 5627228 kB' 'Inactive(anon): 0 kB' 'Active(file): 243672 kB' 'Inactive(file): 3643172 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9263848 kB' 'Mapped: 104768 kB' 'AnonPages: 250268 kB' 'Shmem: 5377004 kB' 'KernelStack: 5016 kB' 'PageTables: 3068 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 72296 kB' 'Slab: 245844 kB' 'SReclaimable: 72296 kB' 'SUnreclaim: 173548 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.895 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.895 16:40:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # continue 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.896 16:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.896 16:40:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.896 16:40:36 -- setup/common.sh@33 -- # echo 0 00:04:50.896 16:40:36 -- setup/common.sh@33 -- # return 0 00:04:50.896 16:40:36 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:50.896 16:40:36 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:50.896 16:40:36 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:50.896 16:40:36 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:50.896 16:40:36 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:50.896 node0=512 expecting 512 00:04:50.896 16:40:36 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:50.896 16:40:36 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:50.896 16:40:36 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:50.896 16:40:36 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:50.896 node1=1024 expecting 1024 00:04:50.896 16:40:36 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:50.896 00:04:50.896 real 0m1.551s 00:04:50.896 user 0m0.659s 00:04:50.896 sys 0m0.850s 00:04:50.896 16:40:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.896 16:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:50.896 ************************************ 00:04:50.896 END TEST custom_alloc 00:04:50.896 ************************************ 00:04:50.896 16:40:36 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:50.896 16:40:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.896 16:40:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.896 16:40:36 -- common/autotest_common.sh@10 -- # set +x 00:04:51.157 ************************************ 00:04:51.157 START TEST no_shrink_alloc 00:04:51.157 ************************************ 00:04:51.157 16:40:36 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:04:51.157 16:40:36 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:51.157 16:40:36 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:51.157 16:40:36 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:51.157 16:40:36 -- setup/hugepages.sh@51 -- # shift 00:04:51.157 16:40:36 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:51.157 16:40:36 -- setup/hugepages.sh@52 -- # local node_ids 00:04:51.157 16:40:36 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:51.157 16:40:36 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:51.157 16:40:36 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:51.157 16:40:36 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:51.157 16:40:36 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:51.157 16:40:36 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:51.157 16:40:36 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:51.157 16:40:36 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:51.157 16:40:36 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:51.157 16:40:36 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:51.157 16:40:36 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:51.157 16:40:36 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:51.157 16:40:36 -- setup/hugepages.sh@73 -- # return 0 00:04:51.157 16:40:36 -- setup/hugepages.sh@198 -- # setup output 00:04:51.157 16:40:36 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:51.157 16:40:36 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:52.095 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:52.095 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:52.095 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:52.095 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:52.095 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:52.095 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:52.095 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:52.095 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:52.095 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:52.095 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:52.095 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:52.095 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:52.095 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:52.095 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:52.095 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:52.095 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:52.095 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:52.359 16:40:37 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:52.359 16:40:37 -- setup/hugepages.sh@89 -- # local node 00:04:52.359 16:40:37 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:52.359 16:40:37 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:52.359 16:40:37 -- setup/hugepages.sh@92 -- # local surp 00:04:52.359 16:40:37 -- setup/hugepages.sh@93 -- # local resv 00:04:52.359 16:40:37 -- setup/hugepages.sh@94 -- # local anon 00:04:52.359 16:40:37 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:52.359 16:40:37 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:52.359 16:40:37 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:52.359 16:40:37 -- setup/common.sh@18 -- # local node= 00:04:52.359 16:40:37 -- setup/common.sh@19 -- # local var val 00:04:52.359 16:40:37 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.359 16:40:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.359 16:40:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.359 16:40:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.359 16:40:37 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.359 16:40:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44072072 kB' 'MemAvailable: 47820324 kB' 'Buffers: 2708 kB' 'Cached: 11940008 kB' 'SwapCached: 0 kB' 'Active: 8639300 kB' 'Inactive: 3752664 kB' 'Active(anon): 8246244 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452456 kB' 'Mapped: 163940 kB' 'Shmem: 7796996 kB' 'KReclaimable: 192708 kB' 'Slab: 668868 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476160 kB' 'KernelStack: 12848 kB' 'PageTables: 7336 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9293808 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.359 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.359 16:40:37 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:37 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:37 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:37 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:37 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:52.360 16:40:38 -- setup/common.sh@33 -- # echo 0 00:04:52.360 16:40:38 -- setup/common.sh@33 -- # return 0 00:04:52.360 16:40:38 -- setup/hugepages.sh@97 -- # anon=0 00:04:52.360 16:40:38 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:52.360 16:40:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:52.360 16:40:38 -- setup/common.sh@18 -- # local node= 00:04:52.360 16:40:38 -- setup/common.sh@19 -- # local var val 00:04:52.360 16:40:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.360 16:40:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.360 16:40:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.360 16:40:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.360 16:40:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.360 16:40:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44076184 kB' 'MemAvailable: 47824436 kB' 'Buffers: 2708 kB' 'Cached: 11940008 kB' 'SwapCached: 0 kB' 'Active: 8640224 kB' 'Inactive: 3752664 kB' 'Active(anon): 8247168 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453436 kB' 'Mapped: 164016 kB' 'Shmem: 7796996 kB' 'KReclaimable: 192708 kB' 'Slab: 668956 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476248 kB' 'KernelStack: 12880 kB' 'PageTables: 7444 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9293820 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.360 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.360 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.361 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.361 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.362 16:40:38 -- setup/common.sh@33 -- # echo 0 00:04:52.362 16:40:38 -- setup/common.sh@33 -- # return 0 00:04:52.362 16:40:38 -- setup/hugepages.sh@99 -- # surp=0 00:04:52.362 16:40:38 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:52.362 16:40:38 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:52.362 16:40:38 -- setup/common.sh@18 -- # local node= 00:04:52.362 16:40:38 -- setup/common.sh@19 -- # local var val 00:04:52.362 16:40:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.362 16:40:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.362 16:40:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.362 16:40:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.362 16:40:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.362 16:40:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44075828 kB' 'MemAvailable: 47824080 kB' 'Buffers: 2708 kB' 'Cached: 11940024 kB' 'SwapCached: 0 kB' 'Active: 8638940 kB' 'Inactive: 3752664 kB' 'Active(anon): 8245884 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452112 kB' 'Mapped: 163920 kB' 'Shmem: 7797012 kB' 'KReclaimable: 192708 kB' 'Slab: 668908 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476200 kB' 'KernelStack: 12848 kB' 'PageTables: 7292 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9293836 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.362 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.362 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:52.363 16:40:38 -- setup/common.sh@33 -- # echo 0 00:04:52.363 16:40:38 -- setup/common.sh@33 -- # return 0 00:04:52.363 16:40:38 -- setup/hugepages.sh@100 -- # resv=0 00:04:52.363 16:40:38 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:52.363 nr_hugepages=1024 00:04:52.363 16:40:38 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:52.363 resv_hugepages=0 00:04:52.363 16:40:38 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:52.363 surplus_hugepages=0 00:04:52.363 16:40:38 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:52.363 anon_hugepages=0 00:04:52.363 16:40:38 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:52.363 16:40:38 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:52.363 16:40:38 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:52.363 16:40:38 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:52.363 16:40:38 -- setup/common.sh@18 -- # local node= 00:04:52.363 16:40:38 -- setup/common.sh@19 -- # local var val 00:04:52.363 16:40:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.363 16:40:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.363 16:40:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:52.363 16:40:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:52.363 16:40:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.363 16:40:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44075072 kB' 'MemAvailable: 47823324 kB' 'Buffers: 2708 kB' 'Cached: 11940036 kB' 'SwapCached: 0 kB' 'Active: 8639560 kB' 'Inactive: 3752664 kB' 'Active(anon): 8246504 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452292 kB' 'Mapped: 163920 kB' 'Shmem: 7797024 kB' 'KReclaimable: 192708 kB' 'Slab: 668908 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476200 kB' 'KernelStack: 12880 kB' 'PageTables: 7388 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9297904 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198504 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.363 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.363 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.364 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.364 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:52.365 16:40:38 -- setup/common.sh@33 -- # echo 1024 00:04:52.365 16:40:38 -- setup/common.sh@33 -- # return 0 00:04:52.365 16:40:38 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:52.365 16:40:38 -- setup/hugepages.sh@112 -- # get_nodes 00:04:52.365 16:40:38 -- setup/hugepages.sh@27 -- # local node 00:04:52.365 16:40:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:52.365 16:40:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:52.365 16:40:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:52.365 16:40:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:52.365 16:40:38 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:52.365 16:40:38 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:52.365 16:40:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:52.365 16:40:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:52.365 16:40:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:52.365 16:40:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:52.365 16:40:38 -- setup/common.sh@18 -- # local node=0 00:04:52.365 16:40:38 -- setup/common.sh@19 -- # local var val 00:04:52.365 16:40:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:52.365 16:40:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:52.365 16:40:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:52.365 16:40:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:52.365 16:40:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:52.365 16:40:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 26596448 kB' 'MemUsed: 6278476 kB' 'SwapCached: 0 kB' 'Active: 2768660 kB' 'Inactive: 109492 kB' 'Active(anon): 2619276 kB' 'Inactive(anon): 0 kB' 'Active(file): 149384 kB' 'Inactive(file): 109492 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2678844 kB' 'Mapped: 59148 kB' 'AnonPages: 202484 kB' 'Shmem: 2419968 kB' 'KernelStack: 7800 kB' 'PageTables: 4228 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 120412 kB' 'Slab: 423060 kB' 'SReclaimable: 120412 kB' 'SUnreclaim: 302648 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.365 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.365 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.624 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.624 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.625 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.625 16:40:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.625 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.625 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.625 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.625 16:40:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.625 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.625 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.625 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.625 16:40:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.625 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.625 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.625 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.625 16:40:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.625 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.625 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.625 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.625 16:40:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.625 16:40:38 -- setup/common.sh@32 -- # continue 00:04:52.625 16:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:52.625 16:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:52.625 16:40:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:52.625 16:40:38 -- setup/common.sh@33 -- # echo 0 00:04:52.625 16:40:38 -- setup/common.sh@33 -- # return 0 00:04:52.625 16:40:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:52.625 16:40:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:52.625 16:40:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:52.625 16:40:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:52.625 16:40:38 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:52.625 node0=1024 expecting 1024 00:04:52.625 16:40:38 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:52.625 16:40:38 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:52.625 16:40:38 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:52.625 16:40:38 -- setup/hugepages.sh@202 -- # setup output 00:04:52.625 16:40:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:52.625 16:40:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:53.569 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:53.569 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:53.569 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:53.835 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:53.835 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:53.835 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:53.835 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:53.835 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:53.835 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:53.835 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:53.835 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:53.835 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:53.835 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:53.835 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:53.835 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:53.835 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:53.835 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:53.835 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:53.835 16:40:39 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:53.835 16:40:39 -- setup/hugepages.sh@89 -- # local node 00:04:53.835 16:40:39 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:53.835 16:40:39 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:53.835 16:40:39 -- setup/hugepages.sh@92 -- # local surp 00:04:53.835 16:40:39 -- setup/hugepages.sh@93 -- # local resv 00:04:53.835 16:40:39 -- setup/hugepages.sh@94 -- # local anon 00:04:53.835 16:40:39 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:53.835 16:40:39 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:53.835 16:40:39 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:53.835 16:40:39 -- setup/common.sh@18 -- # local node= 00:04:53.835 16:40:39 -- setup/common.sh@19 -- # local var val 00:04:53.835 16:40:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.835 16:40:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.835 16:40:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.835 16:40:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.835 16:40:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.835 16:40:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44082412 kB' 'MemAvailable: 47830664 kB' 'Buffers: 2708 kB' 'Cached: 11940088 kB' 'SwapCached: 0 kB' 'Active: 8639704 kB' 'Inactive: 3752664 kB' 'Active(anon): 8246648 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452820 kB' 'Mapped: 164052 kB' 'Shmem: 7797076 kB' 'KReclaimable: 192708 kB' 'Slab: 669208 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476500 kB' 'KernelStack: 12848 kB' 'PageTables: 7204 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9293888 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198552 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.835 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.835 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.836 16:40:39 -- setup/common.sh@33 -- # echo 0 00:04:53.836 16:40:39 -- setup/common.sh@33 -- # return 0 00:04:53.836 16:40:39 -- setup/hugepages.sh@97 -- # anon=0 00:04:53.836 16:40:39 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:53.836 16:40:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:53.836 16:40:39 -- setup/common.sh@18 -- # local node= 00:04:53.836 16:40:39 -- setup/common.sh@19 -- # local var val 00:04:53.836 16:40:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.836 16:40:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.836 16:40:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.836 16:40:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.836 16:40:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.836 16:40:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44082316 kB' 'MemAvailable: 47830568 kB' 'Buffers: 2708 kB' 'Cached: 11940092 kB' 'SwapCached: 0 kB' 'Active: 8640192 kB' 'Inactive: 3752664 kB' 'Active(anon): 8247136 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453280 kB' 'Mapped: 164412 kB' 'Shmem: 7797080 kB' 'KReclaimable: 192708 kB' 'Slab: 669208 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476500 kB' 'KernelStack: 12880 kB' 'PageTables: 7304 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9294992 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198536 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.836 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.836 16:40:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.837 16:40:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.837 16:40:39 -- setup/common.sh@33 -- # echo 0 00:04:53.837 16:40:39 -- setup/common.sh@33 -- # return 0 00:04:53.837 16:40:39 -- setup/hugepages.sh@99 -- # surp=0 00:04:53.837 16:40:39 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:53.837 16:40:39 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:53.837 16:40:39 -- setup/common.sh@18 -- # local node= 00:04:53.837 16:40:39 -- setup/common.sh@19 -- # local var val 00:04:53.837 16:40:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.837 16:40:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.837 16:40:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.837 16:40:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.837 16:40:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.837 16:40:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.837 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44079408 kB' 'MemAvailable: 47827660 kB' 'Buffers: 2708 kB' 'Cached: 11940104 kB' 'SwapCached: 0 kB' 'Active: 8642988 kB' 'Inactive: 3752664 kB' 'Active(anon): 8249932 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 456088 kB' 'Mapped: 164364 kB' 'Shmem: 7797092 kB' 'KReclaimable: 192708 kB' 'Slab: 669208 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476500 kB' 'KernelStack: 12864 kB' 'PageTables: 7244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9298572 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198520 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.838 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.838 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.839 16:40:39 -- setup/common.sh@33 -- # echo 0 00:04:53.839 16:40:39 -- setup/common.sh@33 -- # return 0 00:04:53.839 16:40:39 -- setup/hugepages.sh@100 -- # resv=0 00:04:53.839 16:40:39 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:53.839 nr_hugepages=1024 00:04:53.839 16:40:39 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:53.839 resv_hugepages=0 00:04:53.839 16:40:39 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:53.839 surplus_hugepages=0 00:04:53.839 16:40:39 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:53.839 anon_hugepages=0 00:04:53.839 16:40:39 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:53.839 16:40:39 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:53.839 16:40:39 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:53.839 16:40:39 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:53.839 16:40:39 -- setup/common.sh@18 -- # local node= 00:04:53.839 16:40:39 -- setup/common.sh@19 -- # local var val 00:04:53.839 16:40:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.839 16:40:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.839 16:40:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.839 16:40:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.839 16:40:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.839 16:40:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 44075232 kB' 'MemAvailable: 47823484 kB' 'Buffers: 2708 kB' 'Cached: 11940116 kB' 'SwapCached: 0 kB' 'Active: 8645080 kB' 'Inactive: 3752664 kB' 'Active(anon): 8252024 kB' 'Inactive(anon): 0 kB' 'Active(file): 393056 kB' 'Inactive(file): 3752664 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458196 kB' 'Mapped: 164844 kB' 'Shmem: 7797104 kB' 'KReclaimable: 192708 kB' 'Slab: 669192 kB' 'SReclaimable: 192708 kB' 'SUnreclaim: 476484 kB' 'KernelStack: 12896 kB' 'PageTables: 7340 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 9300052 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198524 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1584732 kB' 'DirectMap2M: 8820736 kB' 'DirectMap1G: 59768832 kB' 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.839 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.839 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # continue 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.840 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.840 16:40:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.101 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.102 16:40:39 -- setup/common.sh@33 -- # echo 1024 00:04:54.102 16:40:39 -- setup/common.sh@33 -- # return 0 00:04:54.102 16:40:39 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:54.102 16:40:39 -- setup/hugepages.sh@112 -- # get_nodes 00:04:54.102 16:40:39 -- setup/hugepages.sh@27 -- # local node 00:04:54.102 16:40:39 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:54.102 16:40:39 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:54.102 16:40:39 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:54.102 16:40:39 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:54.102 16:40:39 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:54.102 16:40:39 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:54.102 16:40:39 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:54.102 16:40:39 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:54.102 16:40:39 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:54.102 16:40:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:54.102 16:40:39 -- setup/common.sh@18 -- # local node=0 00:04:54.102 16:40:39 -- setup/common.sh@19 -- # local var val 00:04:54.102 16:40:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:54.102 16:40:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:54.102 16:40:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:54.102 16:40:39 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:54.102 16:40:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:54.102 16:40:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 26606216 kB' 'MemUsed: 6268708 kB' 'SwapCached: 0 kB' 'Active: 2770584 kB' 'Inactive: 109492 kB' 'Active(anon): 2621200 kB' 'Inactive(anon): 0 kB' 'Active(file): 149384 kB' 'Inactive(file): 109492 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2678916 kB' 'Mapped: 59148 kB' 'AnonPages: 204372 kB' 'Shmem: 2420040 kB' 'KernelStack: 7816 kB' 'PageTables: 4224 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 120412 kB' 'Slab: 423292 kB' 'SReclaimable: 120412 kB' 'SUnreclaim: 302880 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.102 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.102 16:40:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # continue 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.103 16:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.103 16:40:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.103 16:40:39 -- setup/common.sh@33 -- # echo 0 00:04:54.103 16:40:39 -- setup/common.sh@33 -- # return 0 00:04:54.103 16:40:39 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:54.103 16:40:39 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:54.103 16:40:39 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:54.103 16:40:39 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:54.103 16:40:39 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:54.103 node0=1024 expecting 1024 00:04:54.103 16:40:39 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:54.103 00:04:54.103 real 0m2.983s 00:04:54.103 user 0m1.180s 00:04:54.103 sys 0m1.727s 00:04:54.103 16:40:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:54.103 16:40:39 -- common/autotest_common.sh@10 -- # set +x 00:04:54.103 ************************************ 00:04:54.103 END TEST no_shrink_alloc 00:04:54.103 ************************************ 00:04:54.103 16:40:39 -- setup/hugepages.sh@217 -- # clear_hp 00:04:54.103 16:40:39 -- setup/hugepages.sh@37 -- # local node hp 00:04:54.103 16:40:39 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:54.103 16:40:39 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:54.103 16:40:39 -- setup/hugepages.sh@41 -- # echo 0 00:04:54.103 16:40:39 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:54.103 16:40:39 -- setup/hugepages.sh@41 -- # echo 0 00:04:54.103 16:40:39 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:54.103 16:40:39 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:54.103 16:40:39 -- setup/hugepages.sh@41 -- # echo 0 00:04:54.103 16:40:39 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:54.103 16:40:39 -- setup/hugepages.sh@41 -- # echo 0 00:04:54.103 16:40:39 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:54.103 16:40:39 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:54.103 00:04:54.103 real 0m12.044s 00:04:54.103 user 0m4.566s 00:04:54.103 sys 0m6.366s 00:04:54.103 16:40:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:54.103 16:40:39 -- common/autotest_common.sh@10 -- # set +x 00:04:54.103 ************************************ 00:04:54.103 END TEST hugepages 00:04:54.103 ************************************ 00:04:54.103 16:40:39 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:54.103 16:40:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:54.103 16:40:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:54.103 16:40:39 -- common/autotest_common.sh@10 -- # set +x 00:04:54.103 ************************************ 00:04:54.103 START TEST driver 00:04:54.103 ************************************ 00:04:54.103 16:40:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:54.103 * Looking for test storage... 00:04:54.103 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:54.103 16:40:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:54.103 16:40:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:54.103 16:40:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:54.103 16:40:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:54.103 16:40:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:54.103 16:40:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:54.103 16:40:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:54.103 16:40:39 -- scripts/common.sh@335 -- # IFS=.-: 00:04:54.103 16:40:39 -- scripts/common.sh@335 -- # read -ra ver1 00:04:54.103 16:40:39 -- scripts/common.sh@336 -- # IFS=.-: 00:04:54.103 16:40:39 -- scripts/common.sh@336 -- # read -ra ver2 00:04:54.103 16:40:39 -- scripts/common.sh@337 -- # local 'op=<' 00:04:54.103 16:40:39 -- scripts/common.sh@339 -- # ver1_l=2 00:04:54.103 16:40:39 -- scripts/common.sh@340 -- # ver2_l=1 00:04:54.104 16:40:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:54.104 16:40:39 -- scripts/common.sh@343 -- # case "$op" in 00:04:54.104 16:40:39 -- scripts/common.sh@344 -- # : 1 00:04:54.104 16:40:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:54.104 16:40:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:54.104 16:40:39 -- scripts/common.sh@364 -- # decimal 1 00:04:54.104 16:40:39 -- scripts/common.sh@352 -- # local d=1 00:04:54.104 16:40:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:54.104 16:40:39 -- scripts/common.sh@354 -- # echo 1 00:04:54.104 16:40:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:54.104 16:40:39 -- scripts/common.sh@365 -- # decimal 2 00:04:54.104 16:40:39 -- scripts/common.sh@352 -- # local d=2 00:04:54.104 16:40:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:54.104 16:40:39 -- scripts/common.sh@354 -- # echo 2 00:04:54.104 16:40:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:54.104 16:40:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:54.104 16:40:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:54.104 16:40:39 -- scripts/common.sh@367 -- # return 0 00:04:54.104 16:40:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:54.104 16:40:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:54.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.104 --rc genhtml_branch_coverage=1 00:04:54.104 --rc genhtml_function_coverage=1 00:04:54.104 --rc genhtml_legend=1 00:04:54.104 --rc geninfo_all_blocks=1 00:04:54.104 --rc geninfo_unexecuted_blocks=1 00:04:54.104 00:04:54.104 ' 00:04:54.104 16:40:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:54.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.104 --rc genhtml_branch_coverage=1 00:04:54.104 --rc genhtml_function_coverage=1 00:04:54.104 --rc genhtml_legend=1 00:04:54.104 --rc geninfo_all_blocks=1 00:04:54.104 --rc geninfo_unexecuted_blocks=1 00:04:54.104 00:04:54.104 ' 00:04:54.104 16:40:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:54.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.104 --rc genhtml_branch_coverage=1 00:04:54.104 --rc genhtml_function_coverage=1 00:04:54.104 --rc genhtml_legend=1 00:04:54.104 --rc geninfo_all_blocks=1 00:04:54.104 --rc geninfo_unexecuted_blocks=1 00:04:54.104 00:04:54.104 ' 00:04:54.104 16:40:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:54.104 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.104 --rc genhtml_branch_coverage=1 00:04:54.104 --rc genhtml_function_coverage=1 00:04:54.104 --rc genhtml_legend=1 00:04:54.104 --rc geninfo_all_blocks=1 00:04:54.104 --rc geninfo_unexecuted_blocks=1 00:04:54.104 00:04:54.104 ' 00:04:54.104 16:40:39 -- setup/driver.sh@68 -- # setup reset 00:04:54.104 16:40:39 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:54.104 16:40:39 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:57.419 16:40:42 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:57.419 16:40:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:57.419 16:40:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:57.419 16:40:42 -- common/autotest_common.sh@10 -- # set +x 00:04:57.419 ************************************ 00:04:57.419 START TEST guess_driver 00:04:57.419 ************************************ 00:04:57.419 16:40:42 -- common/autotest_common.sh@1114 -- # guess_driver 00:04:57.419 16:40:42 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:57.419 16:40:42 -- setup/driver.sh@47 -- # local fail=0 00:04:57.419 16:40:42 -- setup/driver.sh@49 -- # pick_driver 00:04:57.419 16:40:42 -- setup/driver.sh@36 -- # vfio 00:04:57.419 16:40:42 -- setup/driver.sh@21 -- # local iommu_grups 00:04:57.419 16:40:42 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:57.419 16:40:42 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:57.419 16:40:42 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:57.419 16:40:42 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:57.419 16:40:42 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:57.419 16:40:42 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:57.419 16:40:42 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:57.419 16:40:42 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:57.419 16:40:42 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:57.419 16:40:42 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:57.419 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:57.419 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:57.419 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:57.419 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:57.419 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:57.419 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:57.419 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:57.419 16:40:42 -- setup/driver.sh@30 -- # return 0 00:04:57.419 16:40:42 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:57.419 16:40:42 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:57.419 16:40:42 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:57.419 16:40:42 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:57.419 Looking for driver=vfio-pci 00:04:57.419 16:40:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:57.419 16:40:42 -- setup/driver.sh@45 -- # setup output config 00:04:57.419 16:40:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:57.419 16:40:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:58.034 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.034 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.034 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.034 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.034 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.034 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.034 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.034 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.034 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.034 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.034 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.034 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.034 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.034 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.034 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.294 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.294 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.294 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.294 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.294 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.294 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.294 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.294 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.294 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.294 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.294 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.294 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.294 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.294 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.294 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.294 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.294 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.294 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.294 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.294 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.294 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.294 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.294 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.294 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.294 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.294 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.294 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.294 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.294 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.294 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.294 16:40:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.294 16:40:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.294 16:40:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:59.236 16:40:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:59.236 16:40:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:59.236 16:40:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:59.236 16:40:44 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:59.236 16:40:44 -- setup/driver.sh@65 -- # setup reset 00:04:59.236 16:40:44 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:59.236 16:40:44 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:02.530 00:05:02.531 real 0m5.139s 00:05:02.531 user 0m1.219s 00:05:02.531 sys 0m2.059s 00:05:02.531 16:40:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:02.531 16:40:47 -- common/autotest_common.sh@10 -- # set +x 00:05:02.531 ************************************ 00:05:02.531 END TEST guess_driver 00:05:02.531 ************************************ 00:05:02.531 00:05:02.531 real 0m7.916s 00:05:02.531 user 0m1.920s 00:05:02.531 sys 0m3.168s 00:05:02.531 16:40:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:02.531 16:40:47 -- common/autotest_common.sh@10 -- # set +x 00:05:02.531 ************************************ 00:05:02.531 END TEST driver 00:05:02.531 ************************************ 00:05:02.531 16:40:47 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:02.531 16:40:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:02.531 16:40:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:02.531 16:40:47 -- common/autotest_common.sh@10 -- # set +x 00:05:02.531 ************************************ 00:05:02.531 START TEST devices 00:05:02.531 ************************************ 00:05:02.531 16:40:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:02.531 * Looking for test storage... 00:05:02.531 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:02.531 16:40:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:02.531 16:40:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:02.531 16:40:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:02.531 16:40:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:02.531 16:40:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:02.531 16:40:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:02.531 16:40:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:02.531 16:40:47 -- scripts/common.sh@335 -- # IFS=.-: 00:05:02.531 16:40:47 -- scripts/common.sh@335 -- # read -ra ver1 00:05:02.531 16:40:47 -- scripts/common.sh@336 -- # IFS=.-: 00:05:02.531 16:40:47 -- scripts/common.sh@336 -- # read -ra ver2 00:05:02.531 16:40:47 -- scripts/common.sh@337 -- # local 'op=<' 00:05:02.531 16:40:47 -- scripts/common.sh@339 -- # ver1_l=2 00:05:02.531 16:40:47 -- scripts/common.sh@340 -- # ver2_l=1 00:05:02.531 16:40:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:02.531 16:40:47 -- scripts/common.sh@343 -- # case "$op" in 00:05:02.531 16:40:47 -- scripts/common.sh@344 -- # : 1 00:05:02.531 16:40:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:02.531 16:40:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:02.531 16:40:47 -- scripts/common.sh@364 -- # decimal 1 00:05:02.531 16:40:47 -- scripts/common.sh@352 -- # local d=1 00:05:02.531 16:40:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:02.531 16:40:47 -- scripts/common.sh@354 -- # echo 1 00:05:02.531 16:40:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:02.531 16:40:47 -- scripts/common.sh@365 -- # decimal 2 00:05:02.531 16:40:47 -- scripts/common.sh@352 -- # local d=2 00:05:02.531 16:40:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:02.531 16:40:47 -- scripts/common.sh@354 -- # echo 2 00:05:02.531 16:40:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:02.531 16:40:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:02.531 16:40:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:02.531 16:40:47 -- scripts/common.sh@367 -- # return 0 00:05:02.531 16:40:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:02.531 16:40:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:02.531 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.531 --rc genhtml_branch_coverage=1 00:05:02.531 --rc genhtml_function_coverage=1 00:05:02.531 --rc genhtml_legend=1 00:05:02.531 --rc geninfo_all_blocks=1 00:05:02.531 --rc geninfo_unexecuted_blocks=1 00:05:02.531 00:05:02.531 ' 00:05:02.531 16:40:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:02.531 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.531 --rc genhtml_branch_coverage=1 00:05:02.531 --rc genhtml_function_coverage=1 00:05:02.531 --rc genhtml_legend=1 00:05:02.531 --rc geninfo_all_blocks=1 00:05:02.531 --rc geninfo_unexecuted_blocks=1 00:05:02.531 00:05:02.531 ' 00:05:02.531 16:40:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:02.531 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.531 --rc genhtml_branch_coverage=1 00:05:02.531 --rc genhtml_function_coverage=1 00:05:02.531 --rc genhtml_legend=1 00:05:02.531 --rc geninfo_all_blocks=1 00:05:02.531 --rc geninfo_unexecuted_blocks=1 00:05:02.531 00:05:02.531 ' 00:05:02.531 16:40:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:02.531 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.531 --rc genhtml_branch_coverage=1 00:05:02.531 --rc genhtml_function_coverage=1 00:05:02.531 --rc genhtml_legend=1 00:05:02.531 --rc geninfo_all_blocks=1 00:05:02.531 --rc geninfo_unexecuted_blocks=1 00:05:02.531 00:05:02.531 ' 00:05:02.531 16:40:47 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:05:02.531 16:40:47 -- setup/devices.sh@192 -- # setup reset 00:05:02.531 16:40:47 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:02.531 16:40:47 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:03.912 16:40:49 -- setup/devices.sh@194 -- # get_zoned_devs 00:05:03.912 16:40:49 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:05:03.912 16:40:49 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:05:03.912 16:40:49 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:05:03.912 16:40:49 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:05:03.912 16:40:49 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:05:03.912 16:40:49 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:05:03.912 16:40:49 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:05:03.912 16:40:49 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:05:03.912 16:40:49 -- setup/devices.sh@196 -- # blocks=() 00:05:03.912 16:40:49 -- setup/devices.sh@196 -- # declare -a blocks 00:05:03.912 16:40:49 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:05:03.912 16:40:49 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:05:03.912 16:40:49 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:05:03.912 16:40:49 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:05:03.912 16:40:49 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:05:03.912 16:40:49 -- setup/devices.sh@201 -- # ctrl=nvme0 00:05:03.912 16:40:49 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:05:03.912 16:40:49 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:05:03.912 16:40:49 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:05:03.912 16:40:49 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:05:03.912 16:40:49 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:05:03.912 No valid GPT data, bailing 00:05:03.912 16:40:49 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:05:03.912 16:40:49 -- scripts/common.sh@393 -- # pt= 00:05:03.912 16:40:49 -- scripts/common.sh@394 -- # return 1 00:05:03.912 16:40:49 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:05:03.912 16:40:49 -- setup/common.sh@76 -- # local dev=nvme0n1 00:05:03.912 16:40:49 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:05:03.912 16:40:49 -- setup/common.sh@80 -- # echo 1000204886016 00:05:03.912 16:40:49 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:05:03.912 16:40:49 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:05:03.912 16:40:49 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:05:03.912 16:40:49 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:05:03.912 16:40:49 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:05:03.912 16:40:49 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:05:03.912 16:40:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:03.912 16:40:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:03.912 16:40:49 -- common/autotest_common.sh@10 -- # set +x 00:05:03.912 ************************************ 00:05:03.912 START TEST nvme_mount 00:05:03.912 ************************************ 00:05:03.912 16:40:49 -- common/autotest_common.sh@1114 -- # nvme_mount 00:05:03.912 16:40:49 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:05:03.912 16:40:49 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:05:03.912 16:40:49 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:03.912 16:40:49 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:03.912 16:40:49 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:05:03.912 16:40:49 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:03.912 16:40:49 -- setup/common.sh@40 -- # local part_no=1 00:05:03.912 16:40:49 -- setup/common.sh@41 -- # local size=1073741824 00:05:03.912 16:40:49 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:03.912 16:40:49 -- setup/common.sh@44 -- # parts=() 00:05:03.912 16:40:49 -- setup/common.sh@44 -- # local parts 00:05:03.912 16:40:49 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:03.912 16:40:49 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:03.912 16:40:49 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:03.912 16:40:49 -- setup/common.sh@46 -- # (( part++ )) 00:05:03.912 16:40:49 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:03.913 16:40:49 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:03.913 16:40:49 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:03.913 16:40:49 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:05:04.853 Creating new GPT entries in memory. 00:05:04.853 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:04.853 other utilities. 00:05:04.853 16:40:50 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:04.853 16:40:50 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:04.853 16:40:50 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:04.853 16:40:50 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:04.853 16:40:50 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:05.793 Creating new GPT entries in memory. 00:05:05.793 The operation has completed successfully. 00:05:05.793 16:40:51 -- setup/common.sh@57 -- # (( part++ )) 00:05:05.793 16:40:51 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:05.793 16:40:51 -- setup/common.sh@62 -- # wait 1063707 00:05:05.793 16:40:51 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:05.793 16:40:51 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:05:05.793 16:40:51 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:05.793 16:40:51 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:05:05.793 16:40:51 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:05:05.793 16:40:51 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:06.052 16:40:51 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:06.052 16:40:51 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:06.052 16:40:51 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:05:06.052 16:40:51 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:06.052 16:40:51 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:06.052 16:40:51 -- setup/devices.sh@53 -- # local found=0 00:05:06.052 16:40:51 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:06.052 16:40:51 -- setup/devices.sh@56 -- # : 00:05:06.052 16:40:51 -- setup/devices.sh@59 -- # local pci status 00:05:06.052 16:40:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.052 16:40:51 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:06.052 16:40:51 -- setup/devices.sh@47 -- # setup output config 00:05:06.052 16:40:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:06.052 16:40:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:06.987 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.987 16:40:52 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:05:06.987 16:40:52 -- setup/devices.sh@63 -- # found=1 00:05:06.987 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.987 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.987 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.987 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.987 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.987 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.987 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.987 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.987 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.987 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.987 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.987 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.987 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.987 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.987 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.987 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.987 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.987 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.987 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.987 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.987 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.987 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.987 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.245 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.245 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.245 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.245 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.245 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.245 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.245 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.245 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.245 16:40:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.245 16:40:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.245 16:40:52 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:07.246 16:40:52 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:07.246 16:40:52 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.246 16:40:52 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:07.246 16:40:52 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:07.246 16:40:52 -- setup/devices.sh@110 -- # cleanup_nvme 00:05:07.246 16:40:52 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.246 16:40:52 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.246 16:40:52 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:07.246 16:40:52 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:07.246 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:07.246 16:40:52 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:07.246 16:40:52 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:07.504 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:07.504 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:07.504 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:07.504 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:07.504 16:40:53 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:05:07.504 16:40:53 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:05:07.504 16:40:53 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.504 16:40:53 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:05:07.504 16:40:53 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:05:07.762 16:40:53 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.762 16:40:53 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:07.762 16:40:53 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:07.762 16:40:53 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:05:07.762 16:40:53 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.762 16:40:53 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:07.762 16:40:53 -- setup/devices.sh@53 -- # local found=0 00:05:07.762 16:40:53 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:07.762 16:40:53 -- setup/devices.sh@56 -- # : 00:05:07.762 16:40:53 -- setup/devices.sh@59 -- # local pci status 00:05:07.762 16:40:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.762 16:40:53 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:07.762 16:40:53 -- setup/devices.sh@47 -- # setup output config 00:05:07.762 16:40:53 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:07.762 16:40:53 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:08.700 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:05:08.959 16:40:54 -- setup/devices.sh@63 -- # found=1 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:08.959 16:40:54 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:08.959 16:40:54 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:08.959 16:40:54 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:08.959 16:40:54 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:08.959 16:40:54 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:08.959 16:40:54 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:05:08.959 16:40:54 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:08.959 16:40:54 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:05:08.959 16:40:54 -- setup/devices.sh@50 -- # local mount_point= 00:05:08.959 16:40:54 -- setup/devices.sh@51 -- # local test_file= 00:05:08.959 16:40:54 -- setup/devices.sh@53 -- # local found=0 00:05:08.959 16:40:54 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:08.959 16:40:54 -- setup/devices.sh@59 -- # local pci status 00:05:08.959 16:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.959 16:40:54 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:08.959 16:40:54 -- setup/devices.sh@47 -- # setup output config 00:05:08.959 16:40:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:08.959 16:40:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:10.341 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.341 16:40:55 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:10.341 16:40:55 -- setup/devices.sh@63 -- # found=1 00:05:10.341 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.341 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.341 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.341 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.341 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.341 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.341 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.341 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.341 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.341 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.341 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.341 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.341 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.341 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.341 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.341 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.341 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.341 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.341 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.341 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.341 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.341 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.341 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.342 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.342 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.342 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.342 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.342 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.342 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.342 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.342 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.342 16:40:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.342 16:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.600 16:40:56 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:10.600 16:40:56 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:10.600 16:40:56 -- setup/devices.sh@68 -- # return 0 00:05:10.600 16:40:56 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:10.600 16:40:56 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:10.600 16:40:56 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:10.600 16:40:56 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:10.600 16:40:56 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:10.600 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:10.600 00:05:10.600 real 0m6.772s 00:05:10.600 user 0m1.554s 00:05:10.600 sys 0m2.798s 00:05:10.600 16:40:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:10.600 16:40:56 -- common/autotest_common.sh@10 -- # set +x 00:05:10.600 ************************************ 00:05:10.600 END TEST nvme_mount 00:05:10.600 ************************************ 00:05:10.600 16:40:56 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:10.600 16:40:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:10.600 16:40:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.600 16:40:56 -- common/autotest_common.sh@10 -- # set +x 00:05:10.600 ************************************ 00:05:10.600 START TEST dm_mount 00:05:10.600 ************************************ 00:05:10.600 16:40:56 -- common/autotest_common.sh@1114 -- # dm_mount 00:05:10.600 16:40:56 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:10.600 16:40:56 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:10.600 16:40:56 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:10.600 16:40:56 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:10.600 16:40:56 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:10.600 16:40:56 -- setup/common.sh@40 -- # local part_no=2 00:05:10.600 16:40:56 -- setup/common.sh@41 -- # local size=1073741824 00:05:10.600 16:40:56 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:10.600 16:40:56 -- setup/common.sh@44 -- # parts=() 00:05:10.600 16:40:56 -- setup/common.sh@44 -- # local parts 00:05:10.600 16:40:56 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:10.600 16:40:56 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:10.600 16:40:56 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:10.600 16:40:56 -- setup/common.sh@46 -- # (( part++ )) 00:05:10.600 16:40:56 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:10.600 16:40:56 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:10.600 16:40:56 -- setup/common.sh@46 -- # (( part++ )) 00:05:10.600 16:40:56 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:10.600 16:40:56 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:10.600 16:40:56 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:10.600 16:40:56 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:11.539 Creating new GPT entries in memory. 00:05:11.539 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:11.539 other utilities. 00:05:11.539 16:40:57 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:11.539 16:40:57 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:11.539 16:40:57 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:11.539 16:40:57 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:11.539 16:40:57 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:12.473 Creating new GPT entries in memory. 00:05:12.474 The operation has completed successfully. 00:05:12.474 16:40:58 -- setup/common.sh@57 -- # (( part++ )) 00:05:12.474 16:40:58 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:12.474 16:40:58 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:12.474 16:40:58 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:12.474 16:40:58 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:13.855 The operation has completed successfully. 00:05:13.855 16:40:59 -- setup/common.sh@57 -- # (( part++ )) 00:05:13.855 16:40:59 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:13.855 16:40:59 -- setup/common.sh@62 -- # wait 1066120 00:05:13.855 16:40:59 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:13.855 16:40:59 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:13.855 16:40:59 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:13.855 16:40:59 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:13.855 16:40:59 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:13.855 16:40:59 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:13.855 16:40:59 -- setup/devices.sh@161 -- # break 00:05:13.855 16:40:59 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:13.855 16:40:59 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:13.855 16:40:59 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:13.855 16:40:59 -- setup/devices.sh@166 -- # dm=dm-0 00:05:13.855 16:40:59 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:13.855 16:40:59 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:13.855 16:40:59 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:13.855 16:40:59 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:05:13.855 16:40:59 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:13.855 16:40:59 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:13.855 16:40:59 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:13.855 16:40:59 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:13.855 16:40:59 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:13.855 16:40:59 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:13.855 16:40:59 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:13.855 16:40:59 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:13.855 16:40:59 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:13.855 16:40:59 -- setup/devices.sh@53 -- # local found=0 00:05:13.855 16:40:59 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:13.855 16:40:59 -- setup/devices.sh@56 -- # : 00:05:13.855 16:40:59 -- setup/devices.sh@59 -- # local pci status 00:05:13.855 16:40:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.855 16:40:59 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:13.855 16:40:59 -- setup/devices.sh@47 -- # setup output config 00:05:13.855 16:40:59 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:13.856 16:40:59 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:14.793 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.793 16:41:00 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:14.793 16:41:00 -- setup/devices.sh@63 -- # found=1 00:05:14.793 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.793 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.793 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.793 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.793 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.793 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.793 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.793 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.793 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.793 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.793 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.793 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.793 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.793 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.793 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.793 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.793 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.793 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.793 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.793 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.793 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.793 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.793 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.793 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:14.793 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.053 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.053 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.053 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.053 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.053 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.053 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.053 16:41:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.053 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.053 16:41:00 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:15.053 16:41:00 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:15.053 16:41:00 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:15.053 16:41:00 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:15.053 16:41:00 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:15.053 16:41:00 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:15.053 16:41:00 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:15.053 16:41:00 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:15.053 16:41:00 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:15.053 16:41:00 -- setup/devices.sh@50 -- # local mount_point= 00:05:15.053 16:41:00 -- setup/devices.sh@51 -- # local test_file= 00:05:15.053 16:41:00 -- setup/devices.sh@53 -- # local found=0 00:05:15.053 16:41:00 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:15.053 16:41:00 -- setup/devices.sh@59 -- # local pci status 00:05:15.053 16:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.053 16:41:00 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:15.053 16:41:00 -- setup/devices.sh@47 -- # setup output config 00:05:15.053 16:41:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:15.053 16:41:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:16.431 16:41:01 -- setup/devices.sh@63 -- # found=1 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.431 16:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.431 16:41:02 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:16.431 16:41:02 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:16.431 16:41:02 -- setup/devices.sh@68 -- # return 0 00:05:16.431 16:41:02 -- setup/devices.sh@187 -- # cleanup_dm 00:05:16.431 16:41:02 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:16.431 16:41:02 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:16.431 16:41:02 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:16.431 16:41:02 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:16.431 16:41:02 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:16.431 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:16.431 16:41:02 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:16.431 16:41:02 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:16.431 00:05:16.431 real 0m5.990s 00:05:16.431 user 0m1.027s 00:05:16.431 sys 0m1.817s 00:05:16.431 16:41:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:16.431 16:41:02 -- common/autotest_common.sh@10 -- # set +x 00:05:16.431 ************************************ 00:05:16.431 END TEST dm_mount 00:05:16.431 ************************************ 00:05:16.691 16:41:02 -- setup/devices.sh@1 -- # cleanup 00:05:16.691 16:41:02 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:16.691 16:41:02 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:16.691 16:41:02 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:16.691 16:41:02 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:16.691 16:41:02 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:16.691 16:41:02 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:16.951 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:16.951 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:16.951 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:16.951 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:16.951 16:41:02 -- setup/devices.sh@12 -- # cleanup_dm 00:05:16.951 16:41:02 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:16.951 16:41:02 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:16.951 16:41:02 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:16.951 16:41:02 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:16.951 16:41:02 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:16.951 16:41:02 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:16.951 00:05:16.951 real 0m14.868s 00:05:16.951 user 0m3.327s 00:05:16.951 sys 0m5.748s 00:05:16.951 16:41:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:16.951 16:41:02 -- common/autotest_common.sh@10 -- # set +x 00:05:16.951 ************************************ 00:05:16.951 END TEST devices 00:05:16.951 ************************************ 00:05:16.951 00:05:16.951 real 0m46.224s 00:05:16.951 user 0m13.348s 00:05:16.951 sys 0m21.218s 00:05:16.951 16:41:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:16.951 16:41:02 -- common/autotest_common.sh@10 -- # set +x 00:05:16.951 ************************************ 00:05:16.951 END TEST setup.sh 00:05:16.951 ************************************ 00:05:16.951 16:41:02 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:18.326 Hugepages 00:05:18.326 node hugesize free / total 00:05:18.326 node0 1048576kB 0 / 0 00:05:18.326 node0 2048kB 2048 / 2048 00:05:18.326 node1 1048576kB 0 / 0 00:05:18.326 node1 2048kB 0 / 0 00:05:18.326 00:05:18.326 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:18.326 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:18.326 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:18.326 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:18.326 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:18.326 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:18.326 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:18.326 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:18.326 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:18.326 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:18.326 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:18.326 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:18.326 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:18.326 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:18.326 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:18.326 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:18.326 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:18.326 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:18.326 16:41:03 -- spdk/autotest.sh@128 -- # uname -s 00:05:18.326 16:41:03 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:05:18.326 16:41:03 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:05:18.326 16:41:03 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:19.260 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:19.260 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:19.260 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:19.519 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:19.519 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:19.519 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:19.519 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:19.519 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:19.519 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:19.519 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:19.519 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:19.519 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:19.519 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:19.519 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:19.519 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:19.519 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:20.458 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:20.458 16:41:06 -- common/autotest_common.sh@1527 -- # sleep 1 00:05:21.835 16:41:07 -- common/autotest_common.sh@1528 -- # bdfs=() 00:05:21.835 16:41:07 -- common/autotest_common.sh@1528 -- # local bdfs 00:05:21.835 16:41:07 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:05:21.835 16:41:07 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:05:21.835 16:41:07 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:21.835 16:41:07 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:21.835 16:41:07 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:21.835 16:41:07 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:21.835 16:41:07 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:21.835 16:41:07 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:21.835 16:41:07 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:21.835 16:41:07 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:22.770 Waiting for block devices as requested 00:05:22.770 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:23.029 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:23.029 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:23.288 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:23.288 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:23.288 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:23.288 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:23.546 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:23.546 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:23.546 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:23.804 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:23.804 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:23.804 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:23.804 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:24.063 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:24.063 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:24.063 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:24.323 16:41:09 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:05:24.323 16:41:09 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:24.323 16:41:09 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:05:24.323 16:41:09 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:05:24.323 16:41:09 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:24.323 16:41:09 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:24.323 16:41:09 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:24.323 16:41:09 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:05:24.323 16:41:09 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:05:24.323 16:41:09 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:05:24.323 16:41:09 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:24.323 16:41:09 -- common/autotest_common.sh@1540 -- # grep oacs 00:05:24.323 16:41:09 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:24.323 16:41:09 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:05:24.323 16:41:09 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:05:24.323 16:41:09 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:05:24.323 16:41:09 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:05:24.323 16:41:09 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:05:24.323 16:41:09 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:05:24.324 16:41:09 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:05:24.324 16:41:09 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:05:24.324 16:41:09 -- common/autotest_common.sh@1552 -- # continue 00:05:24.324 16:41:09 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:05:24.324 16:41:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:24.324 16:41:09 -- common/autotest_common.sh@10 -- # set +x 00:05:24.324 16:41:09 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:05:24.324 16:41:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:24.324 16:41:09 -- common/autotest_common.sh@10 -- # set +x 00:05:24.324 16:41:09 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:25.702 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:25.702 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:25.702 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:25.702 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:25.702 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:25.702 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:25.702 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:25.702 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:25.702 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:25.702 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:25.702 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:25.702 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:25.702 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:25.702 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:25.702 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:25.702 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:26.640 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:26.640 16:41:12 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:05:26.640 16:41:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:26.640 16:41:12 -- common/autotest_common.sh@10 -- # set +x 00:05:26.899 16:41:12 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:05:26.899 16:41:12 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:05:26.899 16:41:12 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:05:26.899 16:41:12 -- common/autotest_common.sh@1572 -- # bdfs=() 00:05:26.899 16:41:12 -- common/autotest_common.sh@1572 -- # local bdfs 00:05:26.899 16:41:12 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:05:26.899 16:41:12 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:26.899 16:41:12 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:26.899 16:41:12 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:26.899 16:41:12 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:26.899 16:41:12 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:26.899 16:41:12 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:26.899 16:41:12 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:26.899 16:41:12 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:05:26.899 16:41:12 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:26.899 16:41:12 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:05:26.899 16:41:12 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:26.899 16:41:12 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:05:26.899 16:41:12 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:05:26.899 16:41:12 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:05:26.899 16:41:12 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=1071540 00:05:26.899 16:41:12 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:26.899 16:41:12 -- common/autotest_common.sh@1593 -- # waitforlisten 1071540 00:05:26.899 16:41:12 -- common/autotest_common.sh@829 -- # '[' -z 1071540 ']' 00:05:26.899 16:41:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:26.899 16:41:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:26.899 16:41:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:26.899 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:26.899 16:41:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:26.899 16:41:12 -- common/autotest_common.sh@10 -- # set +x 00:05:26.899 [2024-11-16 16:41:12.541556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:26.899 [2024-11-16 16:41:12.541657] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1071540 ] 00:05:26.899 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.899 [2024-11-16 16:41:12.600035] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.158 [2024-11-16 16:41:12.689331] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:27.158 [2024-11-16 16:41:12.689501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:28.094 16:41:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:28.094 16:41:13 -- common/autotest_common.sh@862 -- # return 0 00:05:28.094 16:41:13 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:05:28.094 16:41:13 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:05:28.094 16:41:13 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:31.382 nvme0n1 00:05:31.382 16:41:16 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:31.382 [2024-11-16 16:41:16.819697] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:31.382 [2024-11-16 16:41:16.819750] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:31.382 request: 00:05:31.382 { 00:05:31.382 "nvme_ctrlr_name": "nvme0", 00:05:31.382 "password": "test", 00:05:31.382 "method": "bdev_nvme_opal_revert", 00:05:31.382 "req_id": 1 00:05:31.382 } 00:05:31.382 Got JSON-RPC error response 00:05:31.382 response: 00:05:31.382 { 00:05:31.382 "code": -32603, 00:05:31.382 "message": "Internal error" 00:05:31.382 } 00:05:31.382 16:41:16 -- common/autotest_common.sh@1599 -- # true 00:05:31.382 16:41:16 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:31.382 16:41:16 -- common/autotest_common.sh@1603 -- # killprocess 1071540 00:05:31.382 16:41:16 -- common/autotest_common.sh@936 -- # '[' -z 1071540 ']' 00:05:31.382 16:41:16 -- common/autotest_common.sh@940 -- # kill -0 1071540 00:05:31.382 16:41:16 -- common/autotest_common.sh@941 -- # uname 00:05:31.382 16:41:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:31.382 16:41:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1071540 00:05:31.382 16:41:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:31.382 16:41:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:31.382 16:41:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1071540' 00:05:31.382 killing process with pid 1071540 00:05:31.382 16:41:16 -- common/autotest_common.sh@955 -- # kill 1071540 00:05:31.382 16:41:16 -- common/autotest_common.sh@960 -- # wait 1071540 00:05:31.382 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.382 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.382 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.382 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.383 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.384 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:33.289 16:41:18 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:33.289 16:41:18 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:33.289 16:41:18 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:33.289 16:41:18 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:33.289 16:41:18 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:33.289 16:41:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:33.289 16:41:18 -- common/autotest_common.sh@10 -- # set +x 00:05:33.289 16:41:18 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:33.289 16:41:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.289 16:41:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.289 16:41:18 -- common/autotest_common.sh@10 -- # set +x 00:05:33.289 ************************************ 00:05:33.289 START TEST env 00:05:33.289 ************************************ 00:05:33.289 16:41:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:33.289 * Looking for test storage... 00:05:33.289 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:33.289 16:41:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:33.289 16:41:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:33.289 16:41:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:33.289 16:41:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:33.289 16:41:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:33.289 16:41:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:33.289 16:41:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:33.289 16:41:18 -- scripts/common.sh@335 -- # IFS=.-: 00:05:33.289 16:41:18 -- scripts/common.sh@335 -- # read -ra ver1 00:05:33.289 16:41:18 -- scripts/common.sh@336 -- # IFS=.-: 00:05:33.289 16:41:18 -- scripts/common.sh@336 -- # read -ra ver2 00:05:33.289 16:41:18 -- scripts/common.sh@337 -- # local 'op=<' 00:05:33.289 16:41:18 -- scripts/common.sh@339 -- # ver1_l=2 00:05:33.289 16:41:18 -- scripts/common.sh@340 -- # ver2_l=1 00:05:33.289 16:41:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:33.289 16:41:18 -- scripts/common.sh@343 -- # case "$op" in 00:05:33.289 16:41:18 -- scripts/common.sh@344 -- # : 1 00:05:33.289 16:41:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:33.289 16:41:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:33.289 16:41:18 -- scripts/common.sh@364 -- # decimal 1 00:05:33.289 16:41:18 -- scripts/common.sh@352 -- # local d=1 00:05:33.289 16:41:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:33.289 16:41:18 -- scripts/common.sh@354 -- # echo 1 00:05:33.289 16:41:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:33.289 16:41:18 -- scripts/common.sh@365 -- # decimal 2 00:05:33.289 16:41:18 -- scripts/common.sh@352 -- # local d=2 00:05:33.289 16:41:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:33.289 16:41:18 -- scripts/common.sh@354 -- # echo 2 00:05:33.289 16:41:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:33.289 16:41:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:33.289 16:41:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:33.289 16:41:18 -- scripts/common.sh@367 -- # return 0 00:05:33.289 16:41:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:33.289 16:41:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:33.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.289 --rc genhtml_branch_coverage=1 00:05:33.289 --rc genhtml_function_coverage=1 00:05:33.289 --rc genhtml_legend=1 00:05:33.289 --rc geninfo_all_blocks=1 00:05:33.289 --rc geninfo_unexecuted_blocks=1 00:05:33.289 00:05:33.289 ' 00:05:33.289 16:41:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:33.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.289 --rc genhtml_branch_coverage=1 00:05:33.289 --rc genhtml_function_coverage=1 00:05:33.289 --rc genhtml_legend=1 00:05:33.289 --rc geninfo_all_blocks=1 00:05:33.289 --rc geninfo_unexecuted_blocks=1 00:05:33.289 00:05:33.289 ' 00:05:33.289 16:41:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:33.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.289 --rc genhtml_branch_coverage=1 00:05:33.289 --rc genhtml_function_coverage=1 00:05:33.289 --rc genhtml_legend=1 00:05:33.289 --rc geninfo_all_blocks=1 00:05:33.289 --rc geninfo_unexecuted_blocks=1 00:05:33.289 00:05:33.289 ' 00:05:33.289 16:41:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:33.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.289 --rc genhtml_branch_coverage=1 00:05:33.289 --rc genhtml_function_coverage=1 00:05:33.289 --rc genhtml_legend=1 00:05:33.289 --rc geninfo_all_blocks=1 00:05:33.289 --rc geninfo_unexecuted_blocks=1 00:05:33.289 00:05:33.289 ' 00:05:33.289 16:41:18 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:33.289 16:41:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.289 16:41:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.289 16:41:18 -- common/autotest_common.sh@10 -- # set +x 00:05:33.289 ************************************ 00:05:33.289 START TEST env_memory 00:05:33.289 ************************************ 00:05:33.289 16:41:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:33.289 00:05:33.289 00:05:33.289 CUnit - A unit testing framework for C - Version 2.1-3 00:05:33.289 http://cunit.sourceforge.net/ 00:05:33.289 00:05:33.289 00:05:33.289 Suite: memory 00:05:33.290 Test: alloc and free memory map ...[2024-11-16 16:41:18.796224] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:33.290 passed 00:05:33.290 Test: mem map translation ...[2024-11-16 16:41:18.816851] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:33.290 [2024-11-16 16:41:18.816874] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:33.290 [2024-11-16 16:41:18.816937] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:33.290 [2024-11-16 16:41:18.816949] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:33.290 passed 00:05:33.290 Test: mem map registration ...[2024-11-16 16:41:18.857934] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:33.290 [2024-11-16 16:41:18.857959] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:33.290 passed 00:05:33.290 Test: mem map adjacent registrations ...passed 00:05:33.290 00:05:33.290 Run Summary: Type Total Ran Passed Failed Inactive 00:05:33.290 suites 1 1 n/a 0 0 00:05:33.290 tests 4 4 4 0 0 00:05:33.290 asserts 152 152 152 0 n/a 00:05:33.290 00:05:33.290 Elapsed time = 0.143 seconds 00:05:33.290 00:05:33.290 real 0m0.150s 00:05:33.290 user 0m0.142s 00:05:33.290 sys 0m0.008s 00:05:33.290 16:41:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.290 16:41:18 -- common/autotest_common.sh@10 -- # set +x 00:05:33.290 ************************************ 00:05:33.290 END TEST env_memory 00:05:33.290 ************************************ 00:05:33.290 16:41:18 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:33.290 16:41:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.290 16:41:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.290 16:41:18 -- common/autotest_common.sh@10 -- # set +x 00:05:33.290 ************************************ 00:05:33.290 START TEST env_vtophys 00:05:33.290 ************************************ 00:05:33.290 16:41:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:33.290 EAL: lib.eal log level changed from notice to debug 00:05:33.290 EAL: Detected lcore 0 as core 0 on socket 0 00:05:33.290 EAL: Detected lcore 1 as core 1 on socket 0 00:05:33.290 EAL: Detected lcore 2 as core 2 on socket 0 00:05:33.290 EAL: Detected lcore 3 as core 3 on socket 0 00:05:33.290 EAL: Detected lcore 4 as core 4 on socket 0 00:05:33.290 EAL: Detected lcore 5 as core 5 on socket 0 00:05:33.290 EAL: Detected lcore 6 as core 8 on socket 0 00:05:33.290 EAL: Detected lcore 7 as core 9 on socket 0 00:05:33.290 EAL: Detected lcore 8 as core 10 on socket 0 00:05:33.290 EAL: Detected lcore 9 as core 11 on socket 0 00:05:33.290 EAL: Detected lcore 10 as core 12 on socket 0 00:05:33.290 EAL: Detected lcore 11 as core 13 on socket 0 00:05:33.290 EAL: Detected lcore 12 as core 0 on socket 1 00:05:33.290 EAL: Detected lcore 13 as core 1 on socket 1 00:05:33.290 EAL: Detected lcore 14 as core 2 on socket 1 00:05:33.290 EAL: Detected lcore 15 as core 3 on socket 1 00:05:33.290 EAL: Detected lcore 16 as core 4 on socket 1 00:05:33.290 EAL: Detected lcore 17 as core 5 on socket 1 00:05:33.290 EAL: Detected lcore 18 as core 8 on socket 1 00:05:33.290 EAL: Detected lcore 19 as core 9 on socket 1 00:05:33.290 EAL: Detected lcore 20 as core 10 on socket 1 00:05:33.290 EAL: Detected lcore 21 as core 11 on socket 1 00:05:33.290 EAL: Detected lcore 22 as core 12 on socket 1 00:05:33.290 EAL: Detected lcore 23 as core 13 on socket 1 00:05:33.290 EAL: Detected lcore 24 as core 0 on socket 0 00:05:33.290 EAL: Detected lcore 25 as core 1 on socket 0 00:05:33.290 EAL: Detected lcore 26 as core 2 on socket 0 00:05:33.290 EAL: Detected lcore 27 as core 3 on socket 0 00:05:33.290 EAL: Detected lcore 28 as core 4 on socket 0 00:05:33.290 EAL: Detected lcore 29 as core 5 on socket 0 00:05:33.290 EAL: Detected lcore 30 as core 8 on socket 0 00:05:33.290 EAL: Detected lcore 31 as core 9 on socket 0 00:05:33.290 EAL: Detected lcore 32 as core 10 on socket 0 00:05:33.290 EAL: Detected lcore 33 as core 11 on socket 0 00:05:33.290 EAL: Detected lcore 34 as core 12 on socket 0 00:05:33.290 EAL: Detected lcore 35 as core 13 on socket 0 00:05:33.290 EAL: Detected lcore 36 as core 0 on socket 1 00:05:33.290 EAL: Detected lcore 37 as core 1 on socket 1 00:05:33.290 EAL: Detected lcore 38 as core 2 on socket 1 00:05:33.290 EAL: Detected lcore 39 as core 3 on socket 1 00:05:33.290 EAL: Detected lcore 40 as core 4 on socket 1 00:05:33.290 EAL: Detected lcore 41 as core 5 on socket 1 00:05:33.290 EAL: Detected lcore 42 as core 8 on socket 1 00:05:33.290 EAL: Detected lcore 43 as core 9 on socket 1 00:05:33.290 EAL: Detected lcore 44 as core 10 on socket 1 00:05:33.290 EAL: Detected lcore 45 as core 11 on socket 1 00:05:33.290 EAL: Detected lcore 46 as core 12 on socket 1 00:05:33.290 EAL: Detected lcore 47 as core 13 on socket 1 00:05:33.290 EAL: Maximum logical cores by configuration: 128 00:05:33.290 EAL: Detected CPU lcores: 48 00:05:33.290 EAL: Detected NUMA nodes: 2 00:05:33.290 EAL: Checking presence of .so 'librte_eal.so.23.0' 00:05:33.290 EAL: Detected shared linkage of DPDK 00:05:33.290 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23.0 00:05:33.290 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23.0 00:05:33.290 EAL: Registered [vdev] bus. 00:05:33.290 EAL: bus.vdev log level changed from disabled to notice 00:05:33.290 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23.0 00:05:33.290 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23.0 00:05:33.290 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:33.290 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:33.290 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:05:33.290 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:05:33.290 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:05:33.290 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:05:33.290 EAL: No shared files mode enabled, IPC will be disabled 00:05:33.290 EAL: No shared files mode enabled, IPC is disabled 00:05:33.290 EAL: Bus pci wants IOVA as 'DC' 00:05:33.291 EAL: Bus vdev wants IOVA as 'DC' 00:05:33.291 EAL: Buses did not request a specific IOVA mode. 00:05:33.291 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:33.291 EAL: Selected IOVA mode 'VA' 00:05:33.291 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.291 EAL: Probing VFIO support... 00:05:33.291 EAL: IOMMU type 1 (Type 1) is supported 00:05:33.291 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:33.291 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:33.291 EAL: VFIO support initialized 00:05:33.291 EAL: Ask a virtual area of 0x2e000 bytes 00:05:33.291 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:33.291 EAL: Setting up physically contiguous memory... 00:05:33.291 EAL: Setting maximum number of open files to 524288 00:05:33.291 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:33.291 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:33.291 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:33.291 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.291 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:33.291 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:33.291 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.291 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:33.291 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:33.291 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.291 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:33.291 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:33.291 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.291 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:33.291 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:33.291 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.291 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:33.291 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:33.291 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.291 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:33.291 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:33.291 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.291 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:33.291 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:33.291 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.291 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:33.291 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:33.291 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:33.291 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.291 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:33.291 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:33.291 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.291 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:33.291 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:33.291 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.291 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:33.291 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:33.291 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.291 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:33.291 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:33.291 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.291 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:33.291 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:33.291 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.291 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:33.291 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:33.291 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.291 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:33.291 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:33.291 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.291 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:33.291 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:33.291 EAL: Hugepages will be freed exactly as allocated. 00:05:33.291 EAL: No shared files mode enabled, IPC is disabled 00:05:33.291 EAL: No shared files mode enabled, IPC is disabled 00:05:33.291 EAL: TSC frequency is ~2700000 KHz 00:05:33.291 EAL: Main lcore 0 is ready (tid=7f2b7d870a00;cpuset=[0]) 00:05:33.291 EAL: Trying to obtain current memory policy. 00:05:33.291 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.291 EAL: Restoring previous memory policy: 0 00:05:33.291 EAL: request: mp_malloc_sync 00:05:33.291 EAL: No shared files mode enabled, IPC is disabled 00:05:33.291 EAL: Heap on socket 0 was expanded by 2MB 00:05:33.291 EAL: No shared files mode enabled, IPC is disabled 00:05:33.291 EAL: No shared files mode enabled, IPC is disabled 00:05:33.291 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:33.291 EAL: Mem event callback 'spdk:(nil)' registered 00:05:33.291 00:05:33.291 00:05:33.291 CUnit - A unit testing framework for C - Version 2.1-3 00:05:33.291 http://cunit.sourceforge.net/ 00:05:33.291 00:05:33.291 00:05:33.291 Suite: components_suite 00:05:33.291 Test: vtophys_malloc_test ...passed 00:05:33.291 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:33.291 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.291 EAL: Restoring previous memory policy: 4 00:05:33.291 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.291 EAL: request: mp_malloc_sync 00:05:33.291 EAL: No shared files mode enabled, IPC is disabled 00:05:33.291 EAL: Heap on socket 0 was expanded by 4MB 00:05:33.291 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.291 EAL: request: mp_malloc_sync 00:05:33.291 EAL: No shared files mode enabled, IPC is disabled 00:05:33.291 EAL: Heap on socket 0 was shrunk by 4MB 00:05:33.291 EAL: Trying to obtain current memory policy. 00:05:33.291 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.291 EAL: Restoring previous memory policy: 4 00:05:33.291 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.291 EAL: request: mp_malloc_sync 00:05:33.291 EAL: No shared files mode enabled, IPC is disabled 00:05:33.291 EAL: Heap on socket 0 was expanded by 6MB 00:05:33.291 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.291 EAL: request: mp_malloc_sync 00:05:33.291 EAL: No shared files mode enabled, IPC is disabled 00:05:33.291 EAL: Heap on socket 0 was shrunk by 6MB 00:05:33.291 EAL: Trying to obtain current memory policy. 00:05:33.291 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.291 EAL: Restoring previous memory policy: 4 00:05:33.291 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.291 EAL: request: mp_malloc_sync 00:05:33.291 EAL: No shared files mode enabled, IPC is disabled 00:05:33.291 EAL: Heap on socket 0 was expanded by 10MB 00:05:33.291 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.292 EAL: request: mp_malloc_sync 00:05:33.292 EAL: No shared files mode enabled, IPC is disabled 00:05:33.292 EAL: Heap on socket 0 was shrunk by 10MB 00:05:33.292 EAL: Trying to obtain current memory policy. 00:05:33.292 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.292 EAL: Restoring previous memory policy: 4 00:05:33.292 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.292 EAL: request: mp_malloc_sync 00:05:33.292 EAL: No shared files mode enabled, IPC is disabled 00:05:33.292 EAL: Heap on socket 0 was expanded by 18MB 00:05:33.292 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.292 EAL: request: mp_malloc_sync 00:05:33.292 EAL: No shared files mode enabled, IPC is disabled 00:05:33.292 EAL: Heap on socket 0 was shrunk by 18MB 00:05:33.292 EAL: Trying to obtain current memory policy. 00:05:33.292 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.292 EAL: Restoring previous memory policy: 4 00:05:33.292 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.292 EAL: request: mp_malloc_sync 00:05:33.292 EAL: No shared files mode enabled, IPC is disabled 00:05:33.292 EAL: Heap on socket 0 was expanded by 34MB 00:05:33.292 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.292 EAL: request: mp_malloc_sync 00:05:33.292 EAL: No shared files mode enabled, IPC is disabled 00:05:33.292 EAL: Heap on socket 0 was shrunk by 34MB 00:05:33.292 EAL: Trying to obtain current memory policy. 00:05:33.292 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.551 EAL: Restoring previous memory policy: 4 00:05:33.551 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.551 EAL: request: mp_malloc_sync 00:05:33.551 EAL: No shared files mode enabled, IPC is disabled 00:05:33.551 EAL: Heap on socket 0 was expanded by 66MB 00:05:33.551 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.551 EAL: request: mp_malloc_sync 00:05:33.551 EAL: No shared files mode enabled, IPC is disabled 00:05:33.551 EAL: Heap on socket 0 was shrunk by 66MB 00:05:33.551 EAL: Trying to obtain current memory policy. 00:05:33.551 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.551 EAL: Restoring previous memory policy: 4 00:05:33.551 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.551 EAL: request: mp_malloc_sync 00:05:33.551 EAL: No shared files mode enabled, IPC is disabled 00:05:33.551 EAL: Heap on socket 0 was expanded by 130MB 00:05:33.551 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.551 EAL: request: mp_malloc_sync 00:05:33.551 EAL: No shared files mode enabled, IPC is disabled 00:05:33.551 EAL: Heap on socket 0 was shrunk by 130MB 00:05:33.551 EAL: Trying to obtain current memory policy. 00:05:33.551 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.551 EAL: Restoring previous memory policy: 4 00:05:33.551 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.551 EAL: request: mp_malloc_sync 00:05:33.551 EAL: No shared files mode enabled, IPC is disabled 00:05:33.551 EAL: Heap on socket 0 was expanded by 258MB 00:05:33.551 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.847 EAL: request: mp_malloc_sync 00:05:33.847 EAL: No shared files mode enabled, IPC is disabled 00:05:33.848 EAL: Heap on socket 0 was shrunk by 258MB 00:05:33.848 EAL: Trying to obtain current memory policy. 00:05:33.848 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.848 EAL: Restoring previous memory policy: 4 00:05:33.848 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.848 EAL: request: mp_malloc_sync 00:05:33.848 EAL: No shared files mode enabled, IPC is disabled 00:05:33.848 EAL: Heap on socket 0 was expanded by 514MB 00:05:33.848 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.137 EAL: request: mp_malloc_sync 00:05:34.137 EAL: No shared files mode enabled, IPC is disabled 00:05:34.137 EAL: Heap on socket 0 was shrunk by 514MB 00:05:34.137 EAL: Trying to obtain current memory policy. 00:05:34.137 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:34.395 EAL: Restoring previous memory policy: 4 00:05:34.395 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.395 EAL: request: mp_malloc_sync 00:05:34.395 EAL: No shared files mode enabled, IPC is disabled 00:05:34.395 EAL: Heap on socket 0 was expanded by 1026MB 00:05:34.654 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.654 EAL: request: mp_malloc_sync 00:05:34.654 EAL: No shared files mode enabled, IPC is disabled 00:05:34.654 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:34.654 passed 00:05:34.654 00:05:34.654 Run Summary: Type Total Ran Passed Failed Inactive 00:05:34.654 suites 1 1 n/a 0 0 00:05:34.654 tests 2 2 2 0 0 00:05:34.654 asserts 497 497 497 0 n/a 00:05:34.654 00:05:34.654 Elapsed time = 1.318 seconds 00:05:34.654 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.654 EAL: request: mp_malloc_sync 00:05:34.654 EAL: No shared files mode enabled, IPC is disabled 00:05:34.654 EAL: Heap on socket 0 was shrunk by 2MB 00:05:34.654 EAL: No shared files mode enabled, IPC is disabled 00:05:34.654 EAL: No shared files mode enabled, IPC is disabled 00:05:34.654 EAL: No shared files mode enabled, IPC is disabled 00:05:34.654 00:05:34.654 real 0m1.435s 00:05:34.654 user 0m0.842s 00:05:34.654 sys 0m0.553s 00:05:34.654 16:41:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.654 16:41:20 -- common/autotest_common.sh@10 -- # set +x 00:05:34.654 ************************************ 00:05:34.654 END TEST env_vtophys 00:05:34.654 ************************************ 00:05:34.654 16:41:20 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:34.654 16:41:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.654 16:41:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.654 16:41:20 -- common/autotest_common.sh@10 -- # set +x 00:05:34.654 ************************************ 00:05:34.654 START TEST env_pci 00:05:34.654 ************************************ 00:05:34.654 16:41:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:34.914 00:05:34.914 00:05:34.914 CUnit - A unit testing framework for C - Version 2.1-3 00:05:34.914 http://cunit.sourceforge.net/ 00:05:34.914 00:05:34.914 00:05:34.914 Suite: pci 00:05:34.914 Test: pci_hook ...[2024-11-16 16:41:20.410077] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1072585 has claimed it 00:05:34.914 EAL: Cannot find device (10000:00:01.0) 00:05:34.914 EAL: Failed to attach device on primary process 00:05:34.914 passed 00:05:34.914 00:05:34.914 Run Summary: Type Total Ran Passed Failed Inactive 00:05:34.914 suites 1 1 n/a 0 0 00:05:34.914 tests 1 1 1 0 0 00:05:34.914 asserts 25 25 25 0 n/a 00:05:34.914 00:05:34.914 Elapsed time = 0.020 seconds 00:05:34.914 00:05:34.914 real 0m0.033s 00:05:34.914 user 0m0.010s 00:05:34.914 sys 0m0.023s 00:05:34.914 16:41:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.914 16:41:20 -- common/autotest_common.sh@10 -- # set +x 00:05:34.914 ************************************ 00:05:34.914 END TEST env_pci 00:05:34.914 ************************************ 00:05:34.914 16:41:20 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:34.914 16:41:20 -- env/env.sh@15 -- # uname 00:05:34.914 16:41:20 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:34.914 16:41:20 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:34.914 16:41:20 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:34.914 16:41:20 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:34.914 16:41:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.914 16:41:20 -- common/autotest_common.sh@10 -- # set +x 00:05:34.914 ************************************ 00:05:34.914 START TEST env_dpdk_post_init 00:05:34.914 ************************************ 00:05:34.914 16:41:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:34.914 EAL: Detected CPU lcores: 48 00:05:34.914 EAL: Detected NUMA nodes: 2 00:05:34.914 EAL: Detected shared linkage of DPDK 00:05:34.914 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:34.914 EAL: Selected IOVA mode 'VA' 00:05:34.914 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.914 EAL: VFIO support initialized 00:05:34.914 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:34.914 EAL: Using IOMMU type 1 (Type 1) 00:05:34.914 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:34.914 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:34.914 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:34.914 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:34.914 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:34.914 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:34.914 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:34.914 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:34.914 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:35.174 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:35.174 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:35.174 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:35.174 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:35.174 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:35.174 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:35.174 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:35.745 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:39.026 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:39.026 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:39.284 Starting DPDK initialization... 00:05:39.284 Starting SPDK post initialization... 00:05:39.284 SPDK NVMe probe 00:05:39.284 Attaching to 0000:88:00.0 00:05:39.284 Attached to 0000:88:00.0 00:05:39.284 Cleaning up... 00:05:39.284 00:05:39.284 real 0m4.393s 00:05:39.284 user 0m3.294s 00:05:39.284 sys 0m0.158s 00:05:39.284 16:41:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.284 16:41:24 -- common/autotest_common.sh@10 -- # set +x 00:05:39.284 ************************************ 00:05:39.285 END TEST env_dpdk_post_init 00:05:39.285 ************************************ 00:05:39.285 16:41:24 -- env/env.sh@26 -- # uname 00:05:39.285 16:41:24 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:39.285 16:41:24 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:39.285 16:41:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:39.285 16:41:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.285 16:41:24 -- common/autotest_common.sh@10 -- # set +x 00:05:39.285 ************************************ 00:05:39.285 START TEST env_mem_callbacks 00:05:39.285 ************************************ 00:05:39.285 16:41:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:39.285 EAL: Detected CPU lcores: 48 00:05:39.285 EAL: Detected NUMA nodes: 2 00:05:39.285 EAL: Detected shared linkage of DPDK 00:05:39.285 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:39.285 EAL: Selected IOVA mode 'VA' 00:05:39.285 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.285 EAL: VFIO support initialized 00:05:39.285 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:39.285 00:05:39.285 00:05:39.285 CUnit - A unit testing framework for C - Version 2.1-3 00:05:39.285 http://cunit.sourceforge.net/ 00:05:39.285 00:05:39.285 00:05:39.285 Suite: memory 00:05:39.285 Test: test ... 00:05:39.285 register 0x200000200000 2097152 00:05:39.285 malloc 3145728 00:05:39.285 register 0x200000400000 4194304 00:05:39.285 buf 0x200000500000 len 3145728 PASSED 00:05:39.285 malloc 64 00:05:39.285 buf 0x2000004fff40 len 64 PASSED 00:05:39.285 malloc 4194304 00:05:39.285 register 0x200000800000 6291456 00:05:39.285 buf 0x200000a00000 len 4194304 PASSED 00:05:39.285 free 0x200000500000 3145728 00:05:39.285 free 0x2000004fff40 64 00:05:39.285 unregister 0x200000400000 4194304 PASSED 00:05:39.285 free 0x200000a00000 4194304 00:05:39.285 unregister 0x200000800000 6291456 PASSED 00:05:39.285 malloc 8388608 00:05:39.285 register 0x200000400000 10485760 00:05:39.285 buf 0x200000600000 len 8388608 PASSED 00:05:39.285 free 0x200000600000 8388608 00:05:39.285 unregister 0x200000400000 10485760 PASSED 00:05:39.285 passed 00:05:39.285 00:05:39.285 Run Summary: Type Total Ran Passed Failed Inactive 00:05:39.285 suites 1 1 n/a 0 0 00:05:39.285 tests 1 1 1 0 0 00:05:39.285 asserts 15 15 15 0 n/a 00:05:39.285 00:05:39.285 Elapsed time = 0.004 seconds 00:05:39.285 00:05:39.285 real 0m0.045s 00:05:39.285 user 0m0.010s 00:05:39.285 sys 0m0.034s 00:05:39.285 16:41:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.285 16:41:24 -- common/autotest_common.sh@10 -- # set +x 00:05:39.285 ************************************ 00:05:39.285 END TEST env_mem_callbacks 00:05:39.285 ************************************ 00:05:39.285 00:05:39.285 real 0m6.338s 00:05:39.285 user 0m4.454s 00:05:39.285 sys 0m0.933s 00:05:39.285 16:41:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.285 16:41:24 -- common/autotest_common.sh@10 -- # set +x 00:05:39.285 ************************************ 00:05:39.285 END TEST env 00:05:39.285 ************************************ 00:05:39.285 16:41:24 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:39.285 16:41:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:39.285 16:41:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.285 16:41:24 -- common/autotest_common.sh@10 -- # set +x 00:05:39.285 ************************************ 00:05:39.285 START TEST rpc 00:05:39.285 ************************************ 00:05:39.285 16:41:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:39.285 * Looking for test storage... 00:05:39.285 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:39.285 16:41:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:39.285 16:41:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:39.285 16:41:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:39.543 16:41:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:39.543 16:41:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:39.543 16:41:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:39.543 16:41:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:39.543 16:41:25 -- scripts/common.sh@335 -- # IFS=.-: 00:05:39.543 16:41:25 -- scripts/common.sh@335 -- # read -ra ver1 00:05:39.543 16:41:25 -- scripts/common.sh@336 -- # IFS=.-: 00:05:39.543 16:41:25 -- scripts/common.sh@336 -- # read -ra ver2 00:05:39.543 16:41:25 -- scripts/common.sh@337 -- # local 'op=<' 00:05:39.543 16:41:25 -- scripts/common.sh@339 -- # ver1_l=2 00:05:39.543 16:41:25 -- scripts/common.sh@340 -- # ver2_l=1 00:05:39.543 16:41:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:39.543 16:41:25 -- scripts/common.sh@343 -- # case "$op" in 00:05:39.543 16:41:25 -- scripts/common.sh@344 -- # : 1 00:05:39.543 16:41:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:39.543 16:41:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:39.544 16:41:25 -- scripts/common.sh@364 -- # decimal 1 00:05:39.544 16:41:25 -- scripts/common.sh@352 -- # local d=1 00:05:39.544 16:41:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:39.544 16:41:25 -- scripts/common.sh@354 -- # echo 1 00:05:39.544 16:41:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:39.544 16:41:25 -- scripts/common.sh@365 -- # decimal 2 00:05:39.544 16:41:25 -- scripts/common.sh@352 -- # local d=2 00:05:39.544 16:41:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:39.544 16:41:25 -- scripts/common.sh@354 -- # echo 2 00:05:39.544 16:41:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:39.544 16:41:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:39.544 16:41:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:39.544 16:41:25 -- scripts/common.sh@367 -- # return 0 00:05:39.544 16:41:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:39.544 16:41:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:39.544 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:39.544 --rc genhtml_branch_coverage=1 00:05:39.544 --rc genhtml_function_coverage=1 00:05:39.544 --rc genhtml_legend=1 00:05:39.544 --rc geninfo_all_blocks=1 00:05:39.544 --rc geninfo_unexecuted_blocks=1 00:05:39.544 00:05:39.544 ' 00:05:39.544 16:41:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:39.544 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:39.544 --rc genhtml_branch_coverage=1 00:05:39.544 --rc genhtml_function_coverage=1 00:05:39.544 --rc genhtml_legend=1 00:05:39.544 --rc geninfo_all_blocks=1 00:05:39.544 --rc geninfo_unexecuted_blocks=1 00:05:39.544 00:05:39.544 ' 00:05:39.544 16:41:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:39.544 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:39.544 --rc genhtml_branch_coverage=1 00:05:39.544 --rc genhtml_function_coverage=1 00:05:39.544 --rc genhtml_legend=1 00:05:39.544 --rc geninfo_all_blocks=1 00:05:39.544 --rc geninfo_unexecuted_blocks=1 00:05:39.544 00:05:39.544 ' 00:05:39.544 16:41:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:39.544 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:39.544 --rc genhtml_branch_coverage=1 00:05:39.544 --rc genhtml_function_coverage=1 00:05:39.544 --rc genhtml_legend=1 00:05:39.544 --rc geninfo_all_blocks=1 00:05:39.544 --rc geninfo_unexecuted_blocks=1 00:05:39.544 00:05:39.544 ' 00:05:39.544 16:41:25 -- rpc/rpc.sh@65 -- # spdk_pid=1073257 00:05:39.544 16:41:25 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:39.544 16:41:25 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:39.544 16:41:25 -- rpc/rpc.sh@67 -- # waitforlisten 1073257 00:05:39.544 16:41:25 -- common/autotest_common.sh@829 -- # '[' -z 1073257 ']' 00:05:39.544 16:41:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:39.544 16:41:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:39.544 16:41:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:39.544 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:39.544 16:41:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:39.544 16:41:25 -- common/autotest_common.sh@10 -- # set +x 00:05:39.544 [2024-11-16 16:41:25.170067] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:39.544 [2024-11-16 16:41:25.170161] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1073257 ] 00:05:39.544 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.544 [2024-11-16 16:41:25.227746] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.802 [2024-11-16 16:41:25.310209] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:39.802 [2024-11-16 16:41:25.310349] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:39.802 [2024-11-16 16:41:25.310366] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1073257' to capture a snapshot of events at runtime. 00:05:39.802 [2024-11-16 16:41:25.310377] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1073257 for offline analysis/debug. 00:05:39.802 [2024-11-16 16:41:25.310402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.368 16:41:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:40.368 16:41:26 -- common/autotest_common.sh@862 -- # return 0 00:05:40.368 16:41:26 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:40.368 16:41:26 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:40.368 16:41:26 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:40.368 16:41:26 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:40.368 16:41:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.368 16:41:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.368 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.368 ************************************ 00:05:40.368 START TEST rpc_integrity 00:05:40.368 ************************************ 00:05:40.368 16:41:26 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:40.368 16:41:26 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:40.368 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.627 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.627 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.627 16:41:26 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:40.627 16:41:26 -- rpc/rpc.sh@13 -- # jq length 00:05:40.627 16:41:26 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:40.627 16:41:26 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:40.627 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.627 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.627 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.627 16:41:26 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:40.627 16:41:26 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:40.627 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.627 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.627 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.627 16:41:26 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:40.627 { 00:05:40.627 "name": "Malloc0", 00:05:40.627 "aliases": [ 00:05:40.627 "b08bbebb-35f8-4cd8-b09a-1f09269b1e73" 00:05:40.627 ], 00:05:40.627 "product_name": "Malloc disk", 00:05:40.627 "block_size": 512, 00:05:40.627 "num_blocks": 16384, 00:05:40.627 "uuid": "b08bbebb-35f8-4cd8-b09a-1f09269b1e73", 00:05:40.627 "assigned_rate_limits": { 00:05:40.627 "rw_ios_per_sec": 0, 00:05:40.627 "rw_mbytes_per_sec": 0, 00:05:40.627 "r_mbytes_per_sec": 0, 00:05:40.627 "w_mbytes_per_sec": 0 00:05:40.627 }, 00:05:40.627 "claimed": false, 00:05:40.627 "zoned": false, 00:05:40.627 "supported_io_types": { 00:05:40.627 "read": true, 00:05:40.627 "write": true, 00:05:40.627 "unmap": true, 00:05:40.627 "write_zeroes": true, 00:05:40.627 "flush": true, 00:05:40.627 "reset": true, 00:05:40.627 "compare": false, 00:05:40.627 "compare_and_write": false, 00:05:40.627 "abort": true, 00:05:40.627 "nvme_admin": false, 00:05:40.627 "nvme_io": false 00:05:40.627 }, 00:05:40.627 "memory_domains": [ 00:05:40.627 { 00:05:40.627 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.627 "dma_device_type": 2 00:05:40.627 } 00:05:40.627 ], 00:05:40.627 "driver_specific": {} 00:05:40.627 } 00:05:40.627 ]' 00:05:40.627 16:41:26 -- rpc/rpc.sh@17 -- # jq length 00:05:40.627 16:41:26 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:40.627 16:41:26 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:40.627 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.627 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.627 [2024-11-16 16:41:26.223130] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:40.627 [2024-11-16 16:41:26.223176] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:40.627 [2024-11-16 16:41:26.223196] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x11a1b20 00:05:40.627 [2024-11-16 16:41:26.223209] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:40.627 [2024-11-16 16:41:26.224434] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:40.627 [2024-11-16 16:41:26.224459] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:40.627 Passthru0 00:05:40.627 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.627 16:41:26 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:40.627 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.627 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.627 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.627 16:41:26 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:40.627 { 00:05:40.627 "name": "Malloc0", 00:05:40.627 "aliases": [ 00:05:40.627 "b08bbebb-35f8-4cd8-b09a-1f09269b1e73" 00:05:40.627 ], 00:05:40.627 "product_name": "Malloc disk", 00:05:40.627 "block_size": 512, 00:05:40.627 "num_blocks": 16384, 00:05:40.627 "uuid": "b08bbebb-35f8-4cd8-b09a-1f09269b1e73", 00:05:40.627 "assigned_rate_limits": { 00:05:40.627 "rw_ios_per_sec": 0, 00:05:40.627 "rw_mbytes_per_sec": 0, 00:05:40.627 "r_mbytes_per_sec": 0, 00:05:40.627 "w_mbytes_per_sec": 0 00:05:40.627 }, 00:05:40.627 "claimed": true, 00:05:40.627 "claim_type": "exclusive_write", 00:05:40.627 "zoned": false, 00:05:40.627 "supported_io_types": { 00:05:40.627 "read": true, 00:05:40.627 "write": true, 00:05:40.627 "unmap": true, 00:05:40.627 "write_zeroes": true, 00:05:40.627 "flush": true, 00:05:40.627 "reset": true, 00:05:40.627 "compare": false, 00:05:40.627 "compare_and_write": false, 00:05:40.627 "abort": true, 00:05:40.627 "nvme_admin": false, 00:05:40.627 "nvme_io": false 00:05:40.627 }, 00:05:40.627 "memory_domains": [ 00:05:40.627 { 00:05:40.627 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.627 "dma_device_type": 2 00:05:40.627 } 00:05:40.627 ], 00:05:40.627 "driver_specific": {} 00:05:40.627 }, 00:05:40.627 { 00:05:40.627 "name": "Passthru0", 00:05:40.627 "aliases": [ 00:05:40.627 "941d7b29-8310-5f00-984e-8682db67d191" 00:05:40.627 ], 00:05:40.627 "product_name": "passthru", 00:05:40.627 "block_size": 512, 00:05:40.627 "num_blocks": 16384, 00:05:40.627 "uuid": "941d7b29-8310-5f00-984e-8682db67d191", 00:05:40.627 "assigned_rate_limits": { 00:05:40.627 "rw_ios_per_sec": 0, 00:05:40.627 "rw_mbytes_per_sec": 0, 00:05:40.628 "r_mbytes_per_sec": 0, 00:05:40.628 "w_mbytes_per_sec": 0 00:05:40.628 }, 00:05:40.628 "claimed": false, 00:05:40.628 "zoned": false, 00:05:40.628 "supported_io_types": { 00:05:40.628 "read": true, 00:05:40.628 "write": true, 00:05:40.628 "unmap": true, 00:05:40.628 "write_zeroes": true, 00:05:40.628 "flush": true, 00:05:40.628 "reset": true, 00:05:40.628 "compare": false, 00:05:40.628 "compare_and_write": false, 00:05:40.628 "abort": true, 00:05:40.628 "nvme_admin": false, 00:05:40.628 "nvme_io": false 00:05:40.628 }, 00:05:40.628 "memory_domains": [ 00:05:40.628 { 00:05:40.628 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.628 "dma_device_type": 2 00:05:40.628 } 00:05:40.628 ], 00:05:40.628 "driver_specific": { 00:05:40.628 "passthru": { 00:05:40.628 "name": "Passthru0", 00:05:40.628 "base_bdev_name": "Malloc0" 00:05:40.628 } 00:05:40.628 } 00:05:40.628 } 00:05:40.628 ]' 00:05:40.628 16:41:26 -- rpc/rpc.sh@21 -- # jq length 00:05:40.628 16:41:26 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:40.628 16:41:26 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:40.628 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.628 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.628 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.628 16:41:26 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:40.628 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.628 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.628 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.628 16:41:26 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:40.628 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.628 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.628 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.628 16:41:26 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:40.628 16:41:26 -- rpc/rpc.sh@26 -- # jq length 00:05:40.628 16:41:26 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:40.628 00:05:40.628 real 0m0.217s 00:05:40.628 user 0m0.134s 00:05:40.628 sys 0m0.026s 00:05:40.628 16:41:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.628 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.628 ************************************ 00:05:40.628 END TEST rpc_integrity 00:05:40.628 ************************************ 00:05:40.628 16:41:26 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:40.628 16:41:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.628 16:41:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.628 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.628 ************************************ 00:05:40.628 START TEST rpc_plugins 00:05:40.628 ************************************ 00:05:40.628 16:41:26 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:40.628 16:41:26 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:40.628 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.628 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.628 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.628 16:41:26 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:40.628 16:41:26 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:40.628 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.628 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.885 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.885 16:41:26 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:40.885 { 00:05:40.885 "name": "Malloc1", 00:05:40.885 "aliases": [ 00:05:40.885 "f2ee7c9b-7889-48b7-9c08-720a6ddfe933" 00:05:40.885 ], 00:05:40.885 "product_name": "Malloc disk", 00:05:40.885 "block_size": 4096, 00:05:40.885 "num_blocks": 256, 00:05:40.885 "uuid": "f2ee7c9b-7889-48b7-9c08-720a6ddfe933", 00:05:40.885 "assigned_rate_limits": { 00:05:40.885 "rw_ios_per_sec": 0, 00:05:40.885 "rw_mbytes_per_sec": 0, 00:05:40.885 "r_mbytes_per_sec": 0, 00:05:40.885 "w_mbytes_per_sec": 0 00:05:40.885 }, 00:05:40.885 "claimed": false, 00:05:40.885 "zoned": false, 00:05:40.885 "supported_io_types": { 00:05:40.885 "read": true, 00:05:40.885 "write": true, 00:05:40.885 "unmap": true, 00:05:40.885 "write_zeroes": true, 00:05:40.885 "flush": true, 00:05:40.885 "reset": true, 00:05:40.885 "compare": false, 00:05:40.885 "compare_and_write": false, 00:05:40.885 "abort": true, 00:05:40.885 "nvme_admin": false, 00:05:40.885 "nvme_io": false 00:05:40.885 }, 00:05:40.885 "memory_domains": [ 00:05:40.885 { 00:05:40.885 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.885 "dma_device_type": 2 00:05:40.885 } 00:05:40.885 ], 00:05:40.885 "driver_specific": {} 00:05:40.885 } 00:05:40.885 ]' 00:05:40.885 16:41:26 -- rpc/rpc.sh@32 -- # jq length 00:05:40.885 16:41:26 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:40.885 16:41:26 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:40.885 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.885 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.885 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.885 16:41:26 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:40.885 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.885 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.885 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.885 16:41:26 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:40.885 16:41:26 -- rpc/rpc.sh@36 -- # jq length 00:05:40.885 16:41:26 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:40.885 00:05:40.885 real 0m0.114s 00:05:40.885 user 0m0.073s 00:05:40.885 sys 0m0.009s 00:05:40.885 16:41:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.885 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.885 ************************************ 00:05:40.885 END TEST rpc_plugins 00:05:40.885 ************************************ 00:05:40.885 16:41:26 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:40.885 16:41:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.885 16:41:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.885 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.885 ************************************ 00:05:40.885 START TEST rpc_trace_cmd_test 00:05:40.886 ************************************ 00:05:40.886 16:41:26 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:40.886 16:41:26 -- rpc/rpc.sh@40 -- # local info 00:05:40.886 16:41:26 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:40.886 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.886 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:40.886 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.886 16:41:26 -- rpc/rpc.sh@42 -- # info='{ 00:05:40.886 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1073257", 00:05:40.886 "tpoint_group_mask": "0x8", 00:05:40.886 "iscsi_conn": { 00:05:40.886 "mask": "0x2", 00:05:40.886 "tpoint_mask": "0x0" 00:05:40.886 }, 00:05:40.886 "scsi": { 00:05:40.886 "mask": "0x4", 00:05:40.886 "tpoint_mask": "0x0" 00:05:40.886 }, 00:05:40.886 "bdev": { 00:05:40.886 "mask": "0x8", 00:05:40.886 "tpoint_mask": "0xffffffffffffffff" 00:05:40.886 }, 00:05:40.886 "nvmf_rdma": { 00:05:40.886 "mask": "0x10", 00:05:40.886 "tpoint_mask": "0x0" 00:05:40.886 }, 00:05:40.886 "nvmf_tcp": { 00:05:40.886 "mask": "0x20", 00:05:40.886 "tpoint_mask": "0x0" 00:05:40.886 }, 00:05:40.886 "ftl": { 00:05:40.886 "mask": "0x40", 00:05:40.886 "tpoint_mask": "0x0" 00:05:40.886 }, 00:05:40.886 "blobfs": { 00:05:40.886 "mask": "0x80", 00:05:40.886 "tpoint_mask": "0x0" 00:05:40.886 }, 00:05:40.886 "dsa": { 00:05:40.886 "mask": "0x200", 00:05:40.886 "tpoint_mask": "0x0" 00:05:40.886 }, 00:05:40.886 "thread": { 00:05:40.886 "mask": "0x400", 00:05:40.886 "tpoint_mask": "0x0" 00:05:40.886 }, 00:05:40.886 "nvme_pcie": { 00:05:40.886 "mask": "0x800", 00:05:40.886 "tpoint_mask": "0x0" 00:05:40.886 }, 00:05:40.886 "iaa": { 00:05:40.886 "mask": "0x1000", 00:05:40.886 "tpoint_mask": "0x0" 00:05:40.886 }, 00:05:40.886 "nvme_tcp": { 00:05:40.886 "mask": "0x2000", 00:05:40.886 "tpoint_mask": "0x0" 00:05:40.886 }, 00:05:40.886 "bdev_nvme": { 00:05:40.886 "mask": "0x4000", 00:05:40.886 "tpoint_mask": "0x0" 00:05:40.886 } 00:05:40.886 }' 00:05:40.886 16:41:26 -- rpc/rpc.sh@43 -- # jq length 00:05:40.886 16:41:26 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:40.886 16:41:26 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:40.886 16:41:26 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:40.886 16:41:26 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:40.886 16:41:26 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:40.886 16:41:26 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:41.144 16:41:26 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:41.144 16:41:26 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:41.144 16:41:26 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:41.144 00:05:41.144 real 0m0.180s 00:05:41.144 user 0m0.156s 00:05:41.144 sys 0m0.015s 00:05:41.144 16:41:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.144 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:41.144 ************************************ 00:05:41.144 END TEST rpc_trace_cmd_test 00:05:41.144 ************************************ 00:05:41.144 16:41:26 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:41.144 16:41:26 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:41.144 16:41:26 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:41.144 16:41:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.144 16:41:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.144 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:41.144 ************************************ 00:05:41.144 START TEST rpc_daemon_integrity 00:05:41.144 ************************************ 00:05:41.144 16:41:26 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:41.144 16:41:26 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:41.144 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.144 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:41.144 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.144 16:41:26 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:41.144 16:41:26 -- rpc/rpc.sh@13 -- # jq length 00:05:41.144 16:41:26 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:41.144 16:41:26 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:41.144 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.144 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:41.144 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.144 16:41:26 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:41.144 16:41:26 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:41.144 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.144 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:41.144 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.144 16:41:26 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:41.144 { 00:05:41.144 "name": "Malloc2", 00:05:41.144 "aliases": [ 00:05:41.144 "098b6090-44be-4339-919d-ebbac306c237" 00:05:41.144 ], 00:05:41.144 "product_name": "Malloc disk", 00:05:41.144 "block_size": 512, 00:05:41.144 "num_blocks": 16384, 00:05:41.144 "uuid": "098b6090-44be-4339-919d-ebbac306c237", 00:05:41.144 "assigned_rate_limits": { 00:05:41.144 "rw_ios_per_sec": 0, 00:05:41.144 "rw_mbytes_per_sec": 0, 00:05:41.144 "r_mbytes_per_sec": 0, 00:05:41.144 "w_mbytes_per_sec": 0 00:05:41.144 }, 00:05:41.144 "claimed": false, 00:05:41.144 "zoned": false, 00:05:41.144 "supported_io_types": { 00:05:41.144 "read": true, 00:05:41.144 "write": true, 00:05:41.144 "unmap": true, 00:05:41.144 "write_zeroes": true, 00:05:41.144 "flush": true, 00:05:41.144 "reset": true, 00:05:41.144 "compare": false, 00:05:41.144 "compare_and_write": false, 00:05:41.144 "abort": true, 00:05:41.144 "nvme_admin": false, 00:05:41.144 "nvme_io": false 00:05:41.144 }, 00:05:41.144 "memory_domains": [ 00:05:41.144 { 00:05:41.144 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.144 "dma_device_type": 2 00:05:41.144 } 00:05:41.144 ], 00:05:41.144 "driver_specific": {} 00:05:41.144 } 00:05:41.144 ]' 00:05:41.144 16:41:26 -- rpc/rpc.sh@17 -- # jq length 00:05:41.144 16:41:26 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:41.144 16:41:26 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:41.144 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.144 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:41.144 [2024-11-16 16:41:26.800839] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:41.144 [2024-11-16 16:41:26.800886] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:41.144 [2024-11-16 16:41:26.800926] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x11a0ec0 00:05:41.144 [2024-11-16 16:41:26.800940] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:41.144 [2024-11-16 16:41:26.802041] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:41.144 [2024-11-16 16:41:26.802065] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:41.144 Passthru0 00:05:41.144 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.144 16:41:26 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:41.144 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.144 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:41.144 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.144 16:41:26 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:41.144 { 00:05:41.144 "name": "Malloc2", 00:05:41.144 "aliases": [ 00:05:41.144 "098b6090-44be-4339-919d-ebbac306c237" 00:05:41.144 ], 00:05:41.144 "product_name": "Malloc disk", 00:05:41.144 "block_size": 512, 00:05:41.144 "num_blocks": 16384, 00:05:41.144 "uuid": "098b6090-44be-4339-919d-ebbac306c237", 00:05:41.144 "assigned_rate_limits": { 00:05:41.144 "rw_ios_per_sec": 0, 00:05:41.144 "rw_mbytes_per_sec": 0, 00:05:41.144 "r_mbytes_per_sec": 0, 00:05:41.144 "w_mbytes_per_sec": 0 00:05:41.144 }, 00:05:41.144 "claimed": true, 00:05:41.144 "claim_type": "exclusive_write", 00:05:41.144 "zoned": false, 00:05:41.144 "supported_io_types": { 00:05:41.144 "read": true, 00:05:41.144 "write": true, 00:05:41.144 "unmap": true, 00:05:41.144 "write_zeroes": true, 00:05:41.144 "flush": true, 00:05:41.144 "reset": true, 00:05:41.144 "compare": false, 00:05:41.144 "compare_and_write": false, 00:05:41.144 "abort": true, 00:05:41.144 "nvme_admin": false, 00:05:41.144 "nvme_io": false 00:05:41.144 }, 00:05:41.145 "memory_domains": [ 00:05:41.145 { 00:05:41.145 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.145 "dma_device_type": 2 00:05:41.145 } 00:05:41.145 ], 00:05:41.145 "driver_specific": {} 00:05:41.145 }, 00:05:41.145 { 00:05:41.145 "name": "Passthru0", 00:05:41.145 "aliases": [ 00:05:41.145 "d6365fbd-f293-53ac-922d-a3dcce39b591" 00:05:41.145 ], 00:05:41.145 "product_name": "passthru", 00:05:41.145 "block_size": 512, 00:05:41.145 "num_blocks": 16384, 00:05:41.145 "uuid": "d6365fbd-f293-53ac-922d-a3dcce39b591", 00:05:41.145 "assigned_rate_limits": { 00:05:41.145 "rw_ios_per_sec": 0, 00:05:41.145 "rw_mbytes_per_sec": 0, 00:05:41.145 "r_mbytes_per_sec": 0, 00:05:41.145 "w_mbytes_per_sec": 0 00:05:41.145 }, 00:05:41.145 "claimed": false, 00:05:41.145 "zoned": false, 00:05:41.145 "supported_io_types": { 00:05:41.145 "read": true, 00:05:41.145 "write": true, 00:05:41.145 "unmap": true, 00:05:41.145 "write_zeroes": true, 00:05:41.145 "flush": true, 00:05:41.145 "reset": true, 00:05:41.145 "compare": false, 00:05:41.145 "compare_and_write": false, 00:05:41.145 "abort": true, 00:05:41.145 "nvme_admin": false, 00:05:41.145 "nvme_io": false 00:05:41.145 }, 00:05:41.145 "memory_domains": [ 00:05:41.145 { 00:05:41.145 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.145 "dma_device_type": 2 00:05:41.145 } 00:05:41.145 ], 00:05:41.145 "driver_specific": { 00:05:41.145 "passthru": { 00:05:41.145 "name": "Passthru0", 00:05:41.145 "base_bdev_name": "Malloc2" 00:05:41.145 } 00:05:41.145 } 00:05:41.145 } 00:05:41.145 ]' 00:05:41.145 16:41:26 -- rpc/rpc.sh@21 -- # jq length 00:05:41.145 16:41:26 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:41.145 16:41:26 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:41.145 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.145 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:41.145 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.145 16:41:26 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:41.145 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.145 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:41.145 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.145 16:41:26 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:41.145 16:41:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.145 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:41.145 16:41:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.145 16:41:26 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:41.145 16:41:26 -- rpc/rpc.sh@26 -- # jq length 00:05:41.403 16:41:26 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:41.403 00:05:41.403 real 0m0.208s 00:05:41.403 user 0m0.141s 00:05:41.403 sys 0m0.012s 00:05:41.403 16:41:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.403 16:41:26 -- common/autotest_common.sh@10 -- # set +x 00:05:41.403 ************************************ 00:05:41.403 END TEST rpc_daemon_integrity 00:05:41.403 ************************************ 00:05:41.403 16:41:26 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:41.403 16:41:26 -- rpc/rpc.sh@84 -- # killprocess 1073257 00:05:41.403 16:41:26 -- common/autotest_common.sh@936 -- # '[' -z 1073257 ']' 00:05:41.403 16:41:26 -- common/autotest_common.sh@940 -- # kill -0 1073257 00:05:41.403 16:41:26 -- common/autotest_common.sh@941 -- # uname 00:05:41.403 16:41:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:41.403 16:41:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1073257 00:05:41.403 16:41:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:41.403 16:41:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:41.403 16:41:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1073257' 00:05:41.403 killing process with pid 1073257 00:05:41.403 16:41:26 -- common/autotest_common.sh@955 -- # kill 1073257 00:05:41.403 16:41:26 -- common/autotest_common.sh@960 -- # wait 1073257 00:05:41.661 00:05:41.661 real 0m2.373s 00:05:41.661 user 0m2.976s 00:05:41.661 sys 0m0.584s 00:05:41.661 16:41:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.661 16:41:27 -- common/autotest_common.sh@10 -- # set +x 00:05:41.661 ************************************ 00:05:41.661 END TEST rpc 00:05:41.661 ************************************ 00:05:41.661 16:41:27 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:41.661 16:41:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.661 16:41:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.661 16:41:27 -- common/autotest_common.sh@10 -- # set +x 00:05:41.661 ************************************ 00:05:41.661 START TEST rpc_client 00:05:41.662 ************************************ 00:05:41.662 16:41:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:41.920 * Looking for test storage... 00:05:41.920 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:41.920 16:41:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:41.920 16:41:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:41.920 16:41:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:41.920 16:41:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:41.920 16:41:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:41.920 16:41:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:41.920 16:41:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:41.920 16:41:27 -- scripts/common.sh@335 -- # IFS=.-: 00:05:41.920 16:41:27 -- scripts/common.sh@335 -- # read -ra ver1 00:05:41.920 16:41:27 -- scripts/common.sh@336 -- # IFS=.-: 00:05:41.920 16:41:27 -- scripts/common.sh@336 -- # read -ra ver2 00:05:41.920 16:41:27 -- scripts/common.sh@337 -- # local 'op=<' 00:05:41.920 16:41:27 -- scripts/common.sh@339 -- # ver1_l=2 00:05:41.920 16:41:27 -- scripts/common.sh@340 -- # ver2_l=1 00:05:41.920 16:41:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:41.920 16:41:27 -- scripts/common.sh@343 -- # case "$op" in 00:05:41.920 16:41:27 -- scripts/common.sh@344 -- # : 1 00:05:41.920 16:41:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:41.920 16:41:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:41.920 16:41:27 -- scripts/common.sh@364 -- # decimal 1 00:05:41.920 16:41:27 -- scripts/common.sh@352 -- # local d=1 00:05:41.920 16:41:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:41.920 16:41:27 -- scripts/common.sh@354 -- # echo 1 00:05:41.920 16:41:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:41.920 16:41:27 -- scripts/common.sh@365 -- # decimal 2 00:05:41.920 16:41:27 -- scripts/common.sh@352 -- # local d=2 00:05:41.920 16:41:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:41.920 16:41:27 -- scripts/common.sh@354 -- # echo 2 00:05:41.920 16:41:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:41.920 16:41:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:41.920 16:41:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:41.920 16:41:27 -- scripts/common.sh@367 -- # return 0 00:05:41.920 16:41:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:41.920 16:41:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:41.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:41.920 --rc genhtml_branch_coverage=1 00:05:41.920 --rc genhtml_function_coverage=1 00:05:41.920 --rc genhtml_legend=1 00:05:41.920 --rc geninfo_all_blocks=1 00:05:41.920 --rc geninfo_unexecuted_blocks=1 00:05:41.920 00:05:41.920 ' 00:05:41.920 16:41:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:41.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:41.920 --rc genhtml_branch_coverage=1 00:05:41.920 --rc genhtml_function_coverage=1 00:05:41.920 --rc genhtml_legend=1 00:05:41.920 --rc geninfo_all_blocks=1 00:05:41.920 --rc geninfo_unexecuted_blocks=1 00:05:41.920 00:05:41.920 ' 00:05:41.920 16:41:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:41.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:41.920 --rc genhtml_branch_coverage=1 00:05:41.920 --rc genhtml_function_coverage=1 00:05:41.920 --rc genhtml_legend=1 00:05:41.920 --rc geninfo_all_blocks=1 00:05:41.920 --rc geninfo_unexecuted_blocks=1 00:05:41.920 00:05:41.920 ' 00:05:41.920 16:41:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:41.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:41.920 --rc genhtml_branch_coverage=1 00:05:41.920 --rc genhtml_function_coverage=1 00:05:41.920 --rc genhtml_legend=1 00:05:41.920 --rc geninfo_all_blocks=1 00:05:41.920 --rc geninfo_unexecuted_blocks=1 00:05:41.920 00:05:41.920 ' 00:05:41.920 16:41:27 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:41.920 OK 00:05:41.920 16:41:27 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:41.920 00:05:41.920 real 0m0.159s 00:05:41.920 user 0m0.109s 00:05:41.920 sys 0m0.059s 00:05:41.920 16:41:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.920 16:41:27 -- common/autotest_common.sh@10 -- # set +x 00:05:41.920 ************************************ 00:05:41.920 END TEST rpc_client 00:05:41.920 ************************************ 00:05:41.920 16:41:27 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:41.920 16:41:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.920 16:41:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.920 16:41:27 -- common/autotest_common.sh@10 -- # set +x 00:05:41.920 ************************************ 00:05:41.920 START TEST json_config 00:05:41.920 ************************************ 00:05:41.920 16:41:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:41.920 16:41:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:41.920 16:41:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:41.920 16:41:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:42.179 16:41:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:42.179 16:41:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:42.179 16:41:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:42.179 16:41:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:42.179 16:41:27 -- scripts/common.sh@335 -- # IFS=.-: 00:05:42.179 16:41:27 -- scripts/common.sh@335 -- # read -ra ver1 00:05:42.179 16:41:27 -- scripts/common.sh@336 -- # IFS=.-: 00:05:42.179 16:41:27 -- scripts/common.sh@336 -- # read -ra ver2 00:05:42.179 16:41:27 -- scripts/common.sh@337 -- # local 'op=<' 00:05:42.179 16:41:27 -- scripts/common.sh@339 -- # ver1_l=2 00:05:42.179 16:41:27 -- scripts/common.sh@340 -- # ver2_l=1 00:05:42.179 16:41:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:42.179 16:41:27 -- scripts/common.sh@343 -- # case "$op" in 00:05:42.179 16:41:27 -- scripts/common.sh@344 -- # : 1 00:05:42.179 16:41:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:42.179 16:41:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:42.179 16:41:27 -- scripts/common.sh@364 -- # decimal 1 00:05:42.179 16:41:27 -- scripts/common.sh@352 -- # local d=1 00:05:42.179 16:41:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:42.179 16:41:27 -- scripts/common.sh@354 -- # echo 1 00:05:42.179 16:41:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:42.179 16:41:27 -- scripts/common.sh@365 -- # decimal 2 00:05:42.179 16:41:27 -- scripts/common.sh@352 -- # local d=2 00:05:42.179 16:41:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:42.179 16:41:27 -- scripts/common.sh@354 -- # echo 2 00:05:42.179 16:41:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:42.179 16:41:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:42.179 16:41:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:42.179 16:41:27 -- scripts/common.sh@367 -- # return 0 00:05:42.179 16:41:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:42.179 16:41:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:42.179 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.179 --rc genhtml_branch_coverage=1 00:05:42.179 --rc genhtml_function_coverage=1 00:05:42.179 --rc genhtml_legend=1 00:05:42.180 --rc geninfo_all_blocks=1 00:05:42.180 --rc geninfo_unexecuted_blocks=1 00:05:42.180 00:05:42.180 ' 00:05:42.180 16:41:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:42.180 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.180 --rc genhtml_branch_coverage=1 00:05:42.180 --rc genhtml_function_coverage=1 00:05:42.180 --rc genhtml_legend=1 00:05:42.180 --rc geninfo_all_blocks=1 00:05:42.180 --rc geninfo_unexecuted_blocks=1 00:05:42.180 00:05:42.180 ' 00:05:42.180 16:41:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:42.180 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.180 --rc genhtml_branch_coverage=1 00:05:42.180 --rc genhtml_function_coverage=1 00:05:42.180 --rc genhtml_legend=1 00:05:42.180 --rc geninfo_all_blocks=1 00:05:42.180 --rc geninfo_unexecuted_blocks=1 00:05:42.180 00:05:42.180 ' 00:05:42.180 16:41:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:42.180 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.180 --rc genhtml_branch_coverage=1 00:05:42.180 --rc genhtml_function_coverage=1 00:05:42.180 --rc genhtml_legend=1 00:05:42.180 --rc geninfo_all_blocks=1 00:05:42.180 --rc geninfo_unexecuted_blocks=1 00:05:42.180 00:05:42.180 ' 00:05:42.180 16:41:27 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:42.180 16:41:27 -- nvmf/common.sh@7 -- # uname -s 00:05:42.180 16:41:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:42.180 16:41:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:42.180 16:41:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:42.180 16:41:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:42.180 16:41:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:42.180 16:41:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:42.180 16:41:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:42.180 16:41:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:42.180 16:41:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:42.180 16:41:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:42.180 16:41:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:42.180 16:41:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:42.180 16:41:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:42.180 16:41:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:42.180 16:41:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:42.180 16:41:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:42.180 16:41:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:42.180 16:41:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:42.180 16:41:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:42.180 16:41:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:42.180 16:41:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:42.180 16:41:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:42.180 16:41:27 -- paths/export.sh@5 -- # export PATH 00:05:42.180 16:41:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:42.180 16:41:27 -- nvmf/common.sh@46 -- # : 0 00:05:42.180 16:41:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:42.180 16:41:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:42.180 16:41:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:42.180 16:41:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:42.180 16:41:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:42.180 16:41:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:42.180 16:41:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:42.180 16:41:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:42.180 16:41:27 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:42.180 16:41:27 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:42.180 16:41:27 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:42.180 16:41:27 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:42.180 16:41:27 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:42.180 16:41:27 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:42.180 16:41:27 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:42.180 16:41:27 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:42.180 16:41:27 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:42.180 16:41:27 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:42.180 16:41:27 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:42.181 16:41:27 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:42.181 16:41:27 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:42.181 16:41:27 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:42.181 16:41:27 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:42.181 INFO: JSON configuration test init 00:05:42.181 16:41:27 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:42.181 16:41:27 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:42.181 16:41:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:42.181 16:41:27 -- common/autotest_common.sh@10 -- # set +x 00:05:42.181 16:41:27 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:42.181 16:41:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:42.181 16:41:27 -- common/autotest_common.sh@10 -- # set +x 00:05:42.181 16:41:27 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:42.181 16:41:27 -- json_config/json_config.sh@98 -- # local app=target 00:05:42.181 16:41:27 -- json_config/json_config.sh@99 -- # shift 00:05:42.181 16:41:27 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:42.181 16:41:27 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:42.181 16:41:27 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:42.181 16:41:27 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:42.181 16:41:27 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:42.181 16:41:27 -- json_config/json_config.sh@111 -- # app_pid[$app]=1073760 00:05:42.181 16:41:27 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:42.181 16:41:27 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:42.181 Waiting for target to run... 00:05:42.181 16:41:27 -- json_config/json_config.sh@114 -- # waitforlisten 1073760 /var/tmp/spdk_tgt.sock 00:05:42.181 16:41:27 -- common/autotest_common.sh@829 -- # '[' -z 1073760 ']' 00:05:42.181 16:41:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:42.181 16:41:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:42.181 16:41:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:42.181 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:42.181 16:41:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:42.181 16:41:27 -- common/autotest_common.sh@10 -- # set +x 00:05:42.181 [2024-11-16 16:41:27.769949] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:42.181 [2024-11-16 16:41:27.770037] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1073760 ] 00:05:42.181 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.439 [2024-11-16 16:41:28.124968] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.439 [2024-11-16 16:41:28.179866] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:42.439 [2024-11-16 16:41:28.180045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.006 16:41:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:43.006 16:41:28 -- common/autotest_common.sh@862 -- # return 0 00:05:43.006 16:41:28 -- json_config/json_config.sh@115 -- # echo '' 00:05:43.006 00:05:43.006 16:41:28 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:43.006 16:41:28 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:43.006 16:41:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:43.006 16:41:28 -- common/autotest_common.sh@10 -- # set +x 00:05:43.006 16:41:28 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:43.006 16:41:28 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:43.006 16:41:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:43.006 16:41:28 -- common/autotest_common.sh@10 -- # set +x 00:05:43.006 16:41:28 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:43.006 16:41:28 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:43.006 16:41:28 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:46.295 16:41:31 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:46.295 16:41:31 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:46.295 16:41:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:46.295 16:41:31 -- common/autotest_common.sh@10 -- # set +x 00:05:46.295 16:41:31 -- json_config/json_config.sh@48 -- # local ret=0 00:05:46.295 16:41:31 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:46.295 16:41:31 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:46.295 16:41:31 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:46.295 16:41:31 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:46.295 16:41:31 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:46.554 16:41:32 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:46.554 16:41:32 -- json_config/json_config.sh@51 -- # local get_types 00:05:46.554 16:41:32 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:46.554 16:41:32 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:46.554 16:41:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:46.554 16:41:32 -- common/autotest_common.sh@10 -- # set +x 00:05:46.554 16:41:32 -- json_config/json_config.sh@58 -- # return 0 00:05:46.554 16:41:32 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:46.554 16:41:32 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:46.554 16:41:32 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:46.554 16:41:32 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:46.554 16:41:32 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:46.554 16:41:32 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:46.554 16:41:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:46.554 16:41:32 -- common/autotest_common.sh@10 -- # set +x 00:05:46.554 16:41:32 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:46.554 16:41:32 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:46.554 16:41:32 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:46.554 16:41:32 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:46.554 16:41:32 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:46.812 MallocForNvmf0 00:05:46.812 16:41:32 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:46.812 16:41:32 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:47.070 MallocForNvmf1 00:05:47.070 16:41:32 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:47.071 16:41:32 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:47.329 [2024-11-16 16:41:32.907165] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:47.329 16:41:32 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:47.329 16:41:32 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:47.586 16:41:33 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:47.586 16:41:33 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:47.845 16:41:33 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:47.845 16:41:33 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:48.103 16:41:33 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:48.103 16:41:33 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:48.360 [2024-11-16 16:41:33.902343] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:48.360 16:41:33 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:48.360 16:41:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:48.360 16:41:33 -- common/autotest_common.sh@10 -- # set +x 00:05:48.360 16:41:33 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:48.360 16:41:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:48.360 16:41:33 -- common/autotest_common.sh@10 -- # set +x 00:05:48.360 16:41:33 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:48.360 16:41:33 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:48.360 16:41:33 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:48.618 MallocBdevForConfigChangeCheck 00:05:48.619 16:41:34 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:48.619 16:41:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:48.619 16:41:34 -- common/autotest_common.sh@10 -- # set +x 00:05:48.619 16:41:34 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:48.619 16:41:34 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:48.877 16:41:34 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:48.877 INFO: shutting down applications... 00:05:48.877 16:41:34 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:48.877 16:41:34 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:48.877 16:41:34 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:48.877 16:41:34 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:50.777 Calling clear_iscsi_subsystem 00:05:50.777 Calling clear_nvmf_subsystem 00:05:50.777 Calling clear_nbd_subsystem 00:05:50.777 Calling clear_ublk_subsystem 00:05:50.777 Calling clear_vhost_blk_subsystem 00:05:50.777 Calling clear_vhost_scsi_subsystem 00:05:50.777 Calling clear_scheduler_subsystem 00:05:50.777 Calling clear_bdev_subsystem 00:05:50.777 Calling clear_accel_subsystem 00:05:50.777 Calling clear_vmd_subsystem 00:05:50.777 Calling clear_sock_subsystem 00:05:50.777 Calling clear_iobuf_subsystem 00:05:50.777 16:41:36 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:50.777 16:41:36 -- json_config/json_config.sh@396 -- # count=100 00:05:50.777 16:41:36 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:50.777 16:41:36 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:50.777 16:41:36 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:50.777 16:41:36 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:51.035 16:41:36 -- json_config/json_config.sh@398 -- # break 00:05:51.035 16:41:36 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:51.035 16:41:36 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:51.035 16:41:36 -- json_config/json_config.sh@120 -- # local app=target 00:05:51.035 16:41:36 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:51.035 16:41:36 -- json_config/json_config.sh@124 -- # [[ -n 1073760 ]] 00:05:51.035 16:41:36 -- json_config/json_config.sh@127 -- # kill -SIGINT 1073760 00:05:51.035 16:41:36 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:51.035 16:41:36 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:51.035 16:41:36 -- json_config/json_config.sh@130 -- # kill -0 1073760 00:05:51.035 16:41:36 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:51.604 16:41:37 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:51.604 16:41:37 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:51.604 16:41:37 -- json_config/json_config.sh@130 -- # kill -0 1073760 00:05:51.604 16:41:37 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:51.604 16:41:37 -- json_config/json_config.sh@132 -- # break 00:05:51.604 16:41:37 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:51.604 16:41:37 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:51.604 SPDK target shutdown done 00:05:51.604 16:41:37 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:51.604 INFO: relaunching applications... 00:05:51.604 16:41:37 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:51.604 16:41:37 -- json_config/json_config.sh@98 -- # local app=target 00:05:51.604 16:41:37 -- json_config/json_config.sh@99 -- # shift 00:05:51.604 16:41:37 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:51.604 16:41:37 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:51.604 16:41:37 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:51.604 16:41:37 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:51.604 16:41:37 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:51.604 16:41:37 -- json_config/json_config.sh@111 -- # app_pid[$app]=1075102 00:05:51.604 16:41:37 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:51.604 16:41:37 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:51.604 Waiting for target to run... 00:05:51.604 16:41:37 -- json_config/json_config.sh@114 -- # waitforlisten 1075102 /var/tmp/spdk_tgt.sock 00:05:51.604 16:41:37 -- common/autotest_common.sh@829 -- # '[' -z 1075102 ']' 00:05:51.604 16:41:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:51.604 16:41:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:51.604 16:41:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:51.604 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:51.604 16:41:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:51.604 16:41:37 -- common/autotest_common.sh@10 -- # set +x 00:05:51.604 [2024-11-16 16:41:37.192009] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:51.604 [2024-11-16 16:41:37.192105] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1075102 ] 00:05:51.604 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.863 [2024-11-16 16:41:37.539539] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.863 [2024-11-16 16:41:37.594150] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:51.863 [2024-11-16 16:41:37.594327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.149 [2024-11-16 16:41:40.601246] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:55.149 [2024-11-16 16:41:40.633755] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:55.407 16:41:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:55.407 16:41:41 -- common/autotest_common.sh@862 -- # return 0 00:05:55.407 16:41:41 -- json_config/json_config.sh@115 -- # echo '' 00:05:55.407 00:05:55.407 16:41:41 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:55.407 16:41:41 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:55.407 INFO: Checking if target configuration is the same... 00:05:55.407 16:41:41 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:55.407 16:41:41 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:55.407 16:41:41 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:55.407 + '[' 2 -ne 2 ']' 00:05:55.407 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:55.407 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:55.407 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:55.407 +++ basename /dev/fd/62 00:05:55.407 ++ mktemp /tmp/62.XXX 00:05:55.407 + tmp_file_1=/tmp/62.jg9 00:05:55.407 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:55.407 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:55.407 + tmp_file_2=/tmp/spdk_tgt_config.json.sJx 00:05:55.407 + ret=0 00:05:55.407 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:55.974 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:55.974 + diff -u /tmp/62.jg9 /tmp/spdk_tgt_config.json.sJx 00:05:55.974 + echo 'INFO: JSON config files are the same' 00:05:55.974 INFO: JSON config files are the same 00:05:55.974 + rm /tmp/62.jg9 /tmp/spdk_tgt_config.json.sJx 00:05:55.974 + exit 0 00:05:55.974 16:41:41 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:55.974 16:41:41 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:55.974 INFO: changing configuration and checking if this can be detected... 00:05:55.974 16:41:41 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:55.974 16:41:41 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:56.232 16:41:41 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:56.232 16:41:41 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:56.232 16:41:41 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:56.232 + '[' 2 -ne 2 ']' 00:05:56.232 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:56.232 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:56.232 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:56.232 +++ basename /dev/fd/62 00:05:56.232 ++ mktemp /tmp/62.XXX 00:05:56.232 + tmp_file_1=/tmp/62.rkV 00:05:56.232 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:56.232 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:56.232 + tmp_file_2=/tmp/spdk_tgt_config.json.1OJ 00:05:56.232 + ret=0 00:05:56.232 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:56.490 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:56.490 + diff -u /tmp/62.rkV /tmp/spdk_tgt_config.json.1OJ 00:05:56.749 + ret=1 00:05:56.749 + echo '=== Start of file: /tmp/62.rkV ===' 00:05:56.749 + cat /tmp/62.rkV 00:05:56.749 + echo '=== End of file: /tmp/62.rkV ===' 00:05:56.749 + echo '' 00:05:56.749 + echo '=== Start of file: /tmp/spdk_tgt_config.json.1OJ ===' 00:05:56.749 + cat /tmp/spdk_tgt_config.json.1OJ 00:05:56.749 + echo '=== End of file: /tmp/spdk_tgt_config.json.1OJ ===' 00:05:56.749 + echo '' 00:05:56.749 + rm /tmp/62.rkV /tmp/spdk_tgt_config.json.1OJ 00:05:56.749 + exit 1 00:05:56.749 16:41:42 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:56.749 INFO: configuration change detected. 00:05:56.749 16:41:42 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:56.749 16:41:42 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:56.749 16:41:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:56.749 16:41:42 -- common/autotest_common.sh@10 -- # set +x 00:05:56.749 16:41:42 -- json_config/json_config.sh@360 -- # local ret=0 00:05:56.749 16:41:42 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:56.749 16:41:42 -- json_config/json_config.sh@370 -- # [[ -n 1075102 ]] 00:05:56.749 16:41:42 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:56.749 16:41:42 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:56.749 16:41:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:56.749 16:41:42 -- common/autotest_common.sh@10 -- # set +x 00:05:56.749 16:41:42 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:56.749 16:41:42 -- json_config/json_config.sh@246 -- # uname -s 00:05:56.749 16:41:42 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:56.749 16:41:42 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:56.749 16:41:42 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:56.749 16:41:42 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:56.749 16:41:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:56.749 16:41:42 -- common/autotest_common.sh@10 -- # set +x 00:05:56.749 16:41:42 -- json_config/json_config.sh@376 -- # killprocess 1075102 00:05:56.749 16:41:42 -- common/autotest_common.sh@936 -- # '[' -z 1075102 ']' 00:05:56.749 16:41:42 -- common/autotest_common.sh@940 -- # kill -0 1075102 00:05:56.749 16:41:42 -- common/autotest_common.sh@941 -- # uname 00:05:56.749 16:41:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:56.749 16:41:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1075102 00:05:56.749 16:41:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:56.749 16:41:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:56.749 16:41:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1075102' 00:05:56.749 killing process with pid 1075102 00:05:56.749 16:41:42 -- common/autotest_common.sh@955 -- # kill 1075102 00:05:56.749 16:41:42 -- common/autotest_common.sh@960 -- # wait 1075102 00:05:58.651 16:41:43 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:58.651 16:41:43 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:58.651 16:41:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:58.651 16:41:43 -- common/autotest_common.sh@10 -- # set +x 00:05:58.651 16:41:43 -- json_config/json_config.sh@381 -- # return 0 00:05:58.651 16:41:43 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:58.651 INFO: Success 00:05:58.651 00:05:58.651 real 0m16.332s 00:05:58.651 user 0m18.963s 00:05:58.651 sys 0m1.907s 00:05:58.651 16:41:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.651 16:41:43 -- common/autotest_common.sh@10 -- # set +x 00:05:58.651 ************************************ 00:05:58.651 END TEST json_config 00:05:58.651 ************************************ 00:05:58.651 16:41:43 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:58.651 16:41:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:58.651 16:41:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.651 16:41:43 -- common/autotest_common.sh@10 -- # set +x 00:05:58.651 ************************************ 00:05:58.651 START TEST json_config_extra_key 00:05:58.651 ************************************ 00:05:58.651 16:41:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:58.651 16:41:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:58.651 16:41:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:58.651 16:41:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:58.651 16:41:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:58.651 16:41:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:58.651 16:41:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:58.651 16:41:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:58.651 16:41:44 -- scripts/common.sh@335 -- # IFS=.-: 00:05:58.651 16:41:44 -- scripts/common.sh@335 -- # read -ra ver1 00:05:58.651 16:41:44 -- scripts/common.sh@336 -- # IFS=.-: 00:05:58.651 16:41:44 -- scripts/common.sh@336 -- # read -ra ver2 00:05:58.651 16:41:44 -- scripts/common.sh@337 -- # local 'op=<' 00:05:58.651 16:41:44 -- scripts/common.sh@339 -- # ver1_l=2 00:05:58.651 16:41:44 -- scripts/common.sh@340 -- # ver2_l=1 00:05:58.651 16:41:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:58.651 16:41:44 -- scripts/common.sh@343 -- # case "$op" in 00:05:58.651 16:41:44 -- scripts/common.sh@344 -- # : 1 00:05:58.651 16:41:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:58.651 16:41:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:58.651 16:41:44 -- scripts/common.sh@364 -- # decimal 1 00:05:58.651 16:41:44 -- scripts/common.sh@352 -- # local d=1 00:05:58.651 16:41:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:58.651 16:41:44 -- scripts/common.sh@354 -- # echo 1 00:05:58.651 16:41:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:58.651 16:41:44 -- scripts/common.sh@365 -- # decimal 2 00:05:58.651 16:41:44 -- scripts/common.sh@352 -- # local d=2 00:05:58.651 16:41:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:58.651 16:41:44 -- scripts/common.sh@354 -- # echo 2 00:05:58.651 16:41:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:58.651 16:41:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:58.651 16:41:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:58.651 16:41:44 -- scripts/common.sh@367 -- # return 0 00:05:58.651 16:41:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:58.651 16:41:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:58.651 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.651 --rc genhtml_branch_coverage=1 00:05:58.651 --rc genhtml_function_coverage=1 00:05:58.651 --rc genhtml_legend=1 00:05:58.651 --rc geninfo_all_blocks=1 00:05:58.651 --rc geninfo_unexecuted_blocks=1 00:05:58.651 00:05:58.651 ' 00:05:58.651 16:41:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:58.651 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.651 --rc genhtml_branch_coverage=1 00:05:58.651 --rc genhtml_function_coverage=1 00:05:58.651 --rc genhtml_legend=1 00:05:58.651 --rc geninfo_all_blocks=1 00:05:58.651 --rc geninfo_unexecuted_blocks=1 00:05:58.651 00:05:58.651 ' 00:05:58.651 16:41:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:58.651 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.651 --rc genhtml_branch_coverage=1 00:05:58.651 --rc genhtml_function_coverage=1 00:05:58.651 --rc genhtml_legend=1 00:05:58.651 --rc geninfo_all_blocks=1 00:05:58.651 --rc geninfo_unexecuted_blocks=1 00:05:58.651 00:05:58.651 ' 00:05:58.651 16:41:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:58.651 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.651 --rc genhtml_branch_coverage=1 00:05:58.651 --rc genhtml_function_coverage=1 00:05:58.651 --rc genhtml_legend=1 00:05:58.651 --rc geninfo_all_blocks=1 00:05:58.651 --rc geninfo_unexecuted_blocks=1 00:05:58.651 00:05:58.651 ' 00:05:58.651 16:41:44 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:58.652 16:41:44 -- nvmf/common.sh@7 -- # uname -s 00:05:58.652 16:41:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:58.652 16:41:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:58.652 16:41:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:58.652 16:41:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:58.652 16:41:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:58.652 16:41:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:58.652 16:41:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:58.652 16:41:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:58.652 16:41:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:58.652 16:41:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:58.652 16:41:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:58.652 16:41:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:58.652 16:41:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:58.652 16:41:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:58.652 16:41:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:58.652 16:41:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:58.652 16:41:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:58.652 16:41:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:58.652 16:41:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:58.652 16:41:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:58.652 16:41:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:58.652 16:41:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:58.652 16:41:44 -- paths/export.sh@5 -- # export PATH 00:05:58.652 16:41:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:58.652 16:41:44 -- nvmf/common.sh@46 -- # : 0 00:05:58.652 16:41:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:58.652 16:41:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:58.652 16:41:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:58.652 16:41:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:58.652 16:41:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:58.652 16:41:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:58.652 16:41:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:58.652 16:41:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:58.652 INFO: launching applications... 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=1076053 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:58.652 Waiting for target to run... 00:05:58.652 16:41:44 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 1076053 /var/tmp/spdk_tgt.sock 00:05:58.652 16:41:44 -- common/autotest_common.sh@829 -- # '[' -z 1076053 ']' 00:05:58.652 16:41:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:58.652 16:41:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:58.652 16:41:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:58.652 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:58.652 16:41:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:58.652 16:41:44 -- common/autotest_common.sh@10 -- # set +x 00:05:58.652 [2024-11-16 16:41:44.114033] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:58.652 [2024-11-16 16:41:44.114118] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1076053 ] 00:05:58.652 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.911 [2024-11-16 16:41:44.446978] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.911 [2024-11-16 16:41:44.500532] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:58.911 [2024-11-16 16:41:44.500714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.477 16:41:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:59.477 16:41:45 -- common/autotest_common.sh@862 -- # return 0 00:05:59.477 16:41:45 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:59.477 00:05:59.477 16:41:45 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:59.477 INFO: shutting down applications... 00:05:59.477 16:41:45 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:59.477 16:41:45 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:59.477 16:41:45 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:59.477 16:41:45 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 1076053 ]] 00:05:59.477 16:41:45 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 1076053 00:05:59.477 16:41:45 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:59.477 16:41:45 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:59.477 16:41:45 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1076053 00:05:59.477 16:41:45 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:06:00.043 16:41:45 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:06:00.043 16:41:45 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:06:00.043 16:41:45 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1076053 00:06:00.043 16:41:45 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:06:00.043 16:41:45 -- json_config/json_config_extra_key.sh@52 -- # break 00:06:00.043 16:41:45 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:06:00.043 16:41:45 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:06:00.043 SPDK target shutdown done 00:06:00.043 16:41:45 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:06:00.043 Success 00:06:00.043 00:06:00.043 real 0m1.638s 00:06:00.043 user 0m1.590s 00:06:00.043 sys 0m0.443s 00:06:00.043 16:41:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.043 16:41:45 -- common/autotest_common.sh@10 -- # set +x 00:06:00.043 ************************************ 00:06:00.043 END TEST json_config_extra_key 00:06:00.043 ************************************ 00:06:00.043 16:41:45 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:00.043 16:41:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:00.043 16:41:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.043 16:41:45 -- common/autotest_common.sh@10 -- # set +x 00:06:00.043 ************************************ 00:06:00.043 START TEST alias_rpc 00:06:00.043 ************************************ 00:06:00.043 16:41:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:00.043 * Looking for test storage... 00:06:00.043 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:06:00.043 16:41:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:00.043 16:41:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:00.043 16:41:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:00.043 16:41:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:00.043 16:41:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:00.043 16:41:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:00.043 16:41:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:00.043 16:41:45 -- scripts/common.sh@335 -- # IFS=.-: 00:06:00.043 16:41:45 -- scripts/common.sh@335 -- # read -ra ver1 00:06:00.043 16:41:45 -- scripts/common.sh@336 -- # IFS=.-: 00:06:00.043 16:41:45 -- scripts/common.sh@336 -- # read -ra ver2 00:06:00.043 16:41:45 -- scripts/common.sh@337 -- # local 'op=<' 00:06:00.043 16:41:45 -- scripts/common.sh@339 -- # ver1_l=2 00:06:00.043 16:41:45 -- scripts/common.sh@340 -- # ver2_l=1 00:06:00.043 16:41:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:00.043 16:41:45 -- scripts/common.sh@343 -- # case "$op" in 00:06:00.043 16:41:45 -- scripts/common.sh@344 -- # : 1 00:06:00.043 16:41:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:00.043 16:41:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:00.043 16:41:45 -- scripts/common.sh@364 -- # decimal 1 00:06:00.043 16:41:45 -- scripts/common.sh@352 -- # local d=1 00:06:00.043 16:41:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:00.043 16:41:45 -- scripts/common.sh@354 -- # echo 1 00:06:00.043 16:41:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:00.043 16:41:45 -- scripts/common.sh@365 -- # decimal 2 00:06:00.043 16:41:45 -- scripts/common.sh@352 -- # local d=2 00:06:00.043 16:41:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:00.043 16:41:45 -- scripts/common.sh@354 -- # echo 2 00:06:00.043 16:41:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:00.043 16:41:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:00.043 16:41:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:00.043 16:41:45 -- scripts/common.sh@367 -- # return 0 00:06:00.043 16:41:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:00.043 16:41:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:00.043 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.043 --rc genhtml_branch_coverage=1 00:06:00.043 --rc genhtml_function_coverage=1 00:06:00.043 --rc genhtml_legend=1 00:06:00.043 --rc geninfo_all_blocks=1 00:06:00.043 --rc geninfo_unexecuted_blocks=1 00:06:00.043 00:06:00.043 ' 00:06:00.043 16:41:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:00.043 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.043 --rc genhtml_branch_coverage=1 00:06:00.043 --rc genhtml_function_coverage=1 00:06:00.043 --rc genhtml_legend=1 00:06:00.043 --rc geninfo_all_blocks=1 00:06:00.044 --rc geninfo_unexecuted_blocks=1 00:06:00.044 00:06:00.044 ' 00:06:00.044 16:41:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:00.044 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.044 --rc genhtml_branch_coverage=1 00:06:00.044 --rc genhtml_function_coverage=1 00:06:00.044 --rc genhtml_legend=1 00:06:00.044 --rc geninfo_all_blocks=1 00:06:00.044 --rc geninfo_unexecuted_blocks=1 00:06:00.044 00:06:00.044 ' 00:06:00.044 16:41:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:00.044 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.044 --rc genhtml_branch_coverage=1 00:06:00.044 --rc genhtml_function_coverage=1 00:06:00.044 --rc genhtml_legend=1 00:06:00.044 --rc geninfo_all_blocks=1 00:06:00.044 --rc geninfo_unexecuted_blocks=1 00:06:00.044 00:06:00.044 ' 00:06:00.044 16:41:45 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:00.044 16:41:45 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1076253 00:06:00.044 16:41:45 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:00.044 16:41:45 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1076253 00:06:00.044 16:41:45 -- common/autotest_common.sh@829 -- # '[' -z 1076253 ']' 00:06:00.044 16:41:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:00.044 16:41:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:00.044 16:41:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:00.044 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:00.044 16:41:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:00.044 16:41:45 -- common/autotest_common.sh@10 -- # set +x 00:06:00.044 [2024-11-16 16:41:45.788582] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:00.044 [2024-11-16 16:41:45.788709] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1076253 ] 00:06:00.302 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.302 [2024-11-16 16:41:45.847540] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.302 [2024-11-16 16:41:45.933877] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:00.302 [2024-11-16 16:41:45.934048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.235 16:41:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:01.235 16:41:46 -- common/autotest_common.sh@862 -- # return 0 00:06:01.235 16:41:46 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:06:01.493 16:41:47 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1076253 00:06:01.493 16:41:47 -- common/autotest_common.sh@936 -- # '[' -z 1076253 ']' 00:06:01.493 16:41:47 -- common/autotest_common.sh@940 -- # kill -0 1076253 00:06:01.493 16:41:47 -- common/autotest_common.sh@941 -- # uname 00:06:01.493 16:41:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:01.493 16:41:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1076253 00:06:01.493 16:41:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:01.493 16:41:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:01.493 16:41:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1076253' 00:06:01.493 killing process with pid 1076253 00:06:01.493 16:41:47 -- common/autotest_common.sh@955 -- # kill 1076253 00:06:01.493 16:41:47 -- common/autotest_common.sh@960 -- # wait 1076253 00:06:01.752 00:06:01.752 real 0m1.844s 00:06:01.752 user 0m2.145s 00:06:01.752 sys 0m0.467s 00:06:01.752 16:41:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:01.752 16:41:47 -- common/autotest_common.sh@10 -- # set +x 00:06:01.752 ************************************ 00:06:01.752 END TEST alias_rpc 00:06:01.752 ************************************ 00:06:01.752 16:41:47 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:06:01.752 16:41:47 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:01.752 16:41:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:01.752 16:41:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.752 16:41:47 -- common/autotest_common.sh@10 -- # set +x 00:06:01.752 ************************************ 00:06:01.752 START TEST spdkcli_tcp 00:06:01.752 ************************************ 00:06:01.752 16:41:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:02.010 * Looking for test storage... 00:06:02.010 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:06:02.010 16:41:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:02.010 16:41:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:02.010 16:41:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:02.010 16:41:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:02.010 16:41:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:02.010 16:41:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:02.010 16:41:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:02.010 16:41:47 -- scripts/common.sh@335 -- # IFS=.-: 00:06:02.010 16:41:47 -- scripts/common.sh@335 -- # read -ra ver1 00:06:02.010 16:41:47 -- scripts/common.sh@336 -- # IFS=.-: 00:06:02.010 16:41:47 -- scripts/common.sh@336 -- # read -ra ver2 00:06:02.010 16:41:47 -- scripts/common.sh@337 -- # local 'op=<' 00:06:02.010 16:41:47 -- scripts/common.sh@339 -- # ver1_l=2 00:06:02.010 16:41:47 -- scripts/common.sh@340 -- # ver2_l=1 00:06:02.010 16:41:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:02.010 16:41:47 -- scripts/common.sh@343 -- # case "$op" in 00:06:02.010 16:41:47 -- scripts/common.sh@344 -- # : 1 00:06:02.010 16:41:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:02.010 16:41:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:02.010 16:41:47 -- scripts/common.sh@364 -- # decimal 1 00:06:02.010 16:41:47 -- scripts/common.sh@352 -- # local d=1 00:06:02.010 16:41:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:02.010 16:41:47 -- scripts/common.sh@354 -- # echo 1 00:06:02.010 16:41:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:02.010 16:41:47 -- scripts/common.sh@365 -- # decimal 2 00:06:02.010 16:41:47 -- scripts/common.sh@352 -- # local d=2 00:06:02.010 16:41:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:02.010 16:41:47 -- scripts/common.sh@354 -- # echo 2 00:06:02.010 16:41:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:02.010 16:41:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:02.010 16:41:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:02.010 16:41:47 -- scripts/common.sh@367 -- # return 0 00:06:02.010 16:41:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:02.010 16:41:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:02.010 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:02.010 --rc genhtml_branch_coverage=1 00:06:02.010 --rc genhtml_function_coverage=1 00:06:02.010 --rc genhtml_legend=1 00:06:02.010 --rc geninfo_all_blocks=1 00:06:02.010 --rc geninfo_unexecuted_blocks=1 00:06:02.010 00:06:02.010 ' 00:06:02.010 16:41:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:02.010 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:02.010 --rc genhtml_branch_coverage=1 00:06:02.010 --rc genhtml_function_coverage=1 00:06:02.010 --rc genhtml_legend=1 00:06:02.010 --rc geninfo_all_blocks=1 00:06:02.010 --rc geninfo_unexecuted_blocks=1 00:06:02.010 00:06:02.010 ' 00:06:02.010 16:41:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:02.010 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:02.010 --rc genhtml_branch_coverage=1 00:06:02.010 --rc genhtml_function_coverage=1 00:06:02.010 --rc genhtml_legend=1 00:06:02.010 --rc geninfo_all_blocks=1 00:06:02.010 --rc geninfo_unexecuted_blocks=1 00:06:02.010 00:06:02.010 ' 00:06:02.010 16:41:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:02.010 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:02.010 --rc genhtml_branch_coverage=1 00:06:02.010 --rc genhtml_function_coverage=1 00:06:02.010 --rc genhtml_legend=1 00:06:02.010 --rc geninfo_all_blocks=1 00:06:02.010 --rc geninfo_unexecuted_blocks=1 00:06:02.010 00:06:02.010 ' 00:06:02.010 16:41:47 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:06:02.010 16:41:47 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:06:02.010 16:41:47 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:06:02.010 16:41:47 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:06:02.010 16:41:47 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:06:02.010 16:41:47 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:06:02.010 16:41:47 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:06:02.010 16:41:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:02.010 16:41:47 -- common/autotest_common.sh@10 -- # set +x 00:06:02.010 16:41:47 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1076578 00:06:02.010 16:41:47 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:06:02.010 16:41:47 -- spdkcli/tcp.sh@27 -- # waitforlisten 1076578 00:06:02.010 16:41:47 -- common/autotest_common.sh@829 -- # '[' -z 1076578 ']' 00:06:02.010 16:41:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:02.010 16:41:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:02.010 16:41:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:02.010 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:02.010 16:41:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:02.010 16:41:47 -- common/autotest_common.sh@10 -- # set +x 00:06:02.010 [2024-11-16 16:41:47.658407] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:02.010 [2024-11-16 16:41:47.658494] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1076578 ] 00:06:02.010 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.010 [2024-11-16 16:41:47.715609] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:02.268 [2024-11-16 16:41:47.803018] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:02.268 [2024-11-16 16:41:47.803213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:02.268 [2024-11-16 16:41:47.803218] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.202 16:41:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:03.202 16:41:48 -- common/autotest_common.sh@862 -- # return 0 00:06:03.202 16:41:48 -- spdkcli/tcp.sh@31 -- # socat_pid=1076719 00:06:03.202 16:41:48 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:06:03.202 16:41:48 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:06:03.202 [ 00:06:03.202 "bdev_malloc_delete", 00:06:03.202 "bdev_malloc_create", 00:06:03.202 "bdev_null_resize", 00:06:03.202 "bdev_null_delete", 00:06:03.202 "bdev_null_create", 00:06:03.202 "bdev_nvme_cuse_unregister", 00:06:03.202 "bdev_nvme_cuse_register", 00:06:03.202 "bdev_opal_new_user", 00:06:03.202 "bdev_opal_set_lock_state", 00:06:03.202 "bdev_opal_delete", 00:06:03.202 "bdev_opal_get_info", 00:06:03.202 "bdev_opal_create", 00:06:03.202 "bdev_nvme_opal_revert", 00:06:03.202 "bdev_nvme_opal_init", 00:06:03.202 "bdev_nvme_send_cmd", 00:06:03.202 "bdev_nvme_get_path_iostat", 00:06:03.202 "bdev_nvme_get_mdns_discovery_info", 00:06:03.202 "bdev_nvme_stop_mdns_discovery", 00:06:03.202 "bdev_nvme_start_mdns_discovery", 00:06:03.202 "bdev_nvme_set_multipath_policy", 00:06:03.202 "bdev_nvme_set_preferred_path", 00:06:03.202 "bdev_nvme_get_io_paths", 00:06:03.202 "bdev_nvme_remove_error_injection", 00:06:03.202 "bdev_nvme_add_error_injection", 00:06:03.202 "bdev_nvme_get_discovery_info", 00:06:03.202 "bdev_nvme_stop_discovery", 00:06:03.202 "bdev_nvme_start_discovery", 00:06:03.202 "bdev_nvme_get_controller_health_info", 00:06:03.202 "bdev_nvme_disable_controller", 00:06:03.202 "bdev_nvme_enable_controller", 00:06:03.202 "bdev_nvme_reset_controller", 00:06:03.202 "bdev_nvme_get_transport_statistics", 00:06:03.202 "bdev_nvme_apply_firmware", 00:06:03.202 "bdev_nvme_detach_controller", 00:06:03.202 "bdev_nvme_get_controllers", 00:06:03.202 "bdev_nvme_attach_controller", 00:06:03.202 "bdev_nvme_set_hotplug", 00:06:03.202 "bdev_nvme_set_options", 00:06:03.202 "bdev_passthru_delete", 00:06:03.202 "bdev_passthru_create", 00:06:03.202 "bdev_lvol_grow_lvstore", 00:06:03.202 "bdev_lvol_get_lvols", 00:06:03.202 "bdev_lvol_get_lvstores", 00:06:03.202 "bdev_lvol_delete", 00:06:03.202 "bdev_lvol_set_read_only", 00:06:03.202 "bdev_lvol_resize", 00:06:03.202 "bdev_lvol_decouple_parent", 00:06:03.202 "bdev_lvol_inflate", 00:06:03.202 "bdev_lvol_rename", 00:06:03.202 "bdev_lvol_clone_bdev", 00:06:03.202 "bdev_lvol_clone", 00:06:03.202 "bdev_lvol_snapshot", 00:06:03.202 "bdev_lvol_create", 00:06:03.202 "bdev_lvol_delete_lvstore", 00:06:03.202 "bdev_lvol_rename_lvstore", 00:06:03.202 "bdev_lvol_create_lvstore", 00:06:03.202 "bdev_raid_set_options", 00:06:03.202 "bdev_raid_remove_base_bdev", 00:06:03.202 "bdev_raid_add_base_bdev", 00:06:03.202 "bdev_raid_delete", 00:06:03.202 "bdev_raid_create", 00:06:03.202 "bdev_raid_get_bdevs", 00:06:03.202 "bdev_error_inject_error", 00:06:03.202 "bdev_error_delete", 00:06:03.202 "bdev_error_create", 00:06:03.202 "bdev_split_delete", 00:06:03.202 "bdev_split_create", 00:06:03.202 "bdev_delay_delete", 00:06:03.202 "bdev_delay_create", 00:06:03.202 "bdev_delay_update_latency", 00:06:03.202 "bdev_zone_block_delete", 00:06:03.202 "bdev_zone_block_create", 00:06:03.202 "blobfs_create", 00:06:03.202 "blobfs_detect", 00:06:03.202 "blobfs_set_cache_size", 00:06:03.202 "bdev_aio_delete", 00:06:03.202 "bdev_aio_rescan", 00:06:03.202 "bdev_aio_create", 00:06:03.202 "bdev_ftl_set_property", 00:06:03.202 "bdev_ftl_get_properties", 00:06:03.202 "bdev_ftl_get_stats", 00:06:03.202 "bdev_ftl_unmap", 00:06:03.202 "bdev_ftl_unload", 00:06:03.202 "bdev_ftl_delete", 00:06:03.202 "bdev_ftl_load", 00:06:03.202 "bdev_ftl_create", 00:06:03.202 "bdev_virtio_attach_controller", 00:06:03.202 "bdev_virtio_scsi_get_devices", 00:06:03.202 "bdev_virtio_detach_controller", 00:06:03.202 "bdev_virtio_blk_set_hotplug", 00:06:03.202 "bdev_iscsi_delete", 00:06:03.202 "bdev_iscsi_create", 00:06:03.202 "bdev_iscsi_set_options", 00:06:03.202 "accel_error_inject_error", 00:06:03.202 "ioat_scan_accel_module", 00:06:03.202 "dsa_scan_accel_module", 00:06:03.202 "iaa_scan_accel_module", 00:06:03.202 "vfu_virtio_create_scsi_endpoint", 00:06:03.202 "vfu_virtio_scsi_remove_target", 00:06:03.202 "vfu_virtio_scsi_add_target", 00:06:03.202 "vfu_virtio_create_blk_endpoint", 00:06:03.202 "vfu_virtio_delete_endpoint", 00:06:03.202 "iscsi_set_options", 00:06:03.202 "iscsi_get_auth_groups", 00:06:03.202 "iscsi_auth_group_remove_secret", 00:06:03.202 "iscsi_auth_group_add_secret", 00:06:03.202 "iscsi_delete_auth_group", 00:06:03.202 "iscsi_create_auth_group", 00:06:03.202 "iscsi_set_discovery_auth", 00:06:03.202 "iscsi_get_options", 00:06:03.202 "iscsi_target_node_request_logout", 00:06:03.202 "iscsi_target_node_set_redirect", 00:06:03.202 "iscsi_target_node_set_auth", 00:06:03.202 "iscsi_target_node_add_lun", 00:06:03.202 "iscsi_get_connections", 00:06:03.202 "iscsi_portal_group_set_auth", 00:06:03.202 "iscsi_start_portal_group", 00:06:03.202 "iscsi_delete_portal_group", 00:06:03.202 "iscsi_create_portal_group", 00:06:03.202 "iscsi_get_portal_groups", 00:06:03.202 "iscsi_delete_target_node", 00:06:03.203 "iscsi_target_node_remove_pg_ig_maps", 00:06:03.203 "iscsi_target_node_add_pg_ig_maps", 00:06:03.203 "iscsi_create_target_node", 00:06:03.203 "iscsi_get_target_nodes", 00:06:03.203 "iscsi_delete_initiator_group", 00:06:03.203 "iscsi_initiator_group_remove_initiators", 00:06:03.203 "iscsi_initiator_group_add_initiators", 00:06:03.203 "iscsi_create_initiator_group", 00:06:03.203 "iscsi_get_initiator_groups", 00:06:03.203 "nvmf_set_crdt", 00:06:03.203 "nvmf_set_config", 00:06:03.203 "nvmf_set_max_subsystems", 00:06:03.203 "nvmf_subsystem_get_listeners", 00:06:03.203 "nvmf_subsystem_get_qpairs", 00:06:03.203 "nvmf_subsystem_get_controllers", 00:06:03.203 "nvmf_get_stats", 00:06:03.203 "nvmf_get_transports", 00:06:03.203 "nvmf_create_transport", 00:06:03.203 "nvmf_get_targets", 00:06:03.203 "nvmf_delete_target", 00:06:03.203 "nvmf_create_target", 00:06:03.203 "nvmf_subsystem_allow_any_host", 00:06:03.203 "nvmf_subsystem_remove_host", 00:06:03.203 "nvmf_subsystem_add_host", 00:06:03.203 "nvmf_subsystem_remove_ns", 00:06:03.203 "nvmf_subsystem_add_ns", 00:06:03.203 "nvmf_subsystem_listener_set_ana_state", 00:06:03.203 "nvmf_discovery_get_referrals", 00:06:03.203 "nvmf_discovery_remove_referral", 00:06:03.203 "nvmf_discovery_add_referral", 00:06:03.203 "nvmf_subsystem_remove_listener", 00:06:03.203 "nvmf_subsystem_add_listener", 00:06:03.203 "nvmf_delete_subsystem", 00:06:03.203 "nvmf_create_subsystem", 00:06:03.203 "nvmf_get_subsystems", 00:06:03.203 "env_dpdk_get_mem_stats", 00:06:03.203 "nbd_get_disks", 00:06:03.203 "nbd_stop_disk", 00:06:03.203 "nbd_start_disk", 00:06:03.203 "ublk_recover_disk", 00:06:03.203 "ublk_get_disks", 00:06:03.203 "ublk_stop_disk", 00:06:03.203 "ublk_start_disk", 00:06:03.203 "ublk_destroy_target", 00:06:03.203 "ublk_create_target", 00:06:03.203 "virtio_blk_create_transport", 00:06:03.203 "virtio_blk_get_transports", 00:06:03.203 "vhost_controller_set_coalescing", 00:06:03.203 "vhost_get_controllers", 00:06:03.203 "vhost_delete_controller", 00:06:03.203 "vhost_create_blk_controller", 00:06:03.203 "vhost_scsi_controller_remove_target", 00:06:03.203 "vhost_scsi_controller_add_target", 00:06:03.203 "vhost_start_scsi_controller", 00:06:03.203 "vhost_create_scsi_controller", 00:06:03.203 "thread_set_cpumask", 00:06:03.203 "framework_get_scheduler", 00:06:03.203 "framework_set_scheduler", 00:06:03.203 "framework_get_reactors", 00:06:03.203 "thread_get_io_channels", 00:06:03.203 "thread_get_pollers", 00:06:03.203 "thread_get_stats", 00:06:03.203 "framework_monitor_context_switch", 00:06:03.203 "spdk_kill_instance", 00:06:03.203 "log_enable_timestamps", 00:06:03.203 "log_get_flags", 00:06:03.203 "log_clear_flag", 00:06:03.203 "log_set_flag", 00:06:03.203 "log_get_level", 00:06:03.203 "log_set_level", 00:06:03.203 "log_get_print_level", 00:06:03.203 "log_set_print_level", 00:06:03.203 "framework_enable_cpumask_locks", 00:06:03.203 "framework_disable_cpumask_locks", 00:06:03.203 "framework_wait_init", 00:06:03.203 "framework_start_init", 00:06:03.203 "scsi_get_devices", 00:06:03.203 "bdev_get_histogram", 00:06:03.203 "bdev_enable_histogram", 00:06:03.203 "bdev_set_qos_limit", 00:06:03.203 "bdev_set_qd_sampling_period", 00:06:03.203 "bdev_get_bdevs", 00:06:03.203 "bdev_reset_iostat", 00:06:03.203 "bdev_get_iostat", 00:06:03.203 "bdev_examine", 00:06:03.203 "bdev_wait_for_examine", 00:06:03.203 "bdev_set_options", 00:06:03.203 "notify_get_notifications", 00:06:03.203 "notify_get_types", 00:06:03.203 "accel_get_stats", 00:06:03.203 "accel_set_options", 00:06:03.203 "accel_set_driver", 00:06:03.203 "accel_crypto_key_destroy", 00:06:03.203 "accel_crypto_keys_get", 00:06:03.203 "accel_crypto_key_create", 00:06:03.203 "accel_assign_opc", 00:06:03.203 "accel_get_module_info", 00:06:03.203 "accel_get_opc_assignments", 00:06:03.203 "vmd_rescan", 00:06:03.203 "vmd_remove_device", 00:06:03.203 "vmd_enable", 00:06:03.203 "sock_set_default_impl", 00:06:03.203 "sock_impl_set_options", 00:06:03.203 "sock_impl_get_options", 00:06:03.203 "iobuf_get_stats", 00:06:03.203 "iobuf_set_options", 00:06:03.203 "framework_get_pci_devices", 00:06:03.203 "framework_get_config", 00:06:03.203 "framework_get_subsystems", 00:06:03.203 "vfu_tgt_set_base_path", 00:06:03.203 "trace_get_info", 00:06:03.203 "trace_get_tpoint_group_mask", 00:06:03.203 "trace_disable_tpoint_group", 00:06:03.203 "trace_enable_tpoint_group", 00:06:03.203 "trace_clear_tpoint_mask", 00:06:03.203 "trace_set_tpoint_mask", 00:06:03.203 "spdk_get_version", 00:06:03.203 "rpc_get_methods" 00:06:03.203 ] 00:06:03.203 16:41:48 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:06:03.203 16:41:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:03.203 16:41:48 -- common/autotest_common.sh@10 -- # set +x 00:06:03.203 16:41:48 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:06:03.203 16:41:48 -- spdkcli/tcp.sh@38 -- # killprocess 1076578 00:06:03.203 16:41:48 -- common/autotest_common.sh@936 -- # '[' -z 1076578 ']' 00:06:03.203 16:41:48 -- common/autotest_common.sh@940 -- # kill -0 1076578 00:06:03.203 16:41:48 -- common/autotest_common.sh@941 -- # uname 00:06:03.203 16:41:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:03.203 16:41:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1076578 00:06:03.203 16:41:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:03.203 16:41:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:03.203 16:41:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1076578' 00:06:03.203 killing process with pid 1076578 00:06:03.203 16:41:48 -- common/autotest_common.sh@955 -- # kill 1076578 00:06:03.203 16:41:48 -- common/autotest_common.sh@960 -- # wait 1076578 00:06:03.768 00:06:03.768 real 0m1.849s 00:06:03.768 user 0m3.567s 00:06:03.768 sys 0m0.505s 00:06:03.768 16:41:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:03.768 16:41:49 -- common/autotest_common.sh@10 -- # set +x 00:06:03.768 ************************************ 00:06:03.768 END TEST spdkcli_tcp 00:06:03.768 ************************************ 00:06:03.768 16:41:49 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:03.768 16:41:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:03.768 16:41:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.768 16:41:49 -- common/autotest_common.sh@10 -- # set +x 00:06:03.768 ************************************ 00:06:03.768 START TEST dpdk_mem_utility 00:06:03.768 ************************************ 00:06:03.768 16:41:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:03.768 * Looking for test storage... 00:06:03.768 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:06:03.768 16:41:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:03.768 16:41:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:03.768 16:41:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:03.768 16:41:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:03.768 16:41:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:03.768 16:41:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:03.768 16:41:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:03.768 16:41:49 -- scripts/common.sh@335 -- # IFS=.-: 00:06:03.768 16:41:49 -- scripts/common.sh@335 -- # read -ra ver1 00:06:03.768 16:41:49 -- scripts/common.sh@336 -- # IFS=.-: 00:06:03.768 16:41:49 -- scripts/common.sh@336 -- # read -ra ver2 00:06:03.768 16:41:49 -- scripts/common.sh@337 -- # local 'op=<' 00:06:03.768 16:41:49 -- scripts/common.sh@339 -- # ver1_l=2 00:06:03.768 16:41:49 -- scripts/common.sh@340 -- # ver2_l=1 00:06:03.768 16:41:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:03.768 16:41:49 -- scripts/common.sh@343 -- # case "$op" in 00:06:03.768 16:41:49 -- scripts/common.sh@344 -- # : 1 00:06:03.768 16:41:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:03.768 16:41:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:03.768 16:41:49 -- scripts/common.sh@364 -- # decimal 1 00:06:03.769 16:41:49 -- scripts/common.sh@352 -- # local d=1 00:06:03.769 16:41:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:03.769 16:41:49 -- scripts/common.sh@354 -- # echo 1 00:06:03.769 16:41:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:03.769 16:41:49 -- scripts/common.sh@365 -- # decimal 2 00:06:03.769 16:41:49 -- scripts/common.sh@352 -- # local d=2 00:06:03.769 16:41:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:03.769 16:41:49 -- scripts/common.sh@354 -- # echo 2 00:06:03.769 16:41:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:03.769 16:41:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:03.769 16:41:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:03.769 16:41:49 -- scripts/common.sh@367 -- # return 0 00:06:03.769 16:41:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:03.769 16:41:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:03.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.769 --rc genhtml_branch_coverage=1 00:06:03.769 --rc genhtml_function_coverage=1 00:06:03.769 --rc genhtml_legend=1 00:06:03.769 --rc geninfo_all_blocks=1 00:06:03.769 --rc geninfo_unexecuted_blocks=1 00:06:03.769 00:06:03.769 ' 00:06:03.769 16:41:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:03.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.769 --rc genhtml_branch_coverage=1 00:06:03.769 --rc genhtml_function_coverage=1 00:06:03.769 --rc genhtml_legend=1 00:06:03.769 --rc geninfo_all_blocks=1 00:06:03.769 --rc geninfo_unexecuted_blocks=1 00:06:03.769 00:06:03.769 ' 00:06:03.769 16:41:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:03.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.769 --rc genhtml_branch_coverage=1 00:06:03.769 --rc genhtml_function_coverage=1 00:06:03.769 --rc genhtml_legend=1 00:06:03.769 --rc geninfo_all_blocks=1 00:06:03.769 --rc geninfo_unexecuted_blocks=1 00:06:03.769 00:06:03.769 ' 00:06:03.769 16:41:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:03.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.769 --rc genhtml_branch_coverage=1 00:06:03.769 --rc genhtml_function_coverage=1 00:06:03.769 --rc genhtml_legend=1 00:06:03.769 --rc geninfo_all_blocks=1 00:06:03.769 --rc geninfo_unexecuted_blocks=1 00:06:03.769 00:06:03.769 ' 00:06:03.769 16:41:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:03.769 16:41:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1076924 00:06:03.769 16:41:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:03.769 16:41:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1076924 00:06:03.769 16:41:49 -- common/autotest_common.sh@829 -- # '[' -z 1076924 ']' 00:06:03.769 16:41:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:03.769 16:41:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:03.769 16:41:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:03.769 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:03.769 16:41:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:03.769 16:41:49 -- common/autotest_common.sh@10 -- # set +x 00:06:03.769 [2024-11-16 16:41:49.516678] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:03.769 [2024-11-16 16:41:49.516775] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1076924 ] 00:06:04.027 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.027 [2024-11-16 16:41:49.573124] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.028 [2024-11-16 16:41:49.652130] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:04.028 [2024-11-16 16:41:49.652299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.966 16:41:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:04.966 16:41:50 -- common/autotest_common.sh@862 -- # return 0 00:06:04.966 16:41:50 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:06:04.966 16:41:50 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:06:04.966 16:41:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.966 16:41:50 -- common/autotest_common.sh@10 -- # set +x 00:06:04.966 { 00:06:04.966 "filename": "/tmp/spdk_mem_dump.txt" 00:06:04.966 } 00:06:04.966 16:41:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.966 16:41:50 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:04.966 DPDK memory size 814.000000 MiB in 1 heap(s) 00:06:04.966 1 heaps totaling size 814.000000 MiB 00:06:04.966 size: 814.000000 MiB heap id: 0 00:06:04.966 end heaps---------- 00:06:04.966 8 mempools totaling size 598.116089 MiB 00:06:04.966 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:06:04.966 size: 158.602051 MiB name: PDU_data_out_Pool 00:06:04.966 size: 84.521057 MiB name: bdev_io_1076924 00:06:04.966 size: 51.011292 MiB name: evtpool_1076924 00:06:04.966 size: 50.003479 MiB name: msgpool_1076924 00:06:04.966 size: 21.763794 MiB name: PDU_Pool 00:06:04.966 size: 19.513306 MiB name: SCSI_TASK_Pool 00:06:04.966 size: 0.026123 MiB name: Session_Pool 00:06:04.966 end mempools------- 00:06:04.966 6 memzones totaling size 4.142822 MiB 00:06:04.966 size: 1.000366 MiB name: RG_ring_0_1076924 00:06:04.966 size: 1.000366 MiB name: RG_ring_1_1076924 00:06:04.966 size: 1.000366 MiB name: RG_ring_4_1076924 00:06:04.966 size: 1.000366 MiB name: RG_ring_5_1076924 00:06:04.966 size: 0.125366 MiB name: RG_ring_2_1076924 00:06:04.966 size: 0.015991 MiB name: RG_ring_3_1076924 00:06:04.966 end memzones------- 00:06:04.966 16:41:50 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:06:04.966 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:06:04.966 list of free elements. size: 12.519348 MiB 00:06:04.966 element at address: 0x200000400000 with size: 1.999512 MiB 00:06:04.966 element at address: 0x200018e00000 with size: 0.999878 MiB 00:06:04.966 element at address: 0x200019000000 with size: 0.999878 MiB 00:06:04.966 element at address: 0x200003e00000 with size: 0.996277 MiB 00:06:04.966 element at address: 0x200031c00000 with size: 0.994446 MiB 00:06:04.966 element at address: 0x200013800000 with size: 0.978699 MiB 00:06:04.966 element at address: 0x200007000000 with size: 0.959839 MiB 00:06:04.966 element at address: 0x200019200000 with size: 0.936584 MiB 00:06:04.966 element at address: 0x200000200000 with size: 0.841614 MiB 00:06:04.966 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:06:04.966 element at address: 0x20000b200000 with size: 0.490723 MiB 00:06:04.966 element at address: 0x200000800000 with size: 0.487793 MiB 00:06:04.966 element at address: 0x200019400000 with size: 0.485657 MiB 00:06:04.966 element at address: 0x200027e00000 with size: 0.410034 MiB 00:06:04.966 element at address: 0x200003a00000 with size: 0.355530 MiB 00:06:04.966 list of standard malloc elements. size: 199.218079 MiB 00:06:04.966 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:06:04.966 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:06:04.966 element at address: 0x200018efff80 with size: 1.000122 MiB 00:06:04.966 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:06:04.966 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:06:04.966 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:06:04.966 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:06:04.966 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:06:04.966 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:06:04.966 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:06:04.967 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:06:04.967 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:06:04.967 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:06:04.967 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:06:04.967 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:06:04.967 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:06:04.967 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:06:04.967 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:06:04.967 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:06:04.967 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:06:04.967 element at address: 0x200003adb300 with size: 0.000183 MiB 00:06:04.967 element at address: 0x200003adb500 with size: 0.000183 MiB 00:06:04.967 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:06:04.967 element at address: 0x200003affa80 with size: 0.000183 MiB 00:06:04.967 element at address: 0x200003affb40 with size: 0.000183 MiB 00:06:04.967 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:06:04.967 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:06:04.967 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:06:04.967 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:06:04.967 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:06:04.967 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:06:04.967 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:06:04.967 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:06:04.967 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:06:04.967 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:06:04.967 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:06:04.967 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:06:04.967 element at address: 0x200027e69040 with size: 0.000183 MiB 00:06:04.967 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:06:04.967 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:06:04.967 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:06:04.967 list of memzone associated elements. size: 602.262573 MiB 00:06:04.967 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:06:04.967 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:06:04.967 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:06:04.967 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:06:04.967 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:06:04.967 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1076924_0 00:06:04.967 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:06:04.967 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1076924_0 00:06:04.967 element at address: 0x200003fff380 with size: 48.003052 MiB 00:06:04.967 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1076924_0 00:06:04.967 element at address: 0x2000195be940 with size: 20.255554 MiB 00:06:04.967 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:06:04.967 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:06:04.967 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:06:04.967 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:06:04.967 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1076924 00:06:04.967 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:06:04.967 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1076924 00:06:04.967 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:06:04.967 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1076924 00:06:04.967 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:06:04.967 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:06:04.967 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:06:04.967 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:06:04.967 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:06:04.967 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:06:04.967 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:06:04.967 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:06:04.967 element at address: 0x200003eff180 with size: 1.000488 MiB 00:06:04.967 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1076924 00:06:04.967 element at address: 0x200003affc00 with size: 1.000488 MiB 00:06:04.967 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1076924 00:06:04.967 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:06:04.967 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1076924 00:06:04.967 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:06:04.967 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1076924 00:06:04.967 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:06:04.967 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1076924 00:06:04.967 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:06:04.967 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:06:04.967 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:06:04.967 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:06:04.967 element at address: 0x20001947c540 with size: 0.250488 MiB 00:06:04.967 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:06:04.967 element at address: 0x200003adf880 with size: 0.125488 MiB 00:06:04.967 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1076924 00:06:04.967 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:06:04.967 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:06:04.967 element at address: 0x200027e69100 with size: 0.023743 MiB 00:06:04.967 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:06:04.967 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:06:04.967 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1076924 00:06:04.967 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:06:04.967 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:06:04.967 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:06:04.967 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1076924 00:06:04.967 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:06:04.967 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1076924 00:06:04.967 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:06:04.967 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:06:04.967 16:41:50 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:06:04.967 16:41:50 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1076924 00:06:04.967 16:41:50 -- common/autotest_common.sh@936 -- # '[' -z 1076924 ']' 00:06:04.967 16:41:50 -- common/autotest_common.sh@940 -- # kill -0 1076924 00:06:04.967 16:41:50 -- common/autotest_common.sh@941 -- # uname 00:06:04.967 16:41:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:04.967 16:41:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1076924 00:06:04.967 16:41:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:04.967 16:41:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:04.967 16:41:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1076924' 00:06:04.967 killing process with pid 1076924 00:06:04.967 16:41:50 -- common/autotest_common.sh@955 -- # kill 1076924 00:06:04.967 16:41:50 -- common/autotest_common.sh@960 -- # wait 1076924 00:06:05.532 00:06:05.532 real 0m1.691s 00:06:05.532 user 0m1.885s 00:06:05.532 sys 0m0.438s 00:06:05.532 16:41:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:05.532 16:41:51 -- common/autotest_common.sh@10 -- # set +x 00:06:05.532 ************************************ 00:06:05.532 END TEST dpdk_mem_utility 00:06:05.532 ************************************ 00:06:05.532 16:41:51 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:05.532 16:41:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:05.532 16:41:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.532 16:41:51 -- common/autotest_common.sh@10 -- # set +x 00:06:05.532 ************************************ 00:06:05.532 START TEST event 00:06:05.532 ************************************ 00:06:05.532 16:41:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:05.532 * Looking for test storage... 00:06:05.532 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:05.532 16:41:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:05.532 16:41:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:05.532 16:41:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:05.532 16:41:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:05.532 16:41:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:05.532 16:41:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:05.532 16:41:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:05.532 16:41:51 -- scripts/common.sh@335 -- # IFS=.-: 00:06:05.532 16:41:51 -- scripts/common.sh@335 -- # read -ra ver1 00:06:05.532 16:41:51 -- scripts/common.sh@336 -- # IFS=.-: 00:06:05.532 16:41:51 -- scripts/common.sh@336 -- # read -ra ver2 00:06:05.532 16:41:51 -- scripts/common.sh@337 -- # local 'op=<' 00:06:05.532 16:41:51 -- scripts/common.sh@339 -- # ver1_l=2 00:06:05.532 16:41:51 -- scripts/common.sh@340 -- # ver2_l=1 00:06:05.532 16:41:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:05.532 16:41:51 -- scripts/common.sh@343 -- # case "$op" in 00:06:05.532 16:41:51 -- scripts/common.sh@344 -- # : 1 00:06:05.532 16:41:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:05.532 16:41:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:05.532 16:41:51 -- scripts/common.sh@364 -- # decimal 1 00:06:05.532 16:41:51 -- scripts/common.sh@352 -- # local d=1 00:06:05.532 16:41:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:05.532 16:41:51 -- scripts/common.sh@354 -- # echo 1 00:06:05.532 16:41:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:05.532 16:41:51 -- scripts/common.sh@365 -- # decimal 2 00:06:05.532 16:41:51 -- scripts/common.sh@352 -- # local d=2 00:06:05.532 16:41:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:05.532 16:41:51 -- scripts/common.sh@354 -- # echo 2 00:06:05.532 16:41:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:05.532 16:41:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:05.532 16:41:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:05.532 16:41:51 -- scripts/common.sh@367 -- # return 0 00:06:05.532 16:41:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:05.532 16:41:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:05.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.532 --rc genhtml_branch_coverage=1 00:06:05.532 --rc genhtml_function_coverage=1 00:06:05.532 --rc genhtml_legend=1 00:06:05.532 --rc geninfo_all_blocks=1 00:06:05.532 --rc geninfo_unexecuted_blocks=1 00:06:05.532 00:06:05.532 ' 00:06:05.532 16:41:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:05.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.532 --rc genhtml_branch_coverage=1 00:06:05.532 --rc genhtml_function_coverage=1 00:06:05.532 --rc genhtml_legend=1 00:06:05.532 --rc geninfo_all_blocks=1 00:06:05.533 --rc geninfo_unexecuted_blocks=1 00:06:05.533 00:06:05.533 ' 00:06:05.533 16:41:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:05.533 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.533 --rc genhtml_branch_coverage=1 00:06:05.533 --rc genhtml_function_coverage=1 00:06:05.533 --rc genhtml_legend=1 00:06:05.533 --rc geninfo_all_blocks=1 00:06:05.533 --rc geninfo_unexecuted_blocks=1 00:06:05.533 00:06:05.533 ' 00:06:05.533 16:41:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:05.533 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.533 --rc genhtml_branch_coverage=1 00:06:05.533 --rc genhtml_function_coverage=1 00:06:05.533 --rc genhtml_legend=1 00:06:05.533 --rc geninfo_all_blocks=1 00:06:05.533 --rc geninfo_unexecuted_blocks=1 00:06:05.533 00:06:05.533 ' 00:06:05.533 16:41:51 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:06:05.533 16:41:51 -- bdev/nbd_common.sh@6 -- # set -e 00:06:05.533 16:41:51 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:05.533 16:41:51 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:05.533 16:41:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.533 16:41:51 -- common/autotest_common.sh@10 -- # set +x 00:06:05.533 ************************************ 00:06:05.533 START TEST event_perf 00:06:05.533 ************************************ 00:06:05.533 16:41:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:05.533 Running I/O for 1 seconds...[2024-11-16 16:41:51.219503] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:05.533 [2024-11-16 16:41:51.219589] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1077129 ] 00:06:05.533 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.533 [2024-11-16 16:41:51.276505] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:05.792 [2024-11-16 16:41:51.359127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:05.792 [2024-11-16 16:41:51.359187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:05.792 [2024-11-16 16:41:51.359253] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:05.792 [2024-11-16 16:41:51.359255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.726 Running I/O for 1 seconds... 00:06:06.726 lcore 0: 228061 00:06:06.726 lcore 1: 228060 00:06:06.726 lcore 2: 228061 00:06:06.726 lcore 3: 228062 00:06:06.726 done. 00:06:06.726 00:06:06.726 real 0m1.231s 00:06:06.726 user 0m4.153s 00:06:06.726 sys 0m0.073s 00:06:06.726 16:41:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.726 16:41:52 -- common/autotest_common.sh@10 -- # set +x 00:06:06.726 ************************************ 00:06:06.726 END TEST event_perf 00:06:06.726 ************************************ 00:06:06.726 16:41:52 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:06.726 16:41:52 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:06.726 16:41:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.726 16:41:52 -- common/autotest_common.sh@10 -- # set +x 00:06:06.726 ************************************ 00:06:06.726 START TEST event_reactor 00:06:06.726 ************************************ 00:06:06.726 16:41:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:06.985 [2024-11-16 16:41:52.479861] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:06.985 [2024-11-16 16:41:52.479957] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1077286 ] 00:06:06.985 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.985 [2024-11-16 16:41:52.536719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.985 [2024-11-16 16:41:52.615622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.980 test_start 00:06:07.980 oneshot 00:06:07.980 tick 100 00:06:07.980 tick 100 00:06:07.980 tick 250 00:06:07.980 tick 100 00:06:07.980 tick 100 00:06:07.980 tick 250 00:06:07.980 tick 500 00:06:07.980 tick 100 00:06:07.980 tick 100 00:06:07.980 tick 100 00:06:07.980 tick 250 00:06:07.980 tick 100 00:06:07.980 tick 100 00:06:07.980 test_end 00:06:07.980 00:06:07.980 real 0m1.225s 00:06:07.980 user 0m1.148s 00:06:07.980 sys 0m0.072s 00:06:07.980 16:41:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:07.980 16:41:53 -- common/autotest_common.sh@10 -- # set +x 00:06:07.980 ************************************ 00:06:07.980 END TEST event_reactor 00:06:07.980 ************************************ 00:06:07.980 16:41:53 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:07.980 16:41:53 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:07.980 16:41:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.980 16:41:53 -- common/autotest_common.sh@10 -- # set +x 00:06:07.980 ************************************ 00:06:07.980 START TEST event_reactor_perf 00:06:07.980 ************************************ 00:06:07.980 16:41:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:08.238 [2024-11-16 16:41:53.731081] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:08.238 [2024-11-16 16:41:53.731171] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1077445 ] 00:06:08.238 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.238 [2024-11-16 16:41:53.788264] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.238 [2024-11-16 16:41:53.876555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.612 test_start 00:06:09.612 test_end 00:06:09.612 Performance: 445240 events per second 00:06:09.612 00:06:09.612 real 0m1.237s 00:06:09.612 user 0m1.150s 00:06:09.612 sys 0m0.082s 00:06:09.612 16:41:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:09.612 16:41:54 -- common/autotest_common.sh@10 -- # set +x 00:06:09.612 ************************************ 00:06:09.612 END TEST event_reactor_perf 00:06:09.612 ************************************ 00:06:09.612 16:41:54 -- event/event.sh@49 -- # uname -s 00:06:09.612 16:41:54 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:09.612 16:41:54 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:09.612 16:41:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:09.612 16:41:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.612 16:41:54 -- common/autotest_common.sh@10 -- # set +x 00:06:09.612 ************************************ 00:06:09.612 START TEST event_scheduler 00:06:09.612 ************************************ 00:06:09.612 16:41:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:09.612 * Looking for test storage... 00:06:09.612 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:06:09.612 16:41:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:09.612 16:41:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:09.612 16:41:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:09.612 16:41:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:09.612 16:41:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:09.612 16:41:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:09.612 16:41:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:09.612 16:41:55 -- scripts/common.sh@335 -- # IFS=.-: 00:06:09.612 16:41:55 -- scripts/common.sh@335 -- # read -ra ver1 00:06:09.612 16:41:55 -- scripts/common.sh@336 -- # IFS=.-: 00:06:09.612 16:41:55 -- scripts/common.sh@336 -- # read -ra ver2 00:06:09.612 16:41:55 -- scripts/common.sh@337 -- # local 'op=<' 00:06:09.612 16:41:55 -- scripts/common.sh@339 -- # ver1_l=2 00:06:09.612 16:41:55 -- scripts/common.sh@340 -- # ver2_l=1 00:06:09.612 16:41:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:09.612 16:41:55 -- scripts/common.sh@343 -- # case "$op" in 00:06:09.612 16:41:55 -- scripts/common.sh@344 -- # : 1 00:06:09.612 16:41:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:09.612 16:41:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:09.612 16:41:55 -- scripts/common.sh@364 -- # decimal 1 00:06:09.612 16:41:55 -- scripts/common.sh@352 -- # local d=1 00:06:09.612 16:41:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:09.612 16:41:55 -- scripts/common.sh@354 -- # echo 1 00:06:09.612 16:41:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:09.612 16:41:55 -- scripts/common.sh@365 -- # decimal 2 00:06:09.612 16:41:55 -- scripts/common.sh@352 -- # local d=2 00:06:09.612 16:41:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:09.612 16:41:55 -- scripts/common.sh@354 -- # echo 2 00:06:09.612 16:41:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:09.612 16:41:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:09.612 16:41:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:09.612 16:41:55 -- scripts/common.sh@367 -- # return 0 00:06:09.612 16:41:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:09.612 16:41:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:09.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.612 --rc genhtml_branch_coverage=1 00:06:09.612 --rc genhtml_function_coverage=1 00:06:09.612 --rc genhtml_legend=1 00:06:09.612 --rc geninfo_all_blocks=1 00:06:09.612 --rc geninfo_unexecuted_blocks=1 00:06:09.612 00:06:09.612 ' 00:06:09.612 16:41:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:09.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.612 --rc genhtml_branch_coverage=1 00:06:09.612 --rc genhtml_function_coverage=1 00:06:09.612 --rc genhtml_legend=1 00:06:09.612 --rc geninfo_all_blocks=1 00:06:09.612 --rc geninfo_unexecuted_blocks=1 00:06:09.612 00:06:09.612 ' 00:06:09.612 16:41:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:09.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.612 --rc genhtml_branch_coverage=1 00:06:09.612 --rc genhtml_function_coverage=1 00:06:09.612 --rc genhtml_legend=1 00:06:09.612 --rc geninfo_all_blocks=1 00:06:09.612 --rc geninfo_unexecuted_blocks=1 00:06:09.612 00:06:09.612 ' 00:06:09.612 16:41:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:09.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.612 --rc genhtml_branch_coverage=1 00:06:09.612 --rc genhtml_function_coverage=1 00:06:09.612 --rc genhtml_legend=1 00:06:09.612 --rc geninfo_all_blocks=1 00:06:09.612 --rc geninfo_unexecuted_blocks=1 00:06:09.612 00:06:09.612 ' 00:06:09.612 16:41:55 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:09.612 16:41:55 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1077768 00:06:09.612 16:41:55 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:09.612 16:41:55 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:09.612 16:41:55 -- scheduler/scheduler.sh@37 -- # waitforlisten 1077768 00:06:09.612 16:41:55 -- common/autotest_common.sh@829 -- # '[' -z 1077768 ']' 00:06:09.612 16:41:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:09.612 16:41:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:09.612 16:41:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:09.612 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:09.612 16:41:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:09.612 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:09.612 [2024-11-16 16:41:55.145792] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:09.612 [2024-11-16 16:41:55.145882] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1077768 ] 00:06:09.612 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.612 [2024-11-16 16:41:55.203000] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:09.612 [2024-11-16 16:41:55.285726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.612 [2024-11-16 16:41:55.285789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:09.613 [2024-11-16 16:41:55.285854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:09.613 [2024-11-16 16:41:55.285856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:09.613 16:41:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:09.613 16:41:55 -- common/autotest_common.sh@862 -- # return 0 00:06:09.613 16:41:55 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:09.613 16:41:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:09.613 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:09.870 POWER: Env isn't set yet! 00:06:09.870 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:09.870 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:09.870 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:06:09.870 POWER: Cannot get available frequencies of lcore 0 00:06:09.870 POWER: Attempting to initialise PSTAT power management... 00:06:09.870 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:09.870 POWER: Initialized successfully for lcore 0 power management 00:06:09.870 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:09.870 POWER: Initialized successfully for lcore 1 power management 00:06:09.870 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:09.870 POWER: Initialized successfully for lcore 2 power management 00:06:09.870 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:09.870 POWER: Initialized successfully for lcore 3 power management 00:06:09.870 [2024-11-16 16:41:55.416855] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:06:09.870 [2024-11-16 16:41:55.416876] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:06:09.870 [2024-11-16 16:41:55.416889] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:06:09.870 16:41:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:09.870 16:41:55 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:09.870 16:41:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:09.870 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:09.870 [2024-11-16 16:41:55.517329] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:09.870 16:41:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:09.870 16:41:55 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:09.870 16:41:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:09.870 16:41:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.870 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:09.870 ************************************ 00:06:09.870 START TEST scheduler_create_thread 00:06:09.870 ************************************ 00:06:09.870 16:41:55 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:06:09.870 16:41:55 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:09.870 16:41:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:09.870 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:09.870 2 00:06:09.870 16:41:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:09.870 16:41:55 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:09.870 16:41:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:09.870 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:09.870 3 00:06:09.870 16:41:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:09.870 16:41:55 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:09.870 16:41:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:09.870 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:09.870 4 00:06:09.870 16:41:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:09.870 16:41:55 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:09.870 16:41:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:09.870 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:09.870 5 00:06:09.870 16:41:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:09.870 16:41:55 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:09.870 16:41:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:09.870 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:09.870 6 00:06:09.870 16:41:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:09.870 16:41:55 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:09.870 16:41:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:09.870 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:09.870 7 00:06:09.870 16:41:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:09.870 16:41:55 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:09.870 16:41:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:09.870 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:09.870 8 00:06:09.870 16:41:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:09.870 16:41:55 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:09.870 16:41:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:09.870 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:09.870 9 00:06:09.870 16:41:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:09.870 16:41:55 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:09.871 16:41:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:09.871 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:09.871 10 00:06:09.871 16:41:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:09.871 16:41:55 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:09.871 16:41:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:09.871 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:10.129 16:41:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.129 16:41:55 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:10.129 16:41:55 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:10.129 16:41:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.129 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:10.129 16:41:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.129 16:41:55 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:10.129 16:41:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.129 16:41:55 -- common/autotest_common.sh@10 -- # set +x 00:06:11.500 16:41:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:11.500 16:41:57 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:11.500 16:41:57 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:11.500 16:41:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:11.500 16:41:57 -- common/autotest_common.sh@10 -- # set +x 00:06:12.435 16:41:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:12.435 00:06:12.435 real 0m2.620s 00:06:12.435 user 0m0.009s 00:06:12.435 sys 0m0.006s 00:06:12.435 16:41:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:12.435 16:41:58 -- common/autotest_common.sh@10 -- # set +x 00:06:12.435 ************************************ 00:06:12.435 END TEST scheduler_create_thread 00:06:12.435 ************************************ 00:06:12.435 16:41:58 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:12.435 16:41:58 -- scheduler/scheduler.sh@46 -- # killprocess 1077768 00:06:12.435 16:41:58 -- common/autotest_common.sh@936 -- # '[' -z 1077768 ']' 00:06:12.435 16:41:58 -- common/autotest_common.sh@940 -- # kill -0 1077768 00:06:12.435 16:41:58 -- common/autotest_common.sh@941 -- # uname 00:06:12.435 16:41:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:12.435 16:41:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1077768 00:06:12.693 16:41:58 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:12.693 16:41:58 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:12.693 16:41:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1077768' 00:06:12.693 killing process with pid 1077768 00:06:12.693 16:41:58 -- common/autotest_common.sh@955 -- # kill 1077768 00:06:12.693 16:41:58 -- common/autotest_common.sh@960 -- # wait 1077768 00:06:12.950 [2024-11-16 16:41:58.624414] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:13.209 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:13.209 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:13.209 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:06:13.209 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:13.209 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:06:13.209 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:13.209 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:06:13.209 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:13.209 00:06:13.209 real 0m3.880s 00:06:13.209 user 0m5.921s 00:06:13.209 sys 0m0.346s 00:06:13.209 16:41:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:13.209 16:41:58 -- common/autotest_common.sh@10 -- # set +x 00:06:13.209 ************************************ 00:06:13.209 END TEST event_scheduler 00:06:13.209 ************************************ 00:06:13.209 16:41:58 -- event/event.sh@51 -- # modprobe -n nbd 00:06:13.209 16:41:58 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:13.209 16:41:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:13.209 16:41:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:13.209 16:41:58 -- common/autotest_common.sh@10 -- # set +x 00:06:13.209 ************************************ 00:06:13.209 START TEST app_repeat 00:06:13.209 ************************************ 00:06:13.209 16:41:58 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:06:13.209 16:41:58 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:13.209 16:41:58 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:13.209 16:41:58 -- event/event.sh@13 -- # local nbd_list 00:06:13.209 16:41:58 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:13.209 16:41:58 -- event/event.sh@14 -- # local bdev_list 00:06:13.209 16:41:58 -- event/event.sh@15 -- # local repeat_times=4 00:06:13.209 16:41:58 -- event/event.sh@17 -- # modprobe nbd 00:06:13.209 16:41:58 -- event/event.sh@19 -- # repeat_pid=1078230 00:06:13.209 16:41:58 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:13.209 16:41:58 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:13.209 16:41:58 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1078230' 00:06:13.209 Process app_repeat pid: 1078230 00:06:13.209 16:41:58 -- event/event.sh@23 -- # for i in {0..2} 00:06:13.209 16:41:58 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:13.209 spdk_app_start Round 0 00:06:13.209 16:41:58 -- event/event.sh@25 -- # waitforlisten 1078230 /var/tmp/spdk-nbd.sock 00:06:13.209 16:41:58 -- common/autotest_common.sh@829 -- # '[' -z 1078230 ']' 00:06:13.209 16:41:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:13.209 16:41:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:13.209 16:41:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:13.209 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:13.209 16:41:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:13.209 16:41:58 -- common/autotest_common.sh@10 -- # set +x 00:06:13.209 [2024-11-16 16:41:58.918030] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:13.209 [2024-11-16 16:41:58.918102] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1078230 ] 00:06:13.209 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.467 [2024-11-16 16:41:58.982253] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:13.467 [2024-11-16 16:41:59.080657] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:13.467 [2024-11-16 16:41:59.080661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.467 16:41:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:13.467 16:41:59 -- common/autotest_common.sh@862 -- # return 0 00:06:13.467 16:41:59 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:13.725 Malloc0 00:06:13.725 16:41:59 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:13.984 Malloc1 00:06:14.243 16:41:59 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@12 -- # local i 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.243 16:41:59 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:14.243 /dev/nbd0 00:06:14.501 16:41:59 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:14.501 16:42:00 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:14.501 16:42:00 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:14.501 16:42:00 -- common/autotest_common.sh@867 -- # local i 00:06:14.501 16:42:00 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:14.501 16:42:00 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:14.501 16:42:00 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:14.501 16:42:00 -- common/autotest_common.sh@871 -- # break 00:06:14.501 16:42:00 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:14.501 16:42:00 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:14.501 16:42:00 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:14.501 1+0 records in 00:06:14.501 1+0 records out 00:06:14.501 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000206856 s, 19.8 MB/s 00:06:14.501 16:42:00 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.501 16:42:00 -- common/autotest_common.sh@884 -- # size=4096 00:06:14.501 16:42:00 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.501 16:42:00 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:14.501 16:42:00 -- common/autotest_common.sh@887 -- # return 0 00:06:14.501 16:42:00 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:14.501 16:42:00 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.501 16:42:00 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:14.759 /dev/nbd1 00:06:14.759 16:42:00 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:14.759 16:42:00 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:14.759 16:42:00 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:14.759 16:42:00 -- common/autotest_common.sh@867 -- # local i 00:06:14.759 16:42:00 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:14.759 16:42:00 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:14.759 16:42:00 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:14.759 16:42:00 -- common/autotest_common.sh@871 -- # break 00:06:14.759 16:42:00 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:14.759 16:42:00 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:14.759 16:42:00 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:14.759 1+0 records in 00:06:14.759 1+0 records out 00:06:14.759 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000209729 s, 19.5 MB/s 00:06:14.759 16:42:00 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.759 16:42:00 -- common/autotest_common.sh@884 -- # size=4096 00:06:14.759 16:42:00 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.759 16:42:00 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:14.759 16:42:00 -- common/autotest_common.sh@887 -- # return 0 00:06:14.759 16:42:00 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:14.759 16:42:00 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.759 16:42:00 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:14.759 16:42:00 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.759 16:42:00 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:15.017 16:42:00 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:15.017 { 00:06:15.017 "nbd_device": "/dev/nbd0", 00:06:15.017 "bdev_name": "Malloc0" 00:06:15.017 }, 00:06:15.017 { 00:06:15.017 "nbd_device": "/dev/nbd1", 00:06:15.017 "bdev_name": "Malloc1" 00:06:15.017 } 00:06:15.017 ]' 00:06:15.017 16:42:00 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:15.017 { 00:06:15.017 "nbd_device": "/dev/nbd0", 00:06:15.017 "bdev_name": "Malloc0" 00:06:15.017 }, 00:06:15.017 { 00:06:15.017 "nbd_device": "/dev/nbd1", 00:06:15.017 "bdev_name": "Malloc1" 00:06:15.017 } 00:06:15.017 ]' 00:06:15.017 16:42:00 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:15.017 16:42:00 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:15.017 /dev/nbd1' 00:06:15.017 16:42:00 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:15.017 /dev/nbd1' 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@65 -- # count=2 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@95 -- # count=2 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:15.018 256+0 records in 00:06:15.018 256+0 records out 00:06:15.018 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00417905 s, 251 MB/s 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:15.018 256+0 records in 00:06:15.018 256+0 records out 00:06:15.018 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023478 s, 44.7 MB/s 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:15.018 256+0 records in 00:06:15.018 256+0 records out 00:06:15.018 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252738 s, 41.5 MB/s 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@51 -- # local i 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:15.018 16:42:00 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:15.276 16:42:00 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:15.276 16:42:00 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:15.276 16:42:00 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:15.276 16:42:00 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:15.276 16:42:00 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:15.276 16:42:00 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:15.276 16:42:01 -- bdev/nbd_common.sh@41 -- # break 00:06:15.276 16:42:01 -- bdev/nbd_common.sh@45 -- # return 0 00:06:15.276 16:42:01 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:15.276 16:42:01 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@41 -- # break 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@45 -- # return 0 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@65 -- # true 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@65 -- # count=0 00:06:15.841 16:42:01 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:16.099 16:42:01 -- bdev/nbd_common.sh@104 -- # count=0 00:06:16.099 16:42:01 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:16.099 16:42:01 -- bdev/nbd_common.sh@109 -- # return 0 00:06:16.099 16:42:01 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:16.356 16:42:01 -- event/event.sh@35 -- # sleep 3 00:06:16.615 [2024-11-16 16:42:02.113351] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:16.615 [2024-11-16 16:42:02.200986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.615 [2024-11-16 16:42:02.200986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:16.615 [2024-11-16 16:42:02.262403] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:16.615 [2024-11-16 16:42:02.262494] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:19.143 16:42:04 -- event/event.sh@23 -- # for i in {0..2} 00:06:19.143 16:42:04 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:19.143 spdk_app_start Round 1 00:06:19.143 16:42:04 -- event/event.sh@25 -- # waitforlisten 1078230 /var/tmp/spdk-nbd.sock 00:06:19.143 16:42:04 -- common/autotest_common.sh@829 -- # '[' -z 1078230 ']' 00:06:19.143 16:42:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:19.143 16:42:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:19.143 16:42:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:19.143 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:19.401 16:42:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:19.401 16:42:04 -- common/autotest_common.sh@10 -- # set +x 00:06:19.660 16:42:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:19.660 16:42:05 -- common/autotest_common.sh@862 -- # return 0 00:06:19.660 16:42:05 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:19.917 Malloc0 00:06:19.917 16:42:05 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:20.176 Malloc1 00:06:20.176 16:42:05 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@12 -- # local i 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.176 16:42:05 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:20.435 /dev/nbd0 00:06:20.435 16:42:05 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:20.435 16:42:05 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:20.435 16:42:05 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:20.435 16:42:05 -- common/autotest_common.sh@867 -- # local i 00:06:20.435 16:42:05 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:20.435 16:42:05 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:20.435 16:42:05 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:20.435 16:42:05 -- common/autotest_common.sh@871 -- # break 00:06:20.435 16:42:05 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:20.435 16:42:05 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:20.435 16:42:05 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:20.435 1+0 records in 00:06:20.435 1+0 records out 00:06:20.435 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000160848 s, 25.5 MB/s 00:06:20.435 16:42:05 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.435 16:42:05 -- common/autotest_common.sh@884 -- # size=4096 00:06:20.435 16:42:05 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.435 16:42:06 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:20.435 16:42:06 -- common/autotest_common.sh@887 -- # return 0 00:06:20.435 16:42:06 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:20.435 16:42:06 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.435 16:42:06 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:20.693 /dev/nbd1 00:06:20.693 16:42:06 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:20.693 16:42:06 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:20.693 16:42:06 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:20.693 16:42:06 -- common/autotest_common.sh@867 -- # local i 00:06:20.693 16:42:06 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:20.693 16:42:06 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:20.693 16:42:06 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:20.693 16:42:06 -- common/autotest_common.sh@871 -- # break 00:06:20.693 16:42:06 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:20.693 16:42:06 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:20.693 16:42:06 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:20.693 1+0 records in 00:06:20.693 1+0 records out 00:06:20.693 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000228149 s, 18.0 MB/s 00:06:20.693 16:42:06 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.693 16:42:06 -- common/autotest_common.sh@884 -- # size=4096 00:06:20.693 16:42:06 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.693 16:42:06 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:20.693 16:42:06 -- common/autotest_common.sh@887 -- # return 0 00:06:20.693 16:42:06 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:20.693 16:42:06 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.693 16:42:06 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:20.693 16:42:06 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.693 16:42:06 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:20.951 { 00:06:20.951 "nbd_device": "/dev/nbd0", 00:06:20.951 "bdev_name": "Malloc0" 00:06:20.951 }, 00:06:20.951 { 00:06:20.951 "nbd_device": "/dev/nbd1", 00:06:20.951 "bdev_name": "Malloc1" 00:06:20.951 } 00:06:20.951 ]' 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:20.951 { 00:06:20.951 "nbd_device": "/dev/nbd0", 00:06:20.951 "bdev_name": "Malloc0" 00:06:20.951 }, 00:06:20.951 { 00:06:20.951 "nbd_device": "/dev/nbd1", 00:06:20.951 "bdev_name": "Malloc1" 00:06:20.951 } 00:06:20.951 ]' 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:20.951 /dev/nbd1' 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:20.951 /dev/nbd1' 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@65 -- # count=2 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@95 -- # count=2 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:20.951 256+0 records in 00:06:20.951 256+0 records out 00:06:20.951 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00474899 s, 221 MB/s 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:20.951 256+0 records in 00:06:20.951 256+0 records out 00:06:20.951 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200849 s, 52.2 MB/s 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:20.951 256+0 records in 00:06:20.951 256+0 records out 00:06:20.951 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222493 s, 47.1 MB/s 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@51 -- # local i 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:20.951 16:42:06 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:21.209 16:42:06 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:21.209 16:42:06 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:21.209 16:42:06 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:21.209 16:42:06 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:21.209 16:42:06 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:21.209 16:42:06 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:21.209 16:42:06 -- bdev/nbd_common.sh@41 -- # break 00:06:21.209 16:42:06 -- bdev/nbd_common.sh@45 -- # return 0 00:06:21.209 16:42:06 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:21.209 16:42:06 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:21.467 16:42:07 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:21.467 16:42:07 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:21.467 16:42:07 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:21.467 16:42:07 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:21.467 16:42:07 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:21.467 16:42:07 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:21.467 16:42:07 -- bdev/nbd_common.sh@41 -- # break 00:06:21.467 16:42:07 -- bdev/nbd_common.sh@45 -- # return 0 00:06:21.467 16:42:07 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:21.467 16:42:07 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:21.725 16:42:07 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:21.982 16:42:07 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:21.982 16:42:07 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:21.982 16:42:07 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:21.982 16:42:07 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:21.982 16:42:07 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:21.982 16:42:07 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:21.982 16:42:07 -- bdev/nbd_common.sh@65 -- # true 00:06:21.982 16:42:07 -- bdev/nbd_common.sh@65 -- # count=0 00:06:21.982 16:42:07 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:21.982 16:42:07 -- bdev/nbd_common.sh@104 -- # count=0 00:06:21.982 16:42:07 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:21.982 16:42:07 -- bdev/nbd_common.sh@109 -- # return 0 00:06:21.982 16:42:07 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:22.239 16:42:07 -- event/event.sh@35 -- # sleep 3 00:06:22.496 [2024-11-16 16:42:08.053087] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:22.496 [2024-11-16 16:42:08.138457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:22.496 [2024-11-16 16:42:08.138461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.496 [2024-11-16 16:42:08.199760] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:22.496 [2024-11-16 16:42:08.199850] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:25.777 16:42:10 -- event/event.sh@23 -- # for i in {0..2} 00:06:25.777 16:42:10 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:25.777 spdk_app_start Round 2 00:06:25.777 16:42:10 -- event/event.sh@25 -- # waitforlisten 1078230 /var/tmp/spdk-nbd.sock 00:06:25.777 16:42:10 -- common/autotest_common.sh@829 -- # '[' -z 1078230 ']' 00:06:25.777 16:42:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:25.777 16:42:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:25.777 16:42:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:25.777 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:25.777 16:42:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:25.777 16:42:10 -- common/autotest_common.sh@10 -- # set +x 00:06:25.777 16:42:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:25.777 16:42:11 -- common/autotest_common.sh@862 -- # return 0 00:06:25.777 16:42:11 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:25.777 Malloc0 00:06:25.777 16:42:11 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:26.036 Malloc1 00:06:26.036 16:42:11 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@12 -- # local i 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:26.036 16:42:11 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:26.295 /dev/nbd0 00:06:26.295 16:42:11 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:26.295 16:42:11 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:26.295 16:42:11 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:26.295 16:42:11 -- common/autotest_common.sh@867 -- # local i 00:06:26.295 16:42:11 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:26.295 16:42:11 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:26.295 16:42:11 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:26.295 16:42:11 -- common/autotest_common.sh@871 -- # break 00:06:26.295 16:42:11 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:26.295 16:42:11 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:26.295 16:42:11 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:26.295 1+0 records in 00:06:26.295 1+0 records out 00:06:26.295 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000199075 s, 20.6 MB/s 00:06:26.295 16:42:11 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:26.295 16:42:11 -- common/autotest_common.sh@884 -- # size=4096 00:06:26.295 16:42:11 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:26.295 16:42:11 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:26.295 16:42:11 -- common/autotest_common.sh@887 -- # return 0 00:06:26.295 16:42:11 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:26.295 16:42:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:26.295 16:42:11 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:26.552 /dev/nbd1 00:06:26.552 16:42:12 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:26.552 16:42:12 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:26.552 16:42:12 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:26.552 16:42:12 -- common/autotest_common.sh@867 -- # local i 00:06:26.552 16:42:12 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:26.552 16:42:12 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:26.552 16:42:12 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:26.552 16:42:12 -- common/autotest_common.sh@871 -- # break 00:06:26.552 16:42:12 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:26.552 16:42:12 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:26.552 16:42:12 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:26.552 1+0 records in 00:06:26.552 1+0 records out 00:06:26.552 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000195237 s, 21.0 MB/s 00:06:26.552 16:42:12 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:26.552 16:42:12 -- common/autotest_common.sh@884 -- # size=4096 00:06:26.553 16:42:12 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:26.553 16:42:12 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:26.553 16:42:12 -- common/autotest_common.sh@887 -- # return 0 00:06:26.553 16:42:12 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:26.553 16:42:12 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:26.553 16:42:12 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:26.553 16:42:12 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:26.553 16:42:12 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:26.811 { 00:06:26.811 "nbd_device": "/dev/nbd0", 00:06:26.811 "bdev_name": "Malloc0" 00:06:26.811 }, 00:06:26.811 { 00:06:26.811 "nbd_device": "/dev/nbd1", 00:06:26.811 "bdev_name": "Malloc1" 00:06:26.811 } 00:06:26.811 ]' 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:26.811 { 00:06:26.811 "nbd_device": "/dev/nbd0", 00:06:26.811 "bdev_name": "Malloc0" 00:06:26.811 }, 00:06:26.811 { 00:06:26.811 "nbd_device": "/dev/nbd1", 00:06:26.811 "bdev_name": "Malloc1" 00:06:26.811 } 00:06:26.811 ]' 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:26.811 /dev/nbd1' 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:26.811 /dev/nbd1' 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@65 -- # count=2 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@95 -- # count=2 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:26.811 256+0 records in 00:06:26.811 256+0 records out 00:06:26.811 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0051811 s, 202 MB/s 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:26.811 256+0 records in 00:06:26.811 256+0 records out 00:06:26.811 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023097 s, 45.4 MB/s 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:26.811 256+0 records in 00:06:26.811 256+0 records out 00:06:26.811 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215641 s, 48.6 MB/s 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:26.811 16:42:12 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:27.069 16:42:12 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:27.069 16:42:12 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:27.069 16:42:12 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:27.069 16:42:12 -- bdev/nbd_common.sh@51 -- # local i 00:06:27.069 16:42:12 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:27.069 16:42:12 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:27.327 16:42:12 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:27.327 16:42:12 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:27.327 16:42:12 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:27.327 16:42:12 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:27.327 16:42:12 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:27.327 16:42:12 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:27.327 16:42:12 -- bdev/nbd_common.sh@41 -- # break 00:06:27.327 16:42:12 -- bdev/nbd_common.sh@45 -- # return 0 00:06:27.327 16:42:12 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:27.327 16:42:12 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:27.585 16:42:13 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:27.585 16:42:13 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:27.585 16:42:13 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:27.585 16:42:13 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:27.585 16:42:13 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:27.585 16:42:13 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:27.585 16:42:13 -- bdev/nbd_common.sh@41 -- # break 00:06:27.585 16:42:13 -- bdev/nbd_common.sh@45 -- # return 0 00:06:27.585 16:42:13 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:27.585 16:42:13 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:27.585 16:42:13 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:27.843 16:42:13 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:27.843 16:42:13 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:27.843 16:42:13 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:27.843 16:42:13 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:27.843 16:42:13 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:27.843 16:42:13 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:27.843 16:42:13 -- bdev/nbd_common.sh@65 -- # true 00:06:27.843 16:42:13 -- bdev/nbd_common.sh@65 -- # count=0 00:06:27.843 16:42:13 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:27.843 16:42:13 -- bdev/nbd_common.sh@104 -- # count=0 00:06:27.843 16:42:13 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:27.843 16:42:13 -- bdev/nbd_common.sh@109 -- # return 0 00:06:27.843 16:42:13 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:28.101 16:42:13 -- event/event.sh@35 -- # sleep 3 00:06:28.359 [2024-11-16 16:42:13.915833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:28.359 [2024-11-16 16:42:14.004284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:28.359 [2024-11-16 16:42:14.004289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.359 [2024-11-16 16:42:14.063116] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:28.359 [2024-11-16 16:42:14.063193] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:31.639 16:42:16 -- event/event.sh@38 -- # waitforlisten 1078230 /var/tmp/spdk-nbd.sock 00:06:31.639 16:42:16 -- common/autotest_common.sh@829 -- # '[' -z 1078230 ']' 00:06:31.639 16:42:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:31.639 16:42:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:31.639 16:42:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:31.639 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:31.639 16:42:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:31.639 16:42:16 -- common/autotest_common.sh@10 -- # set +x 00:06:31.639 16:42:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:31.639 16:42:16 -- common/autotest_common.sh@862 -- # return 0 00:06:31.639 16:42:16 -- event/event.sh@39 -- # killprocess 1078230 00:06:31.639 16:42:16 -- common/autotest_common.sh@936 -- # '[' -z 1078230 ']' 00:06:31.639 16:42:16 -- common/autotest_common.sh@940 -- # kill -0 1078230 00:06:31.639 16:42:16 -- common/autotest_common.sh@941 -- # uname 00:06:31.639 16:42:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:31.639 16:42:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1078230 00:06:31.639 16:42:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:31.639 16:42:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:31.639 16:42:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1078230' 00:06:31.639 killing process with pid 1078230 00:06:31.639 16:42:16 -- common/autotest_common.sh@955 -- # kill 1078230 00:06:31.639 16:42:16 -- common/autotest_common.sh@960 -- # wait 1078230 00:06:31.639 spdk_app_start is called in Round 0. 00:06:31.639 Shutdown signal received, stop current app iteration 00:06:31.639 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:31.639 spdk_app_start is called in Round 1. 00:06:31.639 Shutdown signal received, stop current app iteration 00:06:31.639 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:31.639 spdk_app_start is called in Round 2. 00:06:31.639 Shutdown signal received, stop current app iteration 00:06:31.639 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:31.639 spdk_app_start is called in Round 3. 00:06:31.639 Shutdown signal received, stop current app iteration 00:06:31.639 16:42:17 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:31.639 16:42:17 -- event/event.sh@42 -- # return 0 00:06:31.639 00:06:31.639 real 0m18.287s 00:06:31.639 user 0m40.076s 00:06:31.639 sys 0m3.238s 00:06:31.639 16:42:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:31.639 16:42:17 -- common/autotest_common.sh@10 -- # set +x 00:06:31.639 ************************************ 00:06:31.639 END TEST app_repeat 00:06:31.639 ************************************ 00:06:31.639 16:42:17 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:31.639 16:42:17 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:31.639 16:42:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:31.639 16:42:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.639 16:42:17 -- common/autotest_common.sh@10 -- # set +x 00:06:31.639 ************************************ 00:06:31.639 START TEST cpu_locks 00:06:31.639 ************************************ 00:06:31.639 16:42:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:31.639 * Looking for test storage... 00:06:31.639 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:31.639 16:42:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:31.639 16:42:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:31.639 16:42:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:31.639 16:42:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:31.639 16:42:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:31.639 16:42:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:31.639 16:42:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:31.639 16:42:17 -- scripts/common.sh@335 -- # IFS=.-: 00:06:31.639 16:42:17 -- scripts/common.sh@335 -- # read -ra ver1 00:06:31.639 16:42:17 -- scripts/common.sh@336 -- # IFS=.-: 00:06:31.639 16:42:17 -- scripts/common.sh@336 -- # read -ra ver2 00:06:31.639 16:42:17 -- scripts/common.sh@337 -- # local 'op=<' 00:06:31.639 16:42:17 -- scripts/common.sh@339 -- # ver1_l=2 00:06:31.639 16:42:17 -- scripts/common.sh@340 -- # ver2_l=1 00:06:31.639 16:42:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:31.639 16:42:17 -- scripts/common.sh@343 -- # case "$op" in 00:06:31.639 16:42:17 -- scripts/common.sh@344 -- # : 1 00:06:31.639 16:42:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:31.639 16:42:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:31.639 16:42:17 -- scripts/common.sh@364 -- # decimal 1 00:06:31.639 16:42:17 -- scripts/common.sh@352 -- # local d=1 00:06:31.639 16:42:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:31.639 16:42:17 -- scripts/common.sh@354 -- # echo 1 00:06:31.639 16:42:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:31.639 16:42:17 -- scripts/common.sh@365 -- # decimal 2 00:06:31.639 16:42:17 -- scripts/common.sh@352 -- # local d=2 00:06:31.639 16:42:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:31.639 16:42:17 -- scripts/common.sh@354 -- # echo 2 00:06:31.639 16:42:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:31.639 16:42:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:31.639 16:42:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:31.639 16:42:17 -- scripts/common.sh@367 -- # return 0 00:06:31.639 16:42:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:31.639 16:42:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:31.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.639 --rc genhtml_branch_coverage=1 00:06:31.639 --rc genhtml_function_coverage=1 00:06:31.639 --rc genhtml_legend=1 00:06:31.639 --rc geninfo_all_blocks=1 00:06:31.639 --rc geninfo_unexecuted_blocks=1 00:06:31.639 00:06:31.639 ' 00:06:31.639 16:42:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:31.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.639 --rc genhtml_branch_coverage=1 00:06:31.639 --rc genhtml_function_coverage=1 00:06:31.639 --rc genhtml_legend=1 00:06:31.639 --rc geninfo_all_blocks=1 00:06:31.639 --rc geninfo_unexecuted_blocks=1 00:06:31.639 00:06:31.639 ' 00:06:31.639 16:42:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:31.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.639 --rc genhtml_branch_coverage=1 00:06:31.639 --rc genhtml_function_coverage=1 00:06:31.639 --rc genhtml_legend=1 00:06:31.639 --rc geninfo_all_blocks=1 00:06:31.639 --rc geninfo_unexecuted_blocks=1 00:06:31.639 00:06:31.639 ' 00:06:31.639 16:42:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:31.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.639 --rc genhtml_branch_coverage=1 00:06:31.639 --rc genhtml_function_coverage=1 00:06:31.639 --rc genhtml_legend=1 00:06:31.639 --rc geninfo_all_blocks=1 00:06:31.639 --rc geninfo_unexecuted_blocks=1 00:06:31.639 00:06:31.639 ' 00:06:31.639 16:42:17 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:31.639 16:42:17 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:31.639 16:42:17 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:31.639 16:42:17 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:31.639 16:42:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:31.639 16:42:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.639 16:42:17 -- common/autotest_common.sh@10 -- # set +x 00:06:31.639 ************************************ 00:06:31.639 START TEST default_locks 00:06:31.639 ************************************ 00:06:31.639 16:42:17 -- common/autotest_common.sh@1114 -- # default_locks 00:06:31.639 16:42:17 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1081284 00:06:31.639 16:42:17 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:31.639 16:42:17 -- event/cpu_locks.sh@47 -- # waitforlisten 1081284 00:06:31.639 16:42:17 -- common/autotest_common.sh@829 -- # '[' -z 1081284 ']' 00:06:31.639 16:42:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:31.639 16:42:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:31.639 16:42:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:31.639 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:31.639 16:42:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:31.639 16:42:17 -- common/autotest_common.sh@10 -- # set +x 00:06:31.897 [2024-11-16 16:42:17.399168] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:31.897 [2024-11-16 16:42:17.399249] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1081284 ] 00:06:31.897 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.897 [2024-11-16 16:42:17.460250] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.897 [2024-11-16 16:42:17.544824] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:31.897 [2024-11-16 16:42:17.544995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.831 16:42:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:32.831 16:42:18 -- common/autotest_common.sh@862 -- # return 0 00:06:32.831 16:42:18 -- event/cpu_locks.sh@49 -- # locks_exist 1081284 00:06:32.831 16:42:18 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:32.831 16:42:18 -- event/cpu_locks.sh@22 -- # lslocks -p 1081284 00:06:33.090 lslocks: write error 00:06:33.090 16:42:18 -- event/cpu_locks.sh@50 -- # killprocess 1081284 00:06:33.090 16:42:18 -- common/autotest_common.sh@936 -- # '[' -z 1081284 ']' 00:06:33.090 16:42:18 -- common/autotest_common.sh@940 -- # kill -0 1081284 00:06:33.090 16:42:18 -- common/autotest_common.sh@941 -- # uname 00:06:33.090 16:42:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:33.090 16:42:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1081284 00:06:33.090 16:42:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:33.090 16:42:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:33.090 16:42:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1081284' 00:06:33.090 killing process with pid 1081284 00:06:33.090 16:42:18 -- common/autotest_common.sh@955 -- # kill 1081284 00:06:33.090 16:42:18 -- common/autotest_common.sh@960 -- # wait 1081284 00:06:33.657 16:42:19 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1081284 00:06:33.657 16:42:19 -- common/autotest_common.sh@650 -- # local es=0 00:06:33.657 16:42:19 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1081284 00:06:33.657 16:42:19 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:33.657 16:42:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:33.657 16:42:19 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:33.657 16:42:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:33.657 16:42:19 -- common/autotest_common.sh@653 -- # waitforlisten 1081284 00:06:33.657 16:42:19 -- common/autotest_common.sh@829 -- # '[' -z 1081284 ']' 00:06:33.657 16:42:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:33.657 16:42:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:33.657 16:42:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:33.657 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:33.657 16:42:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:33.657 16:42:19 -- common/autotest_common.sh@10 -- # set +x 00:06:33.657 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1081284) - No such process 00:06:33.657 ERROR: process (pid: 1081284) is no longer running 00:06:33.657 16:42:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:33.657 16:42:19 -- common/autotest_common.sh@862 -- # return 1 00:06:33.657 16:42:19 -- common/autotest_common.sh@653 -- # es=1 00:06:33.657 16:42:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:33.657 16:42:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:33.657 16:42:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:33.657 16:42:19 -- event/cpu_locks.sh@54 -- # no_locks 00:06:33.657 16:42:19 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:33.657 16:42:19 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:33.657 16:42:19 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:33.657 00:06:33.657 real 0m1.761s 00:06:33.657 user 0m1.894s 00:06:33.657 sys 0m0.572s 00:06:33.657 16:42:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.657 16:42:19 -- common/autotest_common.sh@10 -- # set +x 00:06:33.657 ************************************ 00:06:33.657 END TEST default_locks 00:06:33.657 ************************************ 00:06:33.657 16:42:19 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:33.657 16:42:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:33.657 16:42:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.657 16:42:19 -- common/autotest_common.sh@10 -- # set +x 00:06:33.657 ************************************ 00:06:33.657 START TEST default_locks_via_rpc 00:06:33.657 ************************************ 00:06:33.657 16:42:19 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:33.657 16:42:19 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1081565 00:06:33.657 16:42:19 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:33.657 16:42:19 -- event/cpu_locks.sh@63 -- # waitforlisten 1081565 00:06:33.657 16:42:19 -- common/autotest_common.sh@829 -- # '[' -z 1081565 ']' 00:06:33.657 16:42:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:33.657 16:42:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:33.657 16:42:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:33.657 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:33.657 16:42:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:33.657 16:42:19 -- common/autotest_common.sh@10 -- # set +x 00:06:33.657 [2024-11-16 16:42:19.180718] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:33.657 [2024-11-16 16:42:19.180827] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1081565 ] 00:06:33.657 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.657 [2024-11-16 16:42:19.237400] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.657 [2024-11-16 16:42:19.325195] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:33.657 [2024-11-16 16:42:19.325352] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.590 16:42:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:34.590 16:42:20 -- common/autotest_common.sh@862 -- # return 0 00:06:34.590 16:42:20 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:34.590 16:42:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:34.590 16:42:20 -- common/autotest_common.sh@10 -- # set +x 00:06:34.590 16:42:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:34.590 16:42:20 -- event/cpu_locks.sh@67 -- # no_locks 00:06:34.590 16:42:20 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:34.590 16:42:20 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:34.590 16:42:20 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:34.590 16:42:20 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:34.590 16:42:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:34.590 16:42:20 -- common/autotest_common.sh@10 -- # set +x 00:06:34.590 16:42:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:34.590 16:42:20 -- event/cpu_locks.sh@71 -- # locks_exist 1081565 00:06:34.590 16:42:20 -- event/cpu_locks.sh@22 -- # lslocks -p 1081565 00:06:34.590 16:42:20 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:34.848 16:42:20 -- event/cpu_locks.sh@73 -- # killprocess 1081565 00:06:34.848 16:42:20 -- common/autotest_common.sh@936 -- # '[' -z 1081565 ']' 00:06:34.848 16:42:20 -- common/autotest_common.sh@940 -- # kill -0 1081565 00:06:34.848 16:42:20 -- common/autotest_common.sh@941 -- # uname 00:06:34.848 16:42:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:34.848 16:42:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1081565 00:06:34.848 16:42:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:34.848 16:42:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:34.848 16:42:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1081565' 00:06:34.848 killing process with pid 1081565 00:06:34.848 16:42:20 -- common/autotest_common.sh@955 -- # kill 1081565 00:06:34.848 16:42:20 -- common/autotest_common.sh@960 -- # wait 1081565 00:06:35.108 00:06:35.108 real 0m1.699s 00:06:35.108 user 0m1.880s 00:06:35.108 sys 0m0.546s 00:06:35.108 16:42:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:35.108 16:42:20 -- common/autotest_common.sh@10 -- # set +x 00:06:35.108 ************************************ 00:06:35.108 END TEST default_locks_via_rpc 00:06:35.108 ************************************ 00:06:35.108 16:42:20 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:35.108 16:42:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:35.108 16:42:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.108 16:42:20 -- common/autotest_common.sh@10 -- # set +x 00:06:35.108 ************************************ 00:06:35.108 START TEST non_locking_app_on_locked_coremask 00:06:35.108 ************************************ 00:06:35.108 16:42:20 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:35.108 16:42:20 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1081859 00:06:35.108 16:42:20 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:35.108 16:42:20 -- event/cpu_locks.sh@81 -- # waitforlisten 1081859 /var/tmp/spdk.sock 00:06:35.108 16:42:20 -- common/autotest_common.sh@829 -- # '[' -z 1081859 ']' 00:06:35.108 16:42:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:35.108 16:42:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:35.108 16:42:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:35.108 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:35.108 16:42:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:35.366 16:42:20 -- common/autotest_common.sh@10 -- # set +x 00:06:35.366 [2024-11-16 16:42:20.904486] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:35.366 [2024-11-16 16:42:20.904587] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1081859 ] 00:06:35.366 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.366 [2024-11-16 16:42:20.965841] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:35.367 [2024-11-16 16:42:21.052591] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:35.367 [2024-11-16 16:42:21.052789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.301 16:42:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:36.301 16:42:21 -- common/autotest_common.sh@862 -- # return 0 00:06:36.301 16:42:21 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1081881 00:06:36.301 16:42:21 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:36.301 16:42:21 -- event/cpu_locks.sh@85 -- # waitforlisten 1081881 /var/tmp/spdk2.sock 00:06:36.301 16:42:21 -- common/autotest_common.sh@829 -- # '[' -z 1081881 ']' 00:06:36.301 16:42:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:36.301 16:42:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:36.301 16:42:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:36.301 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:36.301 16:42:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:36.301 16:42:21 -- common/autotest_common.sh@10 -- # set +x 00:06:36.301 [2024-11-16 16:42:21.891409] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:36.301 [2024-11-16 16:42:21.891494] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1081881 ] 00:06:36.301 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.301 [2024-11-16 16:42:21.983451] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:36.301 [2024-11-16 16:42:21.983503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.559 [2024-11-16 16:42:22.168974] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:36.559 [2024-11-16 16:42:22.169170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.126 16:42:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:37.126 16:42:22 -- common/autotest_common.sh@862 -- # return 0 00:06:37.126 16:42:22 -- event/cpu_locks.sh@87 -- # locks_exist 1081859 00:06:37.126 16:42:22 -- event/cpu_locks.sh@22 -- # lslocks -p 1081859 00:06:37.126 16:42:22 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:37.692 lslocks: write error 00:06:37.692 16:42:23 -- event/cpu_locks.sh@89 -- # killprocess 1081859 00:06:37.692 16:42:23 -- common/autotest_common.sh@936 -- # '[' -z 1081859 ']' 00:06:37.692 16:42:23 -- common/autotest_common.sh@940 -- # kill -0 1081859 00:06:37.692 16:42:23 -- common/autotest_common.sh@941 -- # uname 00:06:37.692 16:42:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:37.692 16:42:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1081859 00:06:37.692 16:42:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:37.692 16:42:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:37.692 16:42:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1081859' 00:06:37.692 killing process with pid 1081859 00:06:37.692 16:42:23 -- common/autotest_common.sh@955 -- # kill 1081859 00:06:37.692 16:42:23 -- common/autotest_common.sh@960 -- # wait 1081859 00:06:38.625 16:42:24 -- event/cpu_locks.sh@90 -- # killprocess 1081881 00:06:38.625 16:42:24 -- common/autotest_common.sh@936 -- # '[' -z 1081881 ']' 00:06:38.625 16:42:24 -- common/autotest_common.sh@940 -- # kill -0 1081881 00:06:38.625 16:42:24 -- common/autotest_common.sh@941 -- # uname 00:06:38.625 16:42:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:38.625 16:42:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1081881 00:06:38.625 16:42:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:38.625 16:42:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:38.625 16:42:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1081881' 00:06:38.625 killing process with pid 1081881 00:06:38.625 16:42:24 -- common/autotest_common.sh@955 -- # kill 1081881 00:06:38.625 16:42:24 -- common/autotest_common.sh@960 -- # wait 1081881 00:06:39.192 00:06:39.192 real 0m3.799s 00:06:39.192 user 0m4.128s 00:06:39.192 sys 0m1.121s 00:06:39.192 16:42:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.192 16:42:24 -- common/autotest_common.sh@10 -- # set +x 00:06:39.192 ************************************ 00:06:39.192 END TEST non_locking_app_on_locked_coremask 00:06:39.192 ************************************ 00:06:39.192 16:42:24 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:39.192 16:42:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:39.192 16:42:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.192 16:42:24 -- common/autotest_common.sh@10 -- # set +x 00:06:39.192 ************************************ 00:06:39.192 START TEST locking_app_on_unlocked_coremask 00:06:39.192 ************************************ 00:06:39.192 16:42:24 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:39.192 16:42:24 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1082312 00:06:39.192 16:42:24 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:39.192 16:42:24 -- event/cpu_locks.sh@99 -- # waitforlisten 1082312 /var/tmp/spdk.sock 00:06:39.192 16:42:24 -- common/autotest_common.sh@829 -- # '[' -z 1082312 ']' 00:06:39.192 16:42:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:39.192 16:42:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:39.192 16:42:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:39.192 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:39.192 16:42:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:39.192 16:42:24 -- common/autotest_common.sh@10 -- # set +x 00:06:39.192 [2024-11-16 16:42:24.728797] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:39.192 [2024-11-16 16:42:24.728896] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1082312 ] 00:06:39.192 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.192 [2024-11-16 16:42:24.785259] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:39.192 [2024-11-16 16:42:24.785303] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.192 [2024-11-16 16:42:24.872771] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:39.192 [2024-11-16 16:42:24.872944] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.127 16:42:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:40.127 16:42:25 -- common/autotest_common.sh@862 -- # return 0 00:06:40.127 16:42:25 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1082452 00:06:40.127 16:42:25 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:40.127 16:42:25 -- event/cpu_locks.sh@103 -- # waitforlisten 1082452 /var/tmp/spdk2.sock 00:06:40.127 16:42:25 -- common/autotest_common.sh@829 -- # '[' -z 1082452 ']' 00:06:40.127 16:42:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:40.127 16:42:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:40.127 16:42:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:40.127 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:40.127 16:42:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:40.127 16:42:25 -- common/autotest_common.sh@10 -- # set +x 00:06:40.127 [2024-11-16 16:42:25.740922] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:40.127 [2024-11-16 16:42:25.741000] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1082452 ] 00:06:40.127 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.127 [2024-11-16 16:42:25.831384] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:40.401 [2024-11-16 16:42:26.013647] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:40.401 [2024-11-16 16:42:26.013841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.993 16:42:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:40.993 16:42:26 -- common/autotest_common.sh@862 -- # return 0 00:06:40.993 16:42:26 -- event/cpu_locks.sh@105 -- # locks_exist 1082452 00:06:40.993 16:42:26 -- event/cpu_locks.sh@22 -- # lslocks -p 1082452 00:06:40.993 16:42:26 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:41.560 lslocks: write error 00:06:41.560 16:42:27 -- event/cpu_locks.sh@107 -- # killprocess 1082312 00:06:41.560 16:42:27 -- common/autotest_common.sh@936 -- # '[' -z 1082312 ']' 00:06:41.560 16:42:27 -- common/autotest_common.sh@940 -- # kill -0 1082312 00:06:41.560 16:42:27 -- common/autotest_common.sh@941 -- # uname 00:06:41.560 16:42:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:41.560 16:42:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1082312 00:06:41.560 16:42:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:41.560 16:42:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:41.560 16:42:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1082312' 00:06:41.560 killing process with pid 1082312 00:06:41.560 16:42:27 -- common/autotest_common.sh@955 -- # kill 1082312 00:06:41.560 16:42:27 -- common/autotest_common.sh@960 -- # wait 1082312 00:06:42.127 16:42:27 -- event/cpu_locks.sh@108 -- # killprocess 1082452 00:06:42.127 16:42:27 -- common/autotest_common.sh@936 -- # '[' -z 1082452 ']' 00:06:42.127 16:42:27 -- common/autotest_common.sh@940 -- # kill -0 1082452 00:06:42.127 16:42:27 -- common/autotest_common.sh@941 -- # uname 00:06:42.127 16:42:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:42.127 16:42:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1082452 00:06:42.386 16:42:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:42.386 16:42:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:42.386 16:42:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1082452' 00:06:42.386 killing process with pid 1082452 00:06:42.386 16:42:27 -- common/autotest_common.sh@955 -- # kill 1082452 00:06:42.386 16:42:27 -- common/autotest_common.sh@960 -- # wait 1082452 00:06:42.646 00:06:42.646 real 0m3.649s 00:06:42.646 user 0m4.010s 00:06:42.646 sys 0m1.058s 00:06:42.646 16:42:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:42.646 16:42:28 -- common/autotest_common.sh@10 -- # set +x 00:06:42.646 ************************************ 00:06:42.646 END TEST locking_app_on_unlocked_coremask 00:06:42.646 ************************************ 00:06:42.646 16:42:28 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:42.646 16:42:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:42.646 16:42:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:42.646 16:42:28 -- common/autotest_common.sh@10 -- # set +x 00:06:42.646 ************************************ 00:06:42.646 START TEST locking_app_on_locked_coremask 00:06:42.646 ************************************ 00:06:42.646 16:42:28 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:42.646 16:42:28 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1082782 00:06:42.646 16:42:28 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:42.646 16:42:28 -- event/cpu_locks.sh@116 -- # waitforlisten 1082782 /var/tmp/spdk.sock 00:06:42.646 16:42:28 -- common/autotest_common.sh@829 -- # '[' -z 1082782 ']' 00:06:42.646 16:42:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:42.646 16:42:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:42.646 16:42:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:42.646 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:42.646 16:42:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:42.646 16:42:28 -- common/autotest_common.sh@10 -- # set +x 00:06:42.905 [2024-11-16 16:42:28.406583] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:42.905 [2024-11-16 16:42:28.406685] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1082782 ] 00:06:42.905 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.905 [2024-11-16 16:42:28.468124] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.905 [2024-11-16 16:42:28.553624] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:42.905 [2024-11-16 16:42:28.553819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.841 16:42:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:43.841 16:42:29 -- common/autotest_common.sh@862 -- # return 0 00:06:43.841 16:42:29 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1082922 00:06:43.841 16:42:29 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1082922 /var/tmp/spdk2.sock 00:06:43.841 16:42:29 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:43.841 16:42:29 -- common/autotest_common.sh@650 -- # local es=0 00:06:43.841 16:42:29 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1082922 /var/tmp/spdk2.sock 00:06:43.841 16:42:29 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:43.841 16:42:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:43.841 16:42:29 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:43.841 16:42:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:43.841 16:42:29 -- common/autotest_common.sh@653 -- # waitforlisten 1082922 /var/tmp/spdk2.sock 00:06:43.841 16:42:29 -- common/autotest_common.sh@829 -- # '[' -z 1082922 ']' 00:06:43.841 16:42:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:43.841 16:42:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:43.841 16:42:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:43.841 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:43.841 16:42:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:43.841 16:42:29 -- common/autotest_common.sh@10 -- # set +x 00:06:43.841 [2024-11-16 16:42:29.405069] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:43.841 [2024-11-16 16:42:29.405160] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1082922 ] 00:06:43.842 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.842 [2024-11-16 16:42:29.498252] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1082782 has claimed it. 00:06:43.842 [2024-11-16 16:42:29.498318] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:44.411 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1082922) - No such process 00:06:44.411 ERROR: process (pid: 1082922) is no longer running 00:06:44.411 16:42:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:44.411 16:42:30 -- common/autotest_common.sh@862 -- # return 1 00:06:44.411 16:42:30 -- common/autotest_common.sh@653 -- # es=1 00:06:44.411 16:42:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:44.411 16:42:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:44.411 16:42:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:44.411 16:42:30 -- event/cpu_locks.sh@122 -- # locks_exist 1082782 00:06:44.411 16:42:30 -- event/cpu_locks.sh@22 -- # lslocks -p 1082782 00:06:44.411 16:42:30 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:44.671 lslocks: write error 00:06:44.671 16:42:30 -- event/cpu_locks.sh@124 -- # killprocess 1082782 00:06:44.671 16:42:30 -- common/autotest_common.sh@936 -- # '[' -z 1082782 ']' 00:06:44.671 16:42:30 -- common/autotest_common.sh@940 -- # kill -0 1082782 00:06:44.671 16:42:30 -- common/autotest_common.sh@941 -- # uname 00:06:44.671 16:42:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.671 16:42:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1082782 00:06:44.671 16:42:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:44.671 16:42:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:44.671 16:42:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1082782' 00:06:44.671 killing process with pid 1082782 00:06:44.671 16:42:30 -- common/autotest_common.sh@955 -- # kill 1082782 00:06:44.671 16:42:30 -- common/autotest_common.sh@960 -- # wait 1082782 00:06:45.241 00:06:45.241 real 0m2.476s 00:06:45.241 user 0m2.818s 00:06:45.241 sys 0m0.660s 00:06:45.241 16:42:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:45.241 16:42:30 -- common/autotest_common.sh@10 -- # set +x 00:06:45.241 ************************************ 00:06:45.241 END TEST locking_app_on_locked_coremask 00:06:45.241 ************************************ 00:06:45.241 16:42:30 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:45.241 16:42:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:45.241 16:42:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.241 16:42:30 -- common/autotest_common.sh@10 -- # set +x 00:06:45.241 ************************************ 00:06:45.241 START TEST locking_overlapped_coremask 00:06:45.241 ************************************ 00:06:45.241 16:42:30 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:45.241 16:42:30 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1083108 00:06:45.241 16:42:30 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:45.241 16:42:30 -- event/cpu_locks.sh@133 -- # waitforlisten 1083108 /var/tmp/spdk.sock 00:06:45.241 16:42:30 -- common/autotest_common.sh@829 -- # '[' -z 1083108 ']' 00:06:45.241 16:42:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:45.241 16:42:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:45.241 16:42:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:45.241 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:45.241 16:42:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:45.241 16:42:30 -- common/autotest_common.sh@10 -- # set +x 00:06:45.241 [2024-11-16 16:42:30.909439] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:45.241 [2024-11-16 16:42:30.909534] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1083108 ] 00:06:45.242 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.242 [2024-11-16 16:42:30.969279] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:45.500 [2024-11-16 16:42:31.068810] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:45.500 [2024-11-16 16:42:31.068994] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:45.500 [2024-11-16 16:42:31.069050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:45.500 [2024-11-16 16:42:31.069053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.436 16:42:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:46.436 16:42:31 -- common/autotest_common.sh@862 -- # return 0 00:06:46.436 16:42:31 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1083230 00:06:46.436 16:42:31 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1083230 /var/tmp/spdk2.sock 00:06:46.436 16:42:31 -- common/autotest_common.sh@650 -- # local es=0 00:06:46.436 16:42:31 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1083230 /var/tmp/spdk2.sock 00:06:46.436 16:42:31 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:46.436 16:42:31 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:46.436 16:42:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:46.436 16:42:31 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:46.436 16:42:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:46.436 16:42:31 -- common/autotest_common.sh@653 -- # waitforlisten 1083230 /var/tmp/spdk2.sock 00:06:46.436 16:42:31 -- common/autotest_common.sh@829 -- # '[' -z 1083230 ']' 00:06:46.436 16:42:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:46.436 16:42:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:46.436 16:42:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:46.436 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:46.436 16:42:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:46.436 16:42:31 -- common/autotest_common.sh@10 -- # set +x 00:06:46.436 [2024-11-16 16:42:31.921605] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:46.436 [2024-11-16 16:42:31.921718] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1083230 ] 00:06:46.436 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.436 [2024-11-16 16:42:32.012227] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1083108 has claimed it. 00:06:46.436 [2024-11-16 16:42:32.012287] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:47.005 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1083230) - No such process 00:06:47.005 ERROR: process (pid: 1083230) is no longer running 00:06:47.005 16:42:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:47.006 16:42:32 -- common/autotest_common.sh@862 -- # return 1 00:06:47.006 16:42:32 -- common/autotest_common.sh@653 -- # es=1 00:06:47.006 16:42:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:47.006 16:42:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:47.006 16:42:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:47.006 16:42:32 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:47.006 16:42:32 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:47.006 16:42:32 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:47.006 16:42:32 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:47.006 16:42:32 -- event/cpu_locks.sh@141 -- # killprocess 1083108 00:06:47.006 16:42:32 -- common/autotest_common.sh@936 -- # '[' -z 1083108 ']' 00:06:47.006 16:42:32 -- common/autotest_common.sh@940 -- # kill -0 1083108 00:06:47.006 16:42:32 -- common/autotest_common.sh@941 -- # uname 00:06:47.006 16:42:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:47.006 16:42:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1083108 00:06:47.006 16:42:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:47.006 16:42:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:47.006 16:42:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1083108' 00:06:47.006 killing process with pid 1083108 00:06:47.006 16:42:32 -- common/autotest_common.sh@955 -- # kill 1083108 00:06:47.006 16:42:32 -- common/autotest_common.sh@960 -- # wait 1083108 00:06:47.574 00:06:47.574 real 0m2.233s 00:06:47.574 user 0m6.451s 00:06:47.574 sys 0m0.493s 00:06:47.574 16:42:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:47.574 16:42:33 -- common/autotest_common.sh@10 -- # set +x 00:06:47.574 ************************************ 00:06:47.574 END TEST locking_overlapped_coremask 00:06:47.574 ************************************ 00:06:47.574 16:42:33 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:47.574 16:42:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:47.574 16:42:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:47.574 16:42:33 -- common/autotest_common.sh@10 -- # set +x 00:06:47.574 ************************************ 00:06:47.574 START TEST locking_overlapped_coremask_via_rpc 00:06:47.574 ************************************ 00:06:47.574 16:42:33 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:47.574 16:42:33 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1083435 00:06:47.574 16:42:33 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:47.574 16:42:33 -- event/cpu_locks.sh@149 -- # waitforlisten 1083435 /var/tmp/spdk.sock 00:06:47.574 16:42:33 -- common/autotest_common.sh@829 -- # '[' -z 1083435 ']' 00:06:47.574 16:42:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:47.574 16:42:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:47.574 16:42:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:47.574 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:47.574 16:42:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:47.574 16:42:33 -- common/autotest_common.sh@10 -- # set +x 00:06:47.574 [2024-11-16 16:42:33.168330] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:47.574 [2024-11-16 16:42:33.168425] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1083435 ] 00:06:47.574 EAL: No free 2048 kB hugepages reported on node 1 00:06:47.574 [2024-11-16 16:42:33.233221] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:47.574 [2024-11-16 16:42:33.233269] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:47.834 [2024-11-16 16:42:33.326686] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:47.834 [2024-11-16 16:42:33.326886] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:47.834 [2024-11-16 16:42:33.326959] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:47.834 [2024-11-16 16:42:33.326962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:48.403 16:42:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:48.403 16:42:34 -- common/autotest_common.sh@862 -- # return 0 00:06:48.403 16:42:34 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1083538 00:06:48.403 16:42:34 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:48.403 16:42:34 -- event/cpu_locks.sh@153 -- # waitforlisten 1083538 /var/tmp/spdk2.sock 00:06:48.403 16:42:34 -- common/autotest_common.sh@829 -- # '[' -z 1083538 ']' 00:06:48.403 16:42:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:48.403 16:42:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:48.403 16:42:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:48.403 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:48.403 16:42:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:48.403 16:42:34 -- common/autotest_common.sh@10 -- # set +x 00:06:48.661 [2024-11-16 16:42:34.160226] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:48.661 [2024-11-16 16:42:34.160301] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1083538 ] 00:06:48.661 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.661 [2024-11-16 16:42:34.247297] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:48.661 [2024-11-16 16:42:34.247341] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:48.920 [2024-11-16 16:42:34.423074] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:48.920 [2024-11-16 16:42:34.423268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:48.920 [2024-11-16 16:42:34.426679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:48.920 [2024-11-16 16:42:34.426681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:49.486 16:42:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:49.486 16:42:35 -- common/autotest_common.sh@862 -- # return 0 00:06:49.486 16:42:35 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:49.486 16:42:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:49.486 16:42:35 -- common/autotest_common.sh@10 -- # set +x 00:06:49.486 16:42:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:49.486 16:42:35 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:49.486 16:42:35 -- common/autotest_common.sh@650 -- # local es=0 00:06:49.486 16:42:35 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:49.486 16:42:35 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:49.486 16:42:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:49.486 16:42:35 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:49.486 16:42:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:49.486 16:42:35 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:49.486 16:42:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:49.486 16:42:35 -- common/autotest_common.sh@10 -- # set +x 00:06:49.486 [2024-11-16 16:42:35.138720] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1083435 has claimed it. 00:06:49.486 request: 00:06:49.486 { 00:06:49.486 "method": "framework_enable_cpumask_locks", 00:06:49.486 "req_id": 1 00:06:49.486 } 00:06:49.486 Got JSON-RPC error response 00:06:49.486 response: 00:06:49.486 { 00:06:49.486 "code": -32603, 00:06:49.486 "message": "Failed to claim CPU core: 2" 00:06:49.486 } 00:06:49.486 16:42:35 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:49.486 16:42:35 -- common/autotest_common.sh@653 -- # es=1 00:06:49.486 16:42:35 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:49.486 16:42:35 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:49.486 16:42:35 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:49.486 16:42:35 -- event/cpu_locks.sh@158 -- # waitforlisten 1083435 /var/tmp/spdk.sock 00:06:49.486 16:42:35 -- common/autotest_common.sh@829 -- # '[' -z 1083435 ']' 00:06:49.486 16:42:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:49.486 16:42:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:49.486 16:42:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:49.486 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:49.486 16:42:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:49.486 16:42:35 -- common/autotest_common.sh@10 -- # set +x 00:06:49.745 16:42:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:49.745 16:42:35 -- common/autotest_common.sh@862 -- # return 0 00:06:49.745 16:42:35 -- event/cpu_locks.sh@159 -- # waitforlisten 1083538 /var/tmp/spdk2.sock 00:06:49.745 16:42:35 -- common/autotest_common.sh@829 -- # '[' -z 1083538 ']' 00:06:49.745 16:42:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:49.745 16:42:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:49.745 16:42:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:49.745 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:49.745 16:42:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:49.745 16:42:35 -- common/autotest_common.sh@10 -- # set +x 00:06:50.004 16:42:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:50.004 16:42:35 -- common/autotest_common.sh@862 -- # return 0 00:06:50.004 16:42:35 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:50.004 16:42:35 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:50.004 16:42:35 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:50.004 16:42:35 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:50.004 00:06:50.005 real 0m2.550s 00:06:50.005 user 0m1.272s 00:06:50.005 sys 0m0.208s 00:06:50.005 16:42:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.005 16:42:35 -- common/autotest_common.sh@10 -- # set +x 00:06:50.005 ************************************ 00:06:50.005 END TEST locking_overlapped_coremask_via_rpc 00:06:50.005 ************************************ 00:06:50.005 16:42:35 -- event/cpu_locks.sh@174 -- # cleanup 00:06:50.005 16:42:35 -- event/cpu_locks.sh@15 -- # [[ -z 1083435 ]] 00:06:50.005 16:42:35 -- event/cpu_locks.sh@15 -- # killprocess 1083435 00:06:50.005 16:42:35 -- common/autotest_common.sh@936 -- # '[' -z 1083435 ']' 00:06:50.005 16:42:35 -- common/autotest_common.sh@940 -- # kill -0 1083435 00:06:50.005 16:42:35 -- common/autotest_common.sh@941 -- # uname 00:06:50.005 16:42:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:50.005 16:42:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1083435 00:06:50.005 16:42:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:50.005 16:42:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:50.005 16:42:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1083435' 00:06:50.005 killing process with pid 1083435 00:06:50.005 16:42:35 -- common/autotest_common.sh@955 -- # kill 1083435 00:06:50.005 16:42:35 -- common/autotest_common.sh@960 -- # wait 1083435 00:06:50.574 16:42:36 -- event/cpu_locks.sh@16 -- # [[ -z 1083538 ]] 00:06:50.574 16:42:36 -- event/cpu_locks.sh@16 -- # killprocess 1083538 00:06:50.574 16:42:36 -- common/autotest_common.sh@936 -- # '[' -z 1083538 ']' 00:06:50.574 16:42:36 -- common/autotest_common.sh@940 -- # kill -0 1083538 00:06:50.574 16:42:36 -- common/autotest_common.sh@941 -- # uname 00:06:50.575 16:42:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:50.575 16:42:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1083538 00:06:50.575 16:42:36 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:50.575 16:42:36 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:50.575 16:42:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1083538' 00:06:50.575 killing process with pid 1083538 00:06:50.575 16:42:36 -- common/autotest_common.sh@955 -- # kill 1083538 00:06:50.575 16:42:36 -- common/autotest_common.sh@960 -- # wait 1083538 00:06:50.834 16:42:36 -- event/cpu_locks.sh@18 -- # rm -f 00:06:50.834 16:42:36 -- event/cpu_locks.sh@1 -- # cleanup 00:06:50.834 16:42:36 -- event/cpu_locks.sh@15 -- # [[ -z 1083435 ]] 00:06:50.834 16:42:36 -- event/cpu_locks.sh@15 -- # killprocess 1083435 00:06:50.834 16:42:36 -- common/autotest_common.sh@936 -- # '[' -z 1083435 ']' 00:06:50.834 16:42:36 -- common/autotest_common.sh@940 -- # kill -0 1083435 00:06:50.834 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1083435) - No such process 00:06:50.834 16:42:36 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1083435 is not found' 00:06:50.834 Process with pid 1083435 is not found 00:06:50.834 16:42:36 -- event/cpu_locks.sh@16 -- # [[ -z 1083538 ]] 00:06:50.834 16:42:36 -- event/cpu_locks.sh@16 -- # killprocess 1083538 00:06:50.834 16:42:36 -- common/autotest_common.sh@936 -- # '[' -z 1083538 ']' 00:06:50.834 16:42:36 -- common/autotest_common.sh@940 -- # kill -0 1083538 00:06:50.834 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1083538) - No such process 00:06:50.834 16:42:36 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1083538 is not found' 00:06:50.834 Process with pid 1083538 is not found 00:06:50.834 16:42:36 -- event/cpu_locks.sh@18 -- # rm -f 00:06:50.834 00:06:50.834 real 0m19.370s 00:06:50.834 user 0m35.163s 00:06:50.834 sys 0m5.491s 00:06:50.834 16:42:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.834 16:42:36 -- common/autotest_common.sh@10 -- # set +x 00:06:50.834 ************************************ 00:06:50.834 END TEST cpu_locks 00:06:50.834 ************************************ 00:06:51.092 00:06:51.092 real 0m45.542s 00:06:51.092 user 1m27.772s 00:06:51.092 sys 0m9.488s 00:06:51.092 16:42:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:51.092 16:42:36 -- common/autotest_common.sh@10 -- # set +x 00:06:51.092 ************************************ 00:06:51.092 END TEST event 00:06:51.092 ************************************ 00:06:51.092 16:42:36 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:51.092 16:42:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:51.092 16:42:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.092 16:42:36 -- common/autotest_common.sh@10 -- # set +x 00:06:51.092 ************************************ 00:06:51.092 START TEST thread 00:06:51.092 ************************************ 00:06:51.092 16:42:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:51.092 * Looking for test storage... 00:06:51.092 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:51.092 16:42:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:51.092 16:42:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:51.092 16:42:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:51.092 16:42:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:51.092 16:42:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:51.092 16:42:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:51.092 16:42:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:51.092 16:42:36 -- scripts/common.sh@335 -- # IFS=.-: 00:06:51.092 16:42:36 -- scripts/common.sh@335 -- # read -ra ver1 00:06:51.092 16:42:36 -- scripts/common.sh@336 -- # IFS=.-: 00:06:51.092 16:42:36 -- scripts/common.sh@336 -- # read -ra ver2 00:06:51.092 16:42:36 -- scripts/common.sh@337 -- # local 'op=<' 00:06:51.092 16:42:36 -- scripts/common.sh@339 -- # ver1_l=2 00:06:51.092 16:42:36 -- scripts/common.sh@340 -- # ver2_l=1 00:06:51.092 16:42:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:51.092 16:42:36 -- scripts/common.sh@343 -- # case "$op" in 00:06:51.092 16:42:36 -- scripts/common.sh@344 -- # : 1 00:06:51.092 16:42:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:51.092 16:42:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:51.092 16:42:36 -- scripts/common.sh@364 -- # decimal 1 00:06:51.092 16:42:36 -- scripts/common.sh@352 -- # local d=1 00:06:51.092 16:42:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:51.092 16:42:36 -- scripts/common.sh@354 -- # echo 1 00:06:51.092 16:42:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:51.092 16:42:36 -- scripts/common.sh@365 -- # decimal 2 00:06:51.092 16:42:36 -- scripts/common.sh@352 -- # local d=2 00:06:51.092 16:42:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:51.092 16:42:36 -- scripts/common.sh@354 -- # echo 2 00:06:51.092 16:42:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:51.092 16:42:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:51.092 16:42:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:51.092 16:42:36 -- scripts/common.sh@367 -- # return 0 00:06:51.092 16:42:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:51.092 16:42:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:51.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.092 --rc genhtml_branch_coverage=1 00:06:51.092 --rc genhtml_function_coverage=1 00:06:51.092 --rc genhtml_legend=1 00:06:51.092 --rc geninfo_all_blocks=1 00:06:51.092 --rc geninfo_unexecuted_blocks=1 00:06:51.092 00:06:51.092 ' 00:06:51.092 16:42:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:51.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.092 --rc genhtml_branch_coverage=1 00:06:51.092 --rc genhtml_function_coverage=1 00:06:51.092 --rc genhtml_legend=1 00:06:51.092 --rc geninfo_all_blocks=1 00:06:51.092 --rc geninfo_unexecuted_blocks=1 00:06:51.092 00:06:51.092 ' 00:06:51.092 16:42:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:51.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.092 --rc genhtml_branch_coverage=1 00:06:51.092 --rc genhtml_function_coverage=1 00:06:51.092 --rc genhtml_legend=1 00:06:51.092 --rc geninfo_all_blocks=1 00:06:51.092 --rc geninfo_unexecuted_blocks=1 00:06:51.092 00:06:51.092 ' 00:06:51.092 16:42:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:51.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.092 --rc genhtml_branch_coverage=1 00:06:51.092 --rc genhtml_function_coverage=1 00:06:51.092 --rc genhtml_legend=1 00:06:51.092 --rc geninfo_all_blocks=1 00:06:51.092 --rc geninfo_unexecuted_blocks=1 00:06:51.092 00:06:51.092 ' 00:06:51.092 16:42:36 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:51.092 16:42:36 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:51.092 16:42:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.092 16:42:36 -- common/autotest_common.sh@10 -- # set +x 00:06:51.092 ************************************ 00:06:51.092 START TEST thread_poller_perf 00:06:51.093 ************************************ 00:06:51.093 16:42:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:51.093 [2024-11-16 16:42:36.769717] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:51.093 [2024-11-16 16:42:36.769795] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1084047 ] 00:06:51.093 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.093 [2024-11-16 16:42:36.831046] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:51.352 [2024-11-16 16:42:36.919128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.352 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:52.292 [2024-11-16T15:42:38.042Z] ====================================== 00:06:52.292 [2024-11-16T15:42:38.042Z] busy:2709386481 (cyc) 00:06:52.292 [2024-11-16T15:42:38.042Z] total_run_count: 279000 00:06:52.292 [2024-11-16T15:42:38.042Z] tsc_hz: 2700000000 (cyc) 00:06:52.292 [2024-11-16T15:42:38.042Z] ====================================== 00:06:52.292 [2024-11-16T15:42:38.042Z] poller_cost: 9711 (cyc), 3596 (nsec) 00:06:52.292 00:06:52.292 real 0m1.253s 00:06:52.292 user 0m1.162s 00:06:52.292 sys 0m0.084s 00:06:52.292 16:42:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:52.292 16:42:38 -- common/autotest_common.sh@10 -- # set +x 00:06:52.292 ************************************ 00:06:52.292 END TEST thread_poller_perf 00:06:52.292 ************************************ 00:06:52.292 16:42:38 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:52.292 16:42:38 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:52.292 16:42:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:52.292 16:42:38 -- common/autotest_common.sh@10 -- # set +x 00:06:52.292 ************************************ 00:06:52.292 START TEST thread_poller_perf 00:06:52.292 ************************************ 00:06:52.292 16:42:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:52.552 [2024-11-16 16:42:38.045599] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:52.552 [2024-11-16 16:42:38.045703] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1084202 ] 00:06:52.552 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.552 [2024-11-16 16:42:38.104994] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:52.552 [2024-11-16 16:42:38.195021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.552 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:53.934 [2024-11-16T15:42:39.684Z] ====================================== 00:06:53.934 [2024-11-16T15:42:39.684Z] busy:2703750307 (cyc) 00:06:53.934 [2024-11-16T15:42:39.684Z] total_run_count: 3840000 00:06:53.934 [2024-11-16T15:42:39.684Z] tsc_hz: 2700000000 (cyc) 00:06:53.934 [2024-11-16T15:42:39.684Z] ====================================== 00:06:53.934 [2024-11-16T15:42:39.684Z] poller_cost: 704 (cyc), 260 (nsec) 00:06:53.934 00:06:53.934 real 0m1.245s 00:06:53.934 user 0m1.163s 00:06:53.934 sys 0m0.075s 00:06:53.934 16:42:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:53.934 16:42:39 -- common/autotest_common.sh@10 -- # set +x 00:06:53.934 ************************************ 00:06:53.934 END TEST thread_poller_perf 00:06:53.934 ************************************ 00:06:53.934 16:42:39 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:53.934 00:06:53.934 real 0m2.678s 00:06:53.934 user 0m2.436s 00:06:53.934 sys 0m0.245s 00:06:53.934 16:42:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:53.934 16:42:39 -- common/autotest_common.sh@10 -- # set +x 00:06:53.934 ************************************ 00:06:53.934 END TEST thread 00:06:53.934 ************************************ 00:06:53.934 16:42:39 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:53.934 16:42:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:53.934 16:42:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.934 16:42:39 -- common/autotest_common.sh@10 -- # set +x 00:06:53.934 ************************************ 00:06:53.934 START TEST accel 00:06:53.934 ************************************ 00:06:53.934 16:42:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:53.934 * Looking for test storage... 00:06:53.934 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:53.934 16:42:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:53.934 16:42:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:53.934 16:42:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:53.934 16:42:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:53.934 16:42:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:53.934 16:42:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:53.934 16:42:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:53.934 16:42:39 -- scripts/common.sh@335 -- # IFS=.-: 00:06:53.934 16:42:39 -- scripts/common.sh@335 -- # read -ra ver1 00:06:53.934 16:42:39 -- scripts/common.sh@336 -- # IFS=.-: 00:06:53.934 16:42:39 -- scripts/common.sh@336 -- # read -ra ver2 00:06:53.934 16:42:39 -- scripts/common.sh@337 -- # local 'op=<' 00:06:53.934 16:42:39 -- scripts/common.sh@339 -- # ver1_l=2 00:06:53.934 16:42:39 -- scripts/common.sh@340 -- # ver2_l=1 00:06:53.934 16:42:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:53.934 16:42:39 -- scripts/common.sh@343 -- # case "$op" in 00:06:53.934 16:42:39 -- scripts/common.sh@344 -- # : 1 00:06:53.934 16:42:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:53.934 16:42:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:53.934 16:42:39 -- scripts/common.sh@364 -- # decimal 1 00:06:53.934 16:42:39 -- scripts/common.sh@352 -- # local d=1 00:06:53.934 16:42:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:53.934 16:42:39 -- scripts/common.sh@354 -- # echo 1 00:06:53.934 16:42:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:53.934 16:42:39 -- scripts/common.sh@365 -- # decimal 2 00:06:53.934 16:42:39 -- scripts/common.sh@352 -- # local d=2 00:06:53.934 16:42:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:53.934 16:42:39 -- scripts/common.sh@354 -- # echo 2 00:06:53.934 16:42:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:53.934 16:42:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:53.934 16:42:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:53.934 16:42:39 -- scripts/common.sh@367 -- # return 0 00:06:53.934 16:42:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:53.934 16:42:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:53.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:53.934 --rc genhtml_branch_coverage=1 00:06:53.934 --rc genhtml_function_coverage=1 00:06:53.934 --rc genhtml_legend=1 00:06:53.934 --rc geninfo_all_blocks=1 00:06:53.934 --rc geninfo_unexecuted_blocks=1 00:06:53.934 00:06:53.934 ' 00:06:53.934 16:42:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:53.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:53.934 --rc genhtml_branch_coverage=1 00:06:53.934 --rc genhtml_function_coverage=1 00:06:53.934 --rc genhtml_legend=1 00:06:53.934 --rc geninfo_all_blocks=1 00:06:53.934 --rc geninfo_unexecuted_blocks=1 00:06:53.934 00:06:53.934 ' 00:06:53.934 16:42:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:53.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:53.934 --rc genhtml_branch_coverage=1 00:06:53.934 --rc genhtml_function_coverage=1 00:06:53.934 --rc genhtml_legend=1 00:06:53.934 --rc geninfo_all_blocks=1 00:06:53.934 --rc geninfo_unexecuted_blocks=1 00:06:53.934 00:06:53.934 ' 00:06:53.934 16:42:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:53.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:53.934 --rc genhtml_branch_coverage=1 00:06:53.934 --rc genhtml_function_coverage=1 00:06:53.934 --rc genhtml_legend=1 00:06:53.934 --rc geninfo_all_blocks=1 00:06:53.934 --rc geninfo_unexecuted_blocks=1 00:06:53.934 00:06:53.934 ' 00:06:53.934 16:42:39 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:53.934 16:42:39 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:53.934 16:42:39 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:53.934 16:42:39 -- accel/accel.sh@59 -- # spdk_tgt_pid=1084410 00:06:53.934 16:42:39 -- accel/accel.sh@60 -- # waitforlisten 1084410 00:06:53.934 16:42:39 -- common/autotest_common.sh@829 -- # '[' -z 1084410 ']' 00:06:53.934 16:42:39 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:53.934 16:42:39 -- accel/accel.sh@58 -- # build_accel_config 00:06:53.934 16:42:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:53.934 16:42:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:53.934 16:42:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:53.934 16:42:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:53.934 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:53.934 16:42:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.934 16:42:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:53.935 16:42:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.935 16:42:39 -- common/autotest_common.sh@10 -- # set +x 00:06:53.935 16:42:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:53.935 16:42:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:53.935 16:42:39 -- accel/accel.sh@41 -- # local IFS=, 00:06:53.935 16:42:39 -- accel/accel.sh@42 -- # jq -r . 00:06:53.935 [2024-11-16 16:42:39.502180] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:53.935 [2024-11-16 16:42:39.502269] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1084410 ] 00:06:53.935 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.935 [2024-11-16 16:42:39.563692] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.935 [2024-11-16 16:42:39.652553] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:53.935 [2024-11-16 16:42:39.652744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.874 16:42:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:54.874 16:42:40 -- common/autotest_common.sh@862 -- # return 0 00:06:54.874 16:42:40 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:54.874 16:42:40 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:54.874 16:42:40 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:54.874 16:42:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:54.874 16:42:40 -- common/autotest_common.sh@10 -- # set +x 00:06:54.874 16:42:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:54.874 16:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:54.874 16:42:40 -- accel/accel.sh@64 -- # IFS== 00:06:54.874 16:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:06:54.874 16:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:54.874 16:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:54.874 16:42:40 -- accel/accel.sh@64 -- # IFS== 00:06:54.874 16:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:06:54.874 16:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:54.874 16:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:54.874 16:42:40 -- accel/accel.sh@64 -- # IFS== 00:06:54.874 16:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:06:54.874 16:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:54.874 16:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # IFS== 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:06:54.875 16:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:54.875 16:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # IFS== 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:06:54.875 16:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:54.875 16:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # IFS== 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:06:54.875 16:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:54.875 16:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # IFS== 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:06:54.875 16:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:54.875 16:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # IFS== 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:06:54.875 16:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:54.875 16:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # IFS== 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:06:54.875 16:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:54.875 16:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # IFS== 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:06:54.875 16:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:54.875 16:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # IFS== 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:06:54.875 16:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:54.875 16:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # IFS== 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:06:54.875 16:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:54.875 16:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # IFS== 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:06:54.875 16:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:54.875 16:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # IFS== 00:06:54.875 16:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:06:54.875 16:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:54.875 16:42:40 -- accel/accel.sh@67 -- # killprocess 1084410 00:06:54.875 16:42:40 -- common/autotest_common.sh@936 -- # '[' -z 1084410 ']' 00:06:54.875 16:42:40 -- common/autotest_common.sh@940 -- # kill -0 1084410 00:06:54.875 16:42:40 -- common/autotest_common.sh@941 -- # uname 00:06:54.875 16:42:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:54.875 16:42:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1084410 00:06:54.875 16:42:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:54.875 16:42:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:54.875 16:42:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1084410' 00:06:54.875 killing process with pid 1084410 00:06:54.875 16:42:40 -- common/autotest_common.sh@955 -- # kill 1084410 00:06:54.875 16:42:40 -- common/autotest_common.sh@960 -- # wait 1084410 00:06:55.445 16:42:40 -- accel/accel.sh@68 -- # trap - ERR 00:06:55.445 16:42:40 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:55.445 16:42:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:55.445 16:42:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.445 16:42:40 -- common/autotest_common.sh@10 -- # set +x 00:06:55.445 16:42:40 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:06:55.445 16:42:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:55.445 16:42:40 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.445 16:42:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.445 16:42:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.445 16:42:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.445 16:42:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.445 16:42:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.445 16:42:40 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.445 16:42:40 -- accel/accel.sh@42 -- # jq -r . 00:06:55.445 16:42:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:55.445 16:42:40 -- common/autotest_common.sh@10 -- # set +x 00:06:55.445 16:42:41 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:55.445 16:42:41 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:55.445 16:42:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.445 16:42:41 -- common/autotest_common.sh@10 -- # set +x 00:06:55.445 ************************************ 00:06:55.445 START TEST accel_missing_filename 00:06:55.445 ************************************ 00:06:55.445 16:42:41 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:06:55.445 16:42:41 -- common/autotest_common.sh@650 -- # local es=0 00:06:55.445 16:42:41 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:55.445 16:42:41 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:55.445 16:42:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:55.445 16:42:41 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:55.445 16:42:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:55.445 16:42:41 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:06:55.445 16:42:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:55.445 16:42:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.445 16:42:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.445 16:42:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.445 16:42:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.445 16:42:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.445 16:42:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.445 16:42:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.445 16:42:41 -- accel/accel.sh@42 -- # jq -r . 00:06:55.445 [2024-11-16 16:42:41.033447] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:55.445 [2024-11-16 16:42:41.033518] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1084647 ] 00:06:55.445 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.445 [2024-11-16 16:42:41.094419] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.445 [2024-11-16 16:42:41.185558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.705 [2024-11-16 16:42:41.241868] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:55.705 [2024-11-16 16:42:41.320025] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:55.705 A filename is required. 00:06:55.705 16:42:41 -- common/autotest_common.sh@653 -- # es=234 00:06:55.705 16:42:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:55.705 16:42:41 -- common/autotest_common.sh@662 -- # es=106 00:06:55.705 16:42:41 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:55.705 16:42:41 -- common/autotest_common.sh@670 -- # es=1 00:06:55.705 16:42:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:55.705 00:06:55.705 real 0m0.384s 00:06:55.705 user 0m0.280s 00:06:55.705 sys 0m0.135s 00:06:55.705 16:42:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:55.705 16:42:41 -- common/autotest_common.sh@10 -- # set +x 00:06:55.705 ************************************ 00:06:55.705 END TEST accel_missing_filename 00:06:55.705 ************************************ 00:06:55.705 16:42:41 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:55.705 16:42:41 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:55.705 16:42:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.705 16:42:41 -- common/autotest_common.sh@10 -- # set +x 00:06:55.705 ************************************ 00:06:55.705 START TEST accel_compress_verify 00:06:55.705 ************************************ 00:06:55.705 16:42:41 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:55.705 16:42:41 -- common/autotest_common.sh@650 -- # local es=0 00:06:55.705 16:42:41 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:55.705 16:42:41 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:55.705 16:42:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:55.705 16:42:41 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:55.705 16:42:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:55.705 16:42:41 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:55.705 16:42:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:55.705 16:42:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.705 16:42:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.705 16:42:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.705 16:42:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.705 16:42:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.705 16:42:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.705 16:42:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.705 16:42:41 -- accel/accel.sh@42 -- # jq -r . 00:06:55.705 [2024-11-16 16:42:41.445682] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:55.705 [2024-11-16 16:42:41.445766] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1084734 ] 00:06:55.965 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.965 [2024-11-16 16:42:41.508058] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.965 [2024-11-16 16:42:41.598398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.965 [2024-11-16 16:42:41.660362] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:56.227 [2024-11-16 16:42:41.744833] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:56.227 00:06:56.227 Compression does not support the verify option, aborting. 00:06:56.227 16:42:41 -- common/autotest_common.sh@653 -- # es=161 00:06:56.227 16:42:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:56.227 16:42:41 -- common/autotest_common.sh@662 -- # es=33 00:06:56.227 16:42:41 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:56.227 16:42:41 -- common/autotest_common.sh@670 -- # es=1 00:06:56.227 16:42:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:56.227 00:06:56.227 real 0m0.397s 00:06:56.227 user 0m0.282s 00:06:56.227 sys 0m0.148s 00:06:56.227 16:42:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.227 16:42:41 -- common/autotest_common.sh@10 -- # set +x 00:06:56.227 ************************************ 00:06:56.227 END TEST accel_compress_verify 00:06:56.227 ************************************ 00:06:56.227 16:42:41 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:56.227 16:42:41 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:56.227 16:42:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.227 16:42:41 -- common/autotest_common.sh@10 -- # set +x 00:06:56.227 ************************************ 00:06:56.227 START TEST accel_wrong_workload 00:06:56.227 ************************************ 00:06:56.227 16:42:41 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:06:56.227 16:42:41 -- common/autotest_common.sh@650 -- # local es=0 00:06:56.227 16:42:41 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:56.227 16:42:41 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:56.227 16:42:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:56.227 16:42:41 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:56.227 16:42:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:56.227 16:42:41 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:06:56.227 16:42:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:56.227 16:42:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.227 16:42:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.227 16:42:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.227 16:42:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.227 16:42:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.227 16:42:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.227 16:42:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.227 16:42:41 -- accel/accel.sh@42 -- # jq -r . 00:06:56.227 Unsupported workload type: foobar 00:06:56.227 [2024-11-16 16:42:41.865958] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:56.227 accel_perf options: 00:06:56.227 [-h help message] 00:06:56.227 [-q queue depth per core] 00:06:56.227 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:56.227 [-T number of threads per core 00:06:56.227 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:56.227 [-t time in seconds] 00:06:56.227 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:56.227 [ dif_verify, , dif_generate, dif_generate_copy 00:06:56.227 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:56.227 [-l for compress/decompress workloads, name of uncompressed input file 00:06:56.227 [-S for crc32c workload, use this seed value (default 0) 00:06:56.227 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:56.227 [-f for fill workload, use this BYTE value (default 255) 00:06:56.227 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:56.227 [-y verify result if this switch is on] 00:06:56.227 [-a tasks to allocate per core (default: same value as -q)] 00:06:56.227 Can be used to spread operations across a wider range of memory. 00:06:56.227 16:42:41 -- common/autotest_common.sh@653 -- # es=1 00:06:56.227 16:42:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:56.227 16:42:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:56.227 16:42:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:56.227 00:06:56.227 real 0m0.021s 00:06:56.227 user 0m0.011s 00:06:56.227 sys 0m0.011s 00:06:56.227 16:42:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.227 16:42:41 -- common/autotest_common.sh@10 -- # set +x 00:06:56.227 ************************************ 00:06:56.227 END TEST accel_wrong_workload 00:06:56.227 ************************************ 00:06:56.227 Error: writing output failed: Broken pipe 00:06:56.227 16:42:41 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:56.227 16:42:41 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:56.227 16:42:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.227 16:42:41 -- common/autotest_common.sh@10 -- # set +x 00:06:56.227 ************************************ 00:06:56.227 START TEST accel_negative_buffers 00:06:56.227 ************************************ 00:06:56.227 16:42:41 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:56.227 16:42:41 -- common/autotest_common.sh@650 -- # local es=0 00:06:56.227 16:42:41 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:56.227 16:42:41 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:56.227 16:42:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:56.227 16:42:41 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:56.227 16:42:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:56.227 16:42:41 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:06:56.227 16:42:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:56.227 16:42:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.227 16:42:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.227 16:42:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.227 16:42:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.227 16:42:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.227 16:42:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.227 16:42:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.227 16:42:41 -- accel/accel.sh@42 -- # jq -r . 00:06:56.227 -x option must be non-negative. 00:06:56.227 [2024-11-16 16:42:41.916569] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:56.227 accel_perf options: 00:06:56.227 [-h help message] 00:06:56.227 [-q queue depth per core] 00:06:56.227 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:56.227 [-T number of threads per core 00:06:56.227 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:56.227 [-t time in seconds] 00:06:56.227 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:56.227 [ dif_verify, , dif_generate, dif_generate_copy 00:06:56.227 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:56.227 [-l for compress/decompress workloads, name of uncompressed input file 00:06:56.227 [-S for crc32c workload, use this seed value (default 0) 00:06:56.227 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:56.227 [-f for fill workload, use this BYTE value (default 255) 00:06:56.227 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:56.227 [-y verify result if this switch is on] 00:06:56.227 [-a tasks to allocate per core (default: same value as -q)] 00:06:56.227 Can be used to spread operations across a wider range of memory. 00:06:56.227 16:42:41 -- common/autotest_common.sh@653 -- # es=1 00:06:56.227 16:42:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:56.227 16:42:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:56.227 16:42:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:56.227 00:06:56.227 real 0m0.024s 00:06:56.227 user 0m0.015s 00:06:56.227 sys 0m0.009s 00:06:56.227 16:42:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.227 16:42:41 -- common/autotest_common.sh@10 -- # set +x 00:06:56.227 ************************************ 00:06:56.227 END TEST accel_negative_buffers 00:06:56.227 ************************************ 00:06:56.227 Error: writing output failed: Broken pipe 00:06:56.227 16:42:41 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:56.227 16:42:41 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:56.227 16:42:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.227 16:42:41 -- common/autotest_common.sh@10 -- # set +x 00:06:56.227 ************************************ 00:06:56.227 START TEST accel_crc32c 00:06:56.227 ************************************ 00:06:56.227 16:42:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:56.227 16:42:41 -- accel/accel.sh@16 -- # local accel_opc 00:06:56.227 16:42:41 -- accel/accel.sh@17 -- # local accel_module 00:06:56.227 16:42:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:56.227 16:42:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:56.227 16:42:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.227 16:42:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.227 16:42:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.227 16:42:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.227 16:42:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.227 16:42:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.227 16:42:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.227 16:42:41 -- accel/accel.sh@42 -- # jq -r . 00:06:56.227 [2024-11-16 16:42:41.960952] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:56.227 [2024-11-16 16:42:41.961016] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1084789 ] 00:06:56.486 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.486 [2024-11-16 16:42:42.023268] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:56.486 [2024-11-16 16:42:42.113780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.871 16:42:43 -- accel/accel.sh@18 -- # out=' 00:06:57.871 SPDK Configuration: 00:06:57.871 Core mask: 0x1 00:06:57.871 00:06:57.871 Accel Perf Configuration: 00:06:57.871 Workload Type: crc32c 00:06:57.871 CRC-32C seed: 32 00:06:57.871 Transfer size: 4096 bytes 00:06:57.871 Vector count 1 00:06:57.871 Module: software 00:06:57.871 Queue depth: 32 00:06:57.871 Allocate depth: 32 00:06:57.871 # threads/core: 1 00:06:57.871 Run time: 1 seconds 00:06:57.871 Verify: Yes 00:06:57.871 00:06:57.871 Running for 1 seconds... 00:06:57.871 00:06:57.871 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:57.871 ------------------------------------------------------------------------------------ 00:06:57.871 0,0 404640/s 1580 MiB/s 0 0 00:06:57.871 ==================================================================================== 00:06:57.871 Total 404640/s 1580 MiB/s 0 0' 00:06:57.871 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.871 16:42:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:57.871 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.871 16:42:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:57.871 16:42:43 -- accel/accel.sh@12 -- # build_accel_config 00:06:57.871 16:42:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:57.871 16:42:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:57.871 16:42:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:57.871 16:42:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:57.871 16:42:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:57.871 16:42:43 -- accel/accel.sh@41 -- # local IFS=, 00:06:57.871 16:42:43 -- accel/accel.sh@42 -- # jq -r . 00:06:57.871 [2024-11-16 16:42:43.357154] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:57.871 [2024-11-16 16:42:43.357245] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1085038 ] 00:06:57.871 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.871 [2024-11-16 16:42:43.418858] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.871 [2024-11-16 16:42:43.508466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.871 16:42:43 -- accel/accel.sh@21 -- # val= 00:06:57.871 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.871 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.871 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.871 16:42:43 -- accel/accel.sh@21 -- # val= 00:06:57.871 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.871 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.871 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.871 16:42:43 -- accel/accel.sh@21 -- # val=0x1 00:06:57.871 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.871 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.871 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.871 16:42:43 -- accel/accel.sh@21 -- # val= 00:06:57.871 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.871 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.871 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.871 16:42:43 -- accel/accel.sh@21 -- # val= 00:06:57.871 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.871 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.871 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.871 16:42:43 -- accel/accel.sh@21 -- # val=crc32c 00:06:57.871 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.871 16:42:43 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:57.871 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.871 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.871 16:42:43 -- accel/accel.sh@21 -- # val=32 00:06:57.872 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.872 16:42:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:57.872 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.872 16:42:43 -- accel/accel.sh@21 -- # val= 00:06:57.872 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.872 16:42:43 -- accel/accel.sh@21 -- # val=software 00:06:57.872 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.872 16:42:43 -- accel/accel.sh@23 -- # accel_module=software 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.872 16:42:43 -- accel/accel.sh@21 -- # val=32 00:06:57.872 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.872 16:42:43 -- accel/accel.sh@21 -- # val=32 00:06:57.872 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.872 16:42:43 -- accel/accel.sh@21 -- # val=1 00:06:57.872 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.872 16:42:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:57.872 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.872 16:42:43 -- accel/accel.sh@21 -- # val=Yes 00:06:57.872 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.872 16:42:43 -- accel/accel.sh@21 -- # val= 00:06:57.872 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:57.872 16:42:43 -- accel/accel.sh@21 -- # val= 00:06:57.872 16:42:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # IFS=: 00:06:57.872 16:42:43 -- accel/accel.sh@20 -- # read -r var val 00:06:59.254 16:42:44 -- accel/accel.sh@21 -- # val= 00:06:59.254 16:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.254 16:42:44 -- accel/accel.sh@20 -- # IFS=: 00:06:59.254 16:42:44 -- accel/accel.sh@20 -- # read -r var val 00:06:59.254 16:42:44 -- accel/accel.sh@21 -- # val= 00:06:59.254 16:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.254 16:42:44 -- accel/accel.sh@20 -- # IFS=: 00:06:59.254 16:42:44 -- accel/accel.sh@20 -- # read -r var val 00:06:59.254 16:42:44 -- accel/accel.sh@21 -- # val= 00:06:59.254 16:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.254 16:42:44 -- accel/accel.sh@20 -- # IFS=: 00:06:59.254 16:42:44 -- accel/accel.sh@20 -- # read -r var val 00:06:59.254 16:42:44 -- accel/accel.sh@21 -- # val= 00:06:59.254 16:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.254 16:42:44 -- accel/accel.sh@20 -- # IFS=: 00:06:59.254 16:42:44 -- accel/accel.sh@20 -- # read -r var val 00:06:59.254 16:42:44 -- accel/accel.sh@21 -- # val= 00:06:59.254 16:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.254 16:42:44 -- accel/accel.sh@20 -- # IFS=: 00:06:59.254 16:42:44 -- accel/accel.sh@20 -- # read -r var val 00:06:59.254 16:42:44 -- accel/accel.sh@21 -- # val= 00:06:59.254 16:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.254 16:42:44 -- accel/accel.sh@20 -- # IFS=: 00:06:59.254 16:42:44 -- accel/accel.sh@20 -- # read -r var val 00:06:59.254 16:42:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:59.254 16:42:44 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:59.254 16:42:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:59.254 00:06:59.254 real 0m2.784s 00:06:59.254 user 0m2.487s 00:06:59.254 sys 0m0.289s 00:06:59.254 16:42:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:59.254 16:42:44 -- common/autotest_common.sh@10 -- # set +x 00:06:59.254 ************************************ 00:06:59.254 END TEST accel_crc32c 00:06:59.254 ************************************ 00:06:59.254 16:42:44 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:59.254 16:42:44 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:59.255 16:42:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.255 16:42:44 -- common/autotest_common.sh@10 -- # set +x 00:06:59.255 ************************************ 00:06:59.255 START TEST accel_crc32c_C2 00:06:59.255 ************************************ 00:06:59.255 16:42:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:59.255 16:42:44 -- accel/accel.sh@16 -- # local accel_opc 00:06:59.255 16:42:44 -- accel/accel.sh@17 -- # local accel_module 00:06:59.255 16:42:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:59.255 16:42:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:59.255 16:42:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.255 16:42:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.255 16:42:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.255 16:42:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.255 16:42:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.255 16:42:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.255 16:42:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.255 16:42:44 -- accel/accel.sh@42 -- # jq -r . 00:06:59.255 [2024-11-16 16:42:44.769071] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:59.255 [2024-11-16 16:42:44.769156] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1085217 ] 00:06:59.255 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.255 [2024-11-16 16:42:44.829391] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.255 [2024-11-16 16:42:44.919752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.637 16:42:46 -- accel/accel.sh@18 -- # out=' 00:07:00.637 SPDK Configuration: 00:07:00.637 Core mask: 0x1 00:07:00.637 00:07:00.637 Accel Perf Configuration: 00:07:00.637 Workload Type: crc32c 00:07:00.637 CRC-32C seed: 0 00:07:00.637 Transfer size: 4096 bytes 00:07:00.637 Vector count 2 00:07:00.637 Module: software 00:07:00.637 Queue depth: 32 00:07:00.637 Allocate depth: 32 00:07:00.637 # threads/core: 1 00:07:00.637 Run time: 1 seconds 00:07:00.637 Verify: Yes 00:07:00.637 00:07:00.637 Running for 1 seconds... 00:07:00.637 00:07:00.637 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:00.637 ------------------------------------------------------------------------------------ 00:07:00.637 0,0 310304/s 2424 MiB/s 0 0 00:07:00.637 ==================================================================================== 00:07:00.637 Total 310304/s 1212 MiB/s 0 0' 00:07:00.637 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.637 16:42:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:00.637 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.637 16:42:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:00.637 16:42:46 -- accel/accel.sh@12 -- # build_accel_config 00:07:00.637 16:42:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:00.637 16:42:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:00.637 16:42:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:00.637 16:42:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:00.637 16:42:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:00.637 16:42:46 -- accel/accel.sh@41 -- # local IFS=, 00:07:00.637 16:42:46 -- accel/accel.sh@42 -- # jq -r . 00:07:00.637 [2024-11-16 16:42:46.175663] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:00.637 [2024-11-16 16:42:46.175755] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1085355 ] 00:07:00.637 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.637 [2024-11-16 16:42:46.235754] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.637 [2024-11-16 16:42:46.326025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val= 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val= 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val=0x1 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val= 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val= 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val=crc32c 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val=0 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val= 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val=software 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@23 -- # accel_module=software 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val=32 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val=32 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val=1 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val=Yes 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val= 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:00.897 16:42:46 -- accel/accel.sh@21 -- # val= 00:07:00.897 16:42:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # IFS=: 00:07:00.897 16:42:46 -- accel/accel.sh@20 -- # read -r var val 00:07:01.836 16:42:47 -- accel/accel.sh@21 -- # val= 00:07:01.836 16:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.836 16:42:47 -- accel/accel.sh@20 -- # IFS=: 00:07:01.836 16:42:47 -- accel/accel.sh@20 -- # read -r var val 00:07:01.836 16:42:47 -- accel/accel.sh@21 -- # val= 00:07:01.836 16:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.836 16:42:47 -- accel/accel.sh@20 -- # IFS=: 00:07:01.836 16:42:47 -- accel/accel.sh@20 -- # read -r var val 00:07:01.836 16:42:47 -- accel/accel.sh@21 -- # val= 00:07:01.836 16:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.836 16:42:47 -- accel/accel.sh@20 -- # IFS=: 00:07:01.836 16:42:47 -- accel/accel.sh@20 -- # read -r var val 00:07:01.836 16:42:47 -- accel/accel.sh@21 -- # val= 00:07:01.836 16:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.836 16:42:47 -- accel/accel.sh@20 -- # IFS=: 00:07:01.836 16:42:47 -- accel/accel.sh@20 -- # read -r var val 00:07:01.836 16:42:47 -- accel/accel.sh@21 -- # val= 00:07:01.836 16:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.836 16:42:47 -- accel/accel.sh@20 -- # IFS=: 00:07:01.836 16:42:47 -- accel/accel.sh@20 -- # read -r var val 00:07:01.836 16:42:47 -- accel/accel.sh@21 -- # val= 00:07:01.836 16:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.836 16:42:47 -- accel/accel.sh@20 -- # IFS=: 00:07:01.836 16:42:47 -- accel/accel.sh@20 -- # read -r var val 00:07:01.836 16:42:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:01.836 16:42:47 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:07:01.836 16:42:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:01.836 00:07:01.836 real 0m2.811s 00:07:01.836 user 0m2.523s 00:07:01.836 sys 0m0.280s 00:07:01.836 16:42:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:01.836 16:42:47 -- common/autotest_common.sh@10 -- # set +x 00:07:01.836 ************************************ 00:07:01.836 END TEST accel_crc32c_C2 00:07:01.836 ************************************ 00:07:01.836 16:42:47 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:07:01.836 16:42:47 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:01.836 16:42:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.836 16:42:47 -- common/autotest_common.sh@10 -- # set +x 00:07:02.094 ************************************ 00:07:02.094 START TEST accel_copy 00:07:02.094 ************************************ 00:07:02.094 16:42:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:07:02.094 16:42:47 -- accel/accel.sh@16 -- # local accel_opc 00:07:02.094 16:42:47 -- accel/accel.sh@17 -- # local accel_module 00:07:02.094 16:42:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:07:02.094 16:42:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:02.094 16:42:47 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.094 16:42:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.094 16:42:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.094 16:42:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.094 16:42:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.094 16:42:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.094 16:42:47 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.094 16:42:47 -- accel/accel.sh@42 -- # jq -r . 00:07:02.094 [2024-11-16 16:42:47.605606] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:02.094 [2024-11-16 16:42:47.605716] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1085516 ] 00:07:02.094 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.094 [2024-11-16 16:42:47.666273] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.094 [2024-11-16 16:42:47.756556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.475 16:42:48 -- accel/accel.sh@18 -- # out=' 00:07:03.475 SPDK Configuration: 00:07:03.475 Core mask: 0x1 00:07:03.475 00:07:03.475 Accel Perf Configuration: 00:07:03.475 Workload Type: copy 00:07:03.475 Transfer size: 4096 bytes 00:07:03.475 Vector count 1 00:07:03.475 Module: software 00:07:03.475 Queue depth: 32 00:07:03.475 Allocate depth: 32 00:07:03.475 # threads/core: 1 00:07:03.475 Run time: 1 seconds 00:07:03.475 Verify: Yes 00:07:03.475 00:07:03.475 Running for 1 seconds... 00:07:03.475 00:07:03.475 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:03.475 ------------------------------------------------------------------------------------ 00:07:03.475 0,0 277216/s 1082 MiB/s 0 0 00:07:03.475 ==================================================================================== 00:07:03.475 Total 277216/s 1082 MiB/s 0 0' 00:07:03.475 16:42:48 -- accel/accel.sh@20 -- # IFS=: 00:07:03.475 16:42:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:07:03.475 16:42:48 -- accel/accel.sh@20 -- # read -r var val 00:07:03.475 16:42:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:03.475 16:42:48 -- accel/accel.sh@12 -- # build_accel_config 00:07:03.475 16:42:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:03.475 16:42:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.475 16:42:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.475 16:42:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:03.475 16:42:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:03.475 16:42:48 -- accel/accel.sh@41 -- # local IFS=, 00:07:03.475 16:42:48 -- accel/accel.sh@42 -- # jq -r . 00:07:03.475 [2024-11-16 16:42:49.003290] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:03.475 [2024-11-16 16:42:49.003377] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1085726 ] 00:07:03.475 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.475 [2024-11-16 16:42:49.064506] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.475 [2024-11-16 16:42:49.157504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.475 16:42:49 -- accel/accel.sh@21 -- # val= 00:07:03.475 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.475 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.475 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val= 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val=0x1 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val= 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val= 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val=copy 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@24 -- # accel_opc=copy 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val= 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val=software 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@23 -- # accel_module=software 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val=32 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val=32 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val=1 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val=Yes 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val= 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:03.476 16:42:49 -- accel/accel.sh@21 -- # val= 00:07:03.476 16:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # IFS=: 00:07:03.476 16:42:49 -- accel/accel.sh@20 -- # read -r var val 00:07:04.852 16:42:50 -- accel/accel.sh@21 -- # val= 00:07:04.852 16:42:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.852 16:42:50 -- accel/accel.sh@20 -- # IFS=: 00:07:04.852 16:42:50 -- accel/accel.sh@20 -- # read -r var val 00:07:04.852 16:42:50 -- accel/accel.sh@21 -- # val= 00:07:04.852 16:42:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.852 16:42:50 -- accel/accel.sh@20 -- # IFS=: 00:07:04.852 16:42:50 -- accel/accel.sh@20 -- # read -r var val 00:07:04.852 16:42:50 -- accel/accel.sh@21 -- # val= 00:07:04.852 16:42:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.852 16:42:50 -- accel/accel.sh@20 -- # IFS=: 00:07:04.852 16:42:50 -- accel/accel.sh@20 -- # read -r var val 00:07:04.852 16:42:50 -- accel/accel.sh@21 -- # val= 00:07:04.852 16:42:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.852 16:42:50 -- accel/accel.sh@20 -- # IFS=: 00:07:04.852 16:42:50 -- accel/accel.sh@20 -- # read -r var val 00:07:04.852 16:42:50 -- accel/accel.sh@21 -- # val= 00:07:04.852 16:42:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.852 16:42:50 -- accel/accel.sh@20 -- # IFS=: 00:07:04.852 16:42:50 -- accel/accel.sh@20 -- # read -r var val 00:07:04.852 16:42:50 -- accel/accel.sh@21 -- # val= 00:07:04.852 16:42:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.852 16:42:50 -- accel/accel.sh@20 -- # IFS=: 00:07:04.852 16:42:50 -- accel/accel.sh@20 -- # read -r var val 00:07:04.852 16:42:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:04.852 16:42:50 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:07:04.852 16:42:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:04.852 00:07:04.852 real 0m2.787s 00:07:04.852 user 0m2.495s 00:07:04.852 sys 0m0.282s 00:07:04.852 16:42:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:04.852 16:42:50 -- common/autotest_common.sh@10 -- # set +x 00:07:04.852 ************************************ 00:07:04.852 END TEST accel_copy 00:07:04.852 ************************************ 00:07:04.852 16:42:50 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:04.852 16:42:50 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:04.852 16:42:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.852 16:42:50 -- common/autotest_common.sh@10 -- # set +x 00:07:04.852 ************************************ 00:07:04.852 START TEST accel_fill 00:07:04.852 ************************************ 00:07:04.852 16:42:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:04.852 16:42:50 -- accel/accel.sh@16 -- # local accel_opc 00:07:04.852 16:42:50 -- accel/accel.sh@17 -- # local accel_module 00:07:04.852 16:42:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:04.852 16:42:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:04.852 16:42:50 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.852 16:42:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:04.852 16:42:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.852 16:42:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.852 16:42:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:04.852 16:42:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:04.852 16:42:50 -- accel/accel.sh@41 -- # local IFS=, 00:07:04.852 16:42:50 -- accel/accel.sh@42 -- # jq -r . 00:07:04.852 [2024-11-16 16:42:50.416809] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:04.852 [2024-11-16 16:42:50.416885] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1085935 ] 00:07:04.852 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.852 [2024-11-16 16:42:50.479263] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.852 [2024-11-16 16:42:50.569446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.231 16:42:51 -- accel/accel.sh@18 -- # out=' 00:07:06.231 SPDK Configuration: 00:07:06.231 Core mask: 0x1 00:07:06.231 00:07:06.231 Accel Perf Configuration: 00:07:06.231 Workload Type: fill 00:07:06.231 Fill pattern: 0x80 00:07:06.231 Transfer size: 4096 bytes 00:07:06.231 Vector count 1 00:07:06.231 Module: software 00:07:06.231 Queue depth: 64 00:07:06.231 Allocate depth: 64 00:07:06.231 # threads/core: 1 00:07:06.231 Run time: 1 seconds 00:07:06.231 Verify: Yes 00:07:06.231 00:07:06.231 Running for 1 seconds... 00:07:06.231 00:07:06.231 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:06.231 ------------------------------------------------------------------------------------ 00:07:06.231 0,0 403264/s 1575 MiB/s 0 0 00:07:06.231 ==================================================================================== 00:07:06.231 Total 403264/s 1575 MiB/s 0 0' 00:07:06.231 16:42:51 -- accel/accel.sh@20 -- # IFS=: 00:07:06.231 16:42:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:06.231 16:42:51 -- accel/accel.sh@20 -- # read -r var val 00:07:06.231 16:42:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:06.231 16:42:51 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.231 16:42:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.231 16:42:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.231 16:42:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.231 16:42:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.231 16:42:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.231 16:42:51 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.231 16:42:51 -- accel/accel.sh@42 -- # jq -r . 00:07:06.231 [2024-11-16 16:42:51.825777] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:06.231 [2024-11-16 16:42:51.825865] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1086082 ] 00:07:06.231 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.231 [2024-11-16 16:42:51.885824] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.231 [2024-11-16 16:42:51.975774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val= 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val= 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val=0x1 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val= 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val= 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val=fill 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@24 -- # accel_opc=fill 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val=0x80 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val= 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val=software 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@23 -- # accel_module=software 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val=64 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val=64 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val=1 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val=Yes 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val= 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:06.492 16:42:52 -- accel/accel.sh@21 -- # val= 00:07:06.492 16:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # IFS=: 00:07:06.492 16:42:52 -- accel/accel.sh@20 -- # read -r var val 00:07:07.873 16:42:53 -- accel/accel.sh@21 -- # val= 00:07:07.873 16:42:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.873 16:42:53 -- accel/accel.sh@20 -- # IFS=: 00:07:07.873 16:42:53 -- accel/accel.sh@20 -- # read -r var val 00:07:07.873 16:42:53 -- accel/accel.sh@21 -- # val= 00:07:07.873 16:42:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.874 16:42:53 -- accel/accel.sh@20 -- # IFS=: 00:07:07.874 16:42:53 -- accel/accel.sh@20 -- # read -r var val 00:07:07.874 16:42:53 -- accel/accel.sh@21 -- # val= 00:07:07.874 16:42:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.874 16:42:53 -- accel/accel.sh@20 -- # IFS=: 00:07:07.874 16:42:53 -- accel/accel.sh@20 -- # read -r var val 00:07:07.874 16:42:53 -- accel/accel.sh@21 -- # val= 00:07:07.874 16:42:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.874 16:42:53 -- accel/accel.sh@20 -- # IFS=: 00:07:07.874 16:42:53 -- accel/accel.sh@20 -- # read -r var val 00:07:07.874 16:42:53 -- accel/accel.sh@21 -- # val= 00:07:07.874 16:42:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.874 16:42:53 -- accel/accel.sh@20 -- # IFS=: 00:07:07.874 16:42:53 -- accel/accel.sh@20 -- # read -r var val 00:07:07.874 16:42:53 -- accel/accel.sh@21 -- # val= 00:07:07.874 16:42:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.874 16:42:53 -- accel/accel.sh@20 -- # IFS=: 00:07:07.874 16:42:53 -- accel/accel.sh@20 -- # read -r var val 00:07:07.874 16:42:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:07.874 16:42:53 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:07:07.874 16:42:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:07.874 00:07:07.874 real 0m2.816s 00:07:07.874 user 0m2.529s 00:07:07.874 sys 0m0.278s 00:07:07.874 16:42:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.874 16:42:53 -- common/autotest_common.sh@10 -- # set +x 00:07:07.874 ************************************ 00:07:07.874 END TEST accel_fill 00:07:07.874 ************************************ 00:07:07.874 16:42:53 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:07.874 16:42:53 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:07.874 16:42:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.874 16:42:53 -- common/autotest_common.sh@10 -- # set +x 00:07:07.874 ************************************ 00:07:07.874 START TEST accel_copy_crc32c 00:07:07.874 ************************************ 00:07:07.874 16:42:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:07:07.874 16:42:53 -- accel/accel.sh@16 -- # local accel_opc 00:07:07.874 16:42:53 -- accel/accel.sh@17 -- # local accel_module 00:07:07.874 16:42:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:07.874 16:42:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:07.874 16:42:53 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.874 16:42:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.874 16:42:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.874 16:42:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.874 16:42:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.874 16:42:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.874 16:42:53 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.874 16:42:53 -- accel/accel.sh@42 -- # jq -r . 00:07:07.874 [2024-11-16 16:42:53.263405] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:07.874 [2024-11-16 16:42:53.263483] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1086235 ] 00:07:07.874 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.874 [2024-11-16 16:42:53.324651] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.874 [2024-11-16 16:42:53.412794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.256 16:42:54 -- accel/accel.sh@18 -- # out=' 00:07:09.256 SPDK Configuration: 00:07:09.256 Core mask: 0x1 00:07:09.256 00:07:09.256 Accel Perf Configuration: 00:07:09.256 Workload Type: copy_crc32c 00:07:09.256 CRC-32C seed: 0 00:07:09.256 Vector size: 4096 bytes 00:07:09.256 Transfer size: 4096 bytes 00:07:09.256 Vector count 1 00:07:09.256 Module: software 00:07:09.256 Queue depth: 32 00:07:09.256 Allocate depth: 32 00:07:09.256 # threads/core: 1 00:07:09.256 Run time: 1 seconds 00:07:09.256 Verify: Yes 00:07:09.256 00:07:09.256 Running for 1 seconds... 00:07:09.256 00:07:09.256 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:09.256 ------------------------------------------------------------------------------------ 00:07:09.256 0,0 218464/s 853 MiB/s 0 0 00:07:09.256 ==================================================================================== 00:07:09.256 Total 218464/s 853 MiB/s 0 0' 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:09.256 16:42:54 -- accel/accel.sh@12 -- # build_accel_config 00:07:09.256 16:42:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:09.256 16:42:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:09.256 16:42:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:09.256 16:42:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:09.256 16:42:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:09.256 16:42:54 -- accel/accel.sh@41 -- # local IFS=, 00:07:09.256 16:42:54 -- accel/accel.sh@42 -- # jq -r . 00:07:09.256 [2024-11-16 16:42:54.660575] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:09.256 [2024-11-16 16:42:54.660763] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1086429 ] 00:07:09.256 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.256 [2024-11-16 16:42:54.721344] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.256 [2024-11-16 16:42:54.811215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val= 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val= 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val=0x1 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val= 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val= 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val=0 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val= 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val=software 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@23 -- # accel_module=software 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val=32 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val=32 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val=1 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.256 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.256 16:42:54 -- accel/accel.sh@21 -- # val=Yes 00:07:09.256 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.257 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.257 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.257 16:42:54 -- accel/accel.sh@21 -- # val= 00:07:09.257 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.257 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.257 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:09.257 16:42:54 -- accel/accel.sh@21 -- # val= 00:07:09.257 16:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.257 16:42:54 -- accel/accel.sh@20 -- # IFS=: 00:07:09.257 16:42:54 -- accel/accel.sh@20 -- # read -r var val 00:07:10.636 16:42:56 -- accel/accel.sh@21 -- # val= 00:07:10.636 16:42:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.636 16:42:56 -- accel/accel.sh@20 -- # IFS=: 00:07:10.636 16:42:56 -- accel/accel.sh@20 -- # read -r var val 00:07:10.636 16:42:56 -- accel/accel.sh@21 -- # val= 00:07:10.636 16:42:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.636 16:42:56 -- accel/accel.sh@20 -- # IFS=: 00:07:10.636 16:42:56 -- accel/accel.sh@20 -- # read -r var val 00:07:10.636 16:42:56 -- accel/accel.sh@21 -- # val= 00:07:10.636 16:42:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.636 16:42:56 -- accel/accel.sh@20 -- # IFS=: 00:07:10.636 16:42:56 -- accel/accel.sh@20 -- # read -r var val 00:07:10.636 16:42:56 -- accel/accel.sh@21 -- # val= 00:07:10.636 16:42:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.636 16:42:56 -- accel/accel.sh@20 -- # IFS=: 00:07:10.636 16:42:56 -- accel/accel.sh@20 -- # read -r var val 00:07:10.636 16:42:56 -- accel/accel.sh@21 -- # val= 00:07:10.636 16:42:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.636 16:42:56 -- accel/accel.sh@20 -- # IFS=: 00:07:10.636 16:42:56 -- accel/accel.sh@20 -- # read -r var val 00:07:10.636 16:42:56 -- accel/accel.sh@21 -- # val= 00:07:10.636 16:42:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.636 16:42:56 -- accel/accel.sh@20 -- # IFS=: 00:07:10.636 16:42:56 -- accel/accel.sh@20 -- # read -r var val 00:07:10.636 16:42:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:10.636 16:42:56 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:10.636 16:42:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:10.636 00:07:10.636 real 0m2.796s 00:07:10.636 user 0m2.502s 00:07:10.636 sys 0m0.285s 00:07:10.636 16:42:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:10.636 16:42:56 -- common/autotest_common.sh@10 -- # set +x 00:07:10.636 ************************************ 00:07:10.636 END TEST accel_copy_crc32c 00:07:10.636 ************************************ 00:07:10.636 16:42:56 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:10.636 16:42:56 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:10.636 16:42:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.636 16:42:56 -- common/autotest_common.sh@10 -- # set +x 00:07:10.636 ************************************ 00:07:10.636 START TEST accel_copy_crc32c_C2 00:07:10.636 ************************************ 00:07:10.636 16:42:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:10.636 16:42:56 -- accel/accel.sh@16 -- # local accel_opc 00:07:10.636 16:42:56 -- accel/accel.sh@17 -- # local accel_module 00:07:10.636 16:42:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:10.636 16:42:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:10.636 16:42:56 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.636 16:42:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:10.636 16:42:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.636 16:42:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.636 16:42:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:10.636 16:42:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:10.636 16:42:56 -- accel/accel.sh@41 -- # local IFS=, 00:07:10.636 16:42:56 -- accel/accel.sh@42 -- # jq -r . 00:07:10.636 [2024-11-16 16:42:56.082583] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:10.636 [2024-11-16 16:42:56.082677] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1086661 ] 00:07:10.636 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.636 [2024-11-16 16:42:56.144227] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.636 [2024-11-16 16:42:56.234418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.018 16:42:57 -- accel/accel.sh@18 -- # out=' 00:07:12.018 SPDK Configuration: 00:07:12.018 Core mask: 0x1 00:07:12.018 00:07:12.018 Accel Perf Configuration: 00:07:12.018 Workload Type: copy_crc32c 00:07:12.018 CRC-32C seed: 0 00:07:12.018 Vector size: 4096 bytes 00:07:12.018 Transfer size: 8192 bytes 00:07:12.018 Vector count 2 00:07:12.018 Module: software 00:07:12.018 Queue depth: 32 00:07:12.018 Allocate depth: 32 00:07:12.018 # threads/core: 1 00:07:12.018 Run time: 1 seconds 00:07:12.018 Verify: Yes 00:07:12.018 00:07:12.018 Running for 1 seconds... 00:07:12.018 00:07:12.018 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:12.018 ------------------------------------------------------------------------------------ 00:07:12.018 0,0 155744/s 1216 MiB/s 0 0 00:07:12.018 ==================================================================================== 00:07:12.018 Total 155744/s 608 MiB/s 0 0' 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:12.018 16:42:57 -- accel/accel.sh@12 -- # build_accel_config 00:07:12.018 16:42:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:12.018 16:42:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:12.018 16:42:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:12.018 16:42:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:12.018 16:42:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:12.018 16:42:57 -- accel/accel.sh@41 -- # local IFS=, 00:07:12.018 16:42:57 -- accel/accel.sh@42 -- # jq -r . 00:07:12.018 [2024-11-16 16:42:57.489036] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:12.018 [2024-11-16 16:42:57.489131] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1086803 ] 00:07:12.018 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.018 [2024-11-16 16:42:57.548340] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.018 [2024-11-16 16:42:57.638428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val= 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val= 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val=0x1 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val= 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val= 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val=0 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val='8192 bytes' 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val= 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val=software 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@23 -- # accel_module=software 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val=32 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val=32 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val=1 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val=Yes 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val= 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:12.018 16:42:57 -- accel/accel.sh@21 -- # val= 00:07:12.018 16:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # IFS=: 00:07:12.018 16:42:57 -- accel/accel.sh@20 -- # read -r var val 00:07:13.449 16:42:58 -- accel/accel.sh@21 -- # val= 00:07:13.449 16:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.449 16:42:58 -- accel/accel.sh@20 -- # IFS=: 00:07:13.449 16:42:58 -- accel/accel.sh@20 -- # read -r var val 00:07:13.449 16:42:58 -- accel/accel.sh@21 -- # val= 00:07:13.449 16:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.449 16:42:58 -- accel/accel.sh@20 -- # IFS=: 00:07:13.449 16:42:58 -- accel/accel.sh@20 -- # read -r var val 00:07:13.449 16:42:58 -- accel/accel.sh@21 -- # val= 00:07:13.449 16:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.449 16:42:58 -- accel/accel.sh@20 -- # IFS=: 00:07:13.449 16:42:58 -- accel/accel.sh@20 -- # read -r var val 00:07:13.449 16:42:58 -- accel/accel.sh@21 -- # val= 00:07:13.449 16:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.449 16:42:58 -- accel/accel.sh@20 -- # IFS=: 00:07:13.449 16:42:58 -- accel/accel.sh@20 -- # read -r var val 00:07:13.449 16:42:58 -- accel/accel.sh@21 -- # val= 00:07:13.449 16:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.449 16:42:58 -- accel/accel.sh@20 -- # IFS=: 00:07:13.449 16:42:58 -- accel/accel.sh@20 -- # read -r var val 00:07:13.449 16:42:58 -- accel/accel.sh@21 -- # val= 00:07:13.449 16:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.449 16:42:58 -- accel/accel.sh@20 -- # IFS=: 00:07:13.449 16:42:58 -- accel/accel.sh@20 -- # read -r var val 00:07:13.449 16:42:58 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:13.449 16:42:58 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:13.449 16:42:58 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:13.449 00:07:13.449 real 0m2.809s 00:07:13.449 user 0m2.497s 00:07:13.449 sys 0m0.303s 00:07:13.449 16:42:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:13.449 16:42:58 -- common/autotest_common.sh@10 -- # set +x 00:07:13.449 ************************************ 00:07:13.449 END TEST accel_copy_crc32c_C2 00:07:13.449 ************************************ 00:07:13.449 16:42:58 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:13.449 16:42:58 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:13.449 16:42:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.449 16:42:58 -- common/autotest_common.sh@10 -- # set +x 00:07:13.449 ************************************ 00:07:13.449 START TEST accel_dualcast 00:07:13.449 ************************************ 00:07:13.449 16:42:58 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:07:13.449 16:42:58 -- accel/accel.sh@16 -- # local accel_opc 00:07:13.449 16:42:58 -- accel/accel.sh@17 -- # local accel_module 00:07:13.449 16:42:58 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:07:13.449 16:42:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:13.449 16:42:58 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.449 16:42:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.449 16:42:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.449 16:42:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.449 16:42:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.449 16:42:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.449 16:42:58 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.449 16:42:58 -- accel/accel.sh@42 -- # jq -r . 00:07:13.449 [2024-11-16 16:42:58.916862] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:13.449 [2024-11-16 16:42:58.916955] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1086965 ] 00:07:13.449 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.449 [2024-11-16 16:42:58.976639] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.449 [2024-11-16 16:42:59.067347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.822 16:43:00 -- accel/accel.sh@18 -- # out=' 00:07:14.822 SPDK Configuration: 00:07:14.822 Core mask: 0x1 00:07:14.822 00:07:14.822 Accel Perf Configuration: 00:07:14.822 Workload Type: dualcast 00:07:14.822 Transfer size: 4096 bytes 00:07:14.822 Vector count 1 00:07:14.822 Module: software 00:07:14.822 Queue depth: 32 00:07:14.822 Allocate depth: 32 00:07:14.822 # threads/core: 1 00:07:14.822 Run time: 1 seconds 00:07:14.822 Verify: Yes 00:07:14.822 00:07:14.822 Running for 1 seconds... 00:07:14.822 00:07:14.822 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:14.822 ------------------------------------------------------------------------------------ 00:07:14.822 0,0 297120/s 1160 MiB/s 0 0 00:07:14.822 ==================================================================================== 00:07:14.822 Total 297120/s 1160 MiB/s 0 0' 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:14.822 16:43:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:14.822 16:43:00 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.822 16:43:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.822 16:43:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.822 16:43:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.822 16:43:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.822 16:43:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.822 16:43:00 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.822 16:43:00 -- accel/accel.sh@42 -- # jq -r . 00:07:14.822 [2024-11-16 16:43:00.315152] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:14.822 [2024-11-16 16:43:00.315230] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087125 ] 00:07:14.822 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.822 [2024-11-16 16:43:00.376389] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.822 [2024-11-16 16:43:00.466188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val= 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val= 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val=0x1 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val= 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val= 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val=dualcast 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val= 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val=software 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@23 -- # accel_module=software 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val=32 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val=32 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val=1 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val=Yes 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val= 00:07:14.822 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.822 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:14.822 16:43:00 -- accel/accel.sh@21 -- # val= 00:07:14.823 16:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.823 16:43:00 -- accel/accel.sh@20 -- # IFS=: 00:07:14.823 16:43:00 -- accel/accel.sh@20 -- # read -r var val 00:07:16.196 16:43:01 -- accel/accel.sh@21 -- # val= 00:07:16.196 16:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.196 16:43:01 -- accel/accel.sh@20 -- # IFS=: 00:07:16.196 16:43:01 -- accel/accel.sh@20 -- # read -r var val 00:07:16.196 16:43:01 -- accel/accel.sh@21 -- # val= 00:07:16.196 16:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.196 16:43:01 -- accel/accel.sh@20 -- # IFS=: 00:07:16.196 16:43:01 -- accel/accel.sh@20 -- # read -r var val 00:07:16.196 16:43:01 -- accel/accel.sh@21 -- # val= 00:07:16.196 16:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.196 16:43:01 -- accel/accel.sh@20 -- # IFS=: 00:07:16.196 16:43:01 -- accel/accel.sh@20 -- # read -r var val 00:07:16.196 16:43:01 -- accel/accel.sh@21 -- # val= 00:07:16.196 16:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.196 16:43:01 -- accel/accel.sh@20 -- # IFS=: 00:07:16.196 16:43:01 -- accel/accel.sh@20 -- # read -r var val 00:07:16.196 16:43:01 -- accel/accel.sh@21 -- # val= 00:07:16.196 16:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.196 16:43:01 -- accel/accel.sh@20 -- # IFS=: 00:07:16.196 16:43:01 -- accel/accel.sh@20 -- # read -r var val 00:07:16.196 16:43:01 -- accel/accel.sh@21 -- # val= 00:07:16.196 16:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.196 16:43:01 -- accel/accel.sh@20 -- # IFS=: 00:07:16.196 16:43:01 -- accel/accel.sh@20 -- # read -r var val 00:07:16.196 16:43:01 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:16.196 16:43:01 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:07:16.196 16:43:01 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:16.196 00:07:16.196 real 0m2.794s 00:07:16.197 user 0m2.499s 00:07:16.197 sys 0m0.285s 00:07:16.197 16:43:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.197 16:43:01 -- common/autotest_common.sh@10 -- # set +x 00:07:16.197 ************************************ 00:07:16.197 END TEST accel_dualcast 00:07:16.197 ************************************ 00:07:16.197 16:43:01 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:16.197 16:43:01 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:16.197 16:43:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.197 16:43:01 -- common/autotest_common.sh@10 -- # set +x 00:07:16.197 ************************************ 00:07:16.197 START TEST accel_compare 00:07:16.197 ************************************ 00:07:16.197 16:43:01 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:07:16.197 16:43:01 -- accel/accel.sh@16 -- # local accel_opc 00:07:16.197 16:43:01 -- accel/accel.sh@17 -- # local accel_module 00:07:16.197 16:43:01 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:07:16.197 16:43:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:16.197 16:43:01 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.197 16:43:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.197 16:43:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.197 16:43:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.197 16:43:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.197 16:43:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.197 16:43:01 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.197 16:43:01 -- accel/accel.sh@42 -- # jq -r . 00:07:16.197 [2024-11-16 16:43:01.733229] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:16.197 [2024-11-16 16:43:01.733303] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087390 ] 00:07:16.197 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.197 [2024-11-16 16:43:01.792982] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.197 [2024-11-16 16:43:01.882076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.572 16:43:03 -- accel/accel.sh@18 -- # out=' 00:07:17.572 SPDK Configuration: 00:07:17.572 Core mask: 0x1 00:07:17.572 00:07:17.572 Accel Perf Configuration: 00:07:17.572 Workload Type: compare 00:07:17.572 Transfer size: 4096 bytes 00:07:17.572 Vector count 1 00:07:17.572 Module: software 00:07:17.572 Queue depth: 32 00:07:17.572 Allocate depth: 32 00:07:17.572 # threads/core: 1 00:07:17.572 Run time: 1 seconds 00:07:17.572 Verify: Yes 00:07:17.572 00:07:17.572 Running for 1 seconds... 00:07:17.572 00:07:17.572 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:17.572 ------------------------------------------------------------------------------------ 00:07:17.572 0,0 398176/s 1555 MiB/s 0 0 00:07:17.572 ==================================================================================== 00:07:17.572 Total 398176/s 1555 MiB/s 0 0' 00:07:17.572 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.572 16:43:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:17.572 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.572 16:43:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:17.572 16:43:03 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.572 16:43:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.572 16:43:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.572 16:43:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.572 16:43:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.572 16:43:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.572 16:43:03 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.572 16:43:03 -- accel/accel.sh@42 -- # jq -r . 00:07:17.572 [2024-11-16 16:43:03.130948] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:17.572 [2024-11-16 16:43:03.131036] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087534 ] 00:07:17.572 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.572 [2024-11-16 16:43:03.192403] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.572 [2024-11-16 16:43:03.282311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val= 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val= 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val=0x1 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val= 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val= 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val=compare 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@24 -- # accel_opc=compare 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val= 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val=software 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@23 -- # accel_module=software 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val=32 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val=32 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val=1 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val=Yes 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val= 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:17.831 16:43:03 -- accel/accel.sh@21 -- # val= 00:07:17.831 16:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # IFS=: 00:07:17.831 16:43:03 -- accel/accel.sh@20 -- # read -r var val 00:07:18.767 16:43:04 -- accel/accel.sh@21 -- # val= 00:07:19.025 16:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.025 16:43:04 -- accel/accel.sh@20 -- # IFS=: 00:07:19.025 16:43:04 -- accel/accel.sh@20 -- # read -r var val 00:07:19.025 16:43:04 -- accel/accel.sh@21 -- # val= 00:07:19.025 16:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.025 16:43:04 -- accel/accel.sh@20 -- # IFS=: 00:07:19.025 16:43:04 -- accel/accel.sh@20 -- # read -r var val 00:07:19.025 16:43:04 -- accel/accel.sh@21 -- # val= 00:07:19.025 16:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.025 16:43:04 -- accel/accel.sh@20 -- # IFS=: 00:07:19.025 16:43:04 -- accel/accel.sh@20 -- # read -r var val 00:07:19.025 16:43:04 -- accel/accel.sh@21 -- # val= 00:07:19.025 16:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.025 16:43:04 -- accel/accel.sh@20 -- # IFS=: 00:07:19.025 16:43:04 -- accel/accel.sh@20 -- # read -r var val 00:07:19.025 16:43:04 -- accel/accel.sh@21 -- # val= 00:07:19.025 16:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.025 16:43:04 -- accel/accel.sh@20 -- # IFS=: 00:07:19.025 16:43:04 -- accel/accel.sh@20 -- # read -r var val 00:07:19.025 16:43:04 -- accel/accel.sh@21 -- # val= 00:07:19.025 16:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.025 16:43:04 -- accel/accel.sh@20 -- # IFS=: 00:07:19.025 16:43:04 -- accel/accel.sh@20 -- # read -r var val 00:07:19.025 16:43:04 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:19.025 16:43:04 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:07:19.025 16:43:04 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:19.025 00:07:19.025 real 0m2.803s 00:07:19.025 user 0m2.497s 00:07:19.025 sys 0m0.297s 00:07:19.025 16:43:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:19.025 16:43:04 -- common/autotest_common.sh@10 -- # set +x 00:07:19.025 ************************************ 00:07:19.025 END TEST accel_compare 00:07:19.025 ************************************ 00:07:19.025 16:43:04 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:19.025 16:43:04 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:19.025 16:43:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.025 16:43:04 -- common/autotest_common.sh@10 -- # set +x 00:07:19.025 ************************************ 00:07:19.025 START TEST accel_xor 00:07:19.025 ************************************ 00:07:19.025 16:43:04 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:07:19.025 16:43:04 -- accel/accel.sh@16 -- # local accel_opc 00:07:19.025 16:43:04 -- accel/accel.sh@17 -- # local accel_module 00:07:19.025 16:43:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:07:19.025 16:43:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:19.025 16:43:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.025 16:43:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:19.025 16:43:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.025 16:43:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.025 16:43:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:19.025 16:43:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:19.025 16:43:04 -- accel/accel.sh@41 -- # local IFS=, 00:07:19.025 16:43:04 -- accel/accel.sh@42 -- # jq -r . 00:07:19.025 [2024-11-16 16:43:04.564945] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:19.025 [2024-11-16 16:43:04.565036] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087687 ] 00:07:19.025 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.025 [2024-11-16 16:43:04.624106] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.025 [2024-11-16 16:43:04.714198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.400 16:43:05 -- accel/accel.sh@18 -- # out=' 00:07:20.400 SPDK Configuration: 00:07:20.400 Core mask: 0x1 00:07:20.400 00:07:20.400 Accel Perf Configuration: 00:07:20.400 Workload Type: xor 00:07:20.400 Source buffers: 2 00:07:20.400 Transfer size: 4096 bytes 00:07:20.400 Vector count 1 00:07:20.400 Module: software 00:07:20.400 Queue depth: 32 00:07:20.400 Allocate depth: 32 00:07:20.400 # threads/core: 1 00:07:20.400 Run time: 1 seconds 00:07:20.400 Verify: Yes 00:07:20.400 00:07:20.400 Running for 1 seconds... 00:07:20.400 00:07:20.400 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:20.400 ------------------------------------------------------------------------------------ 00:07:20.400 0,0 192224/s 750 MiB/s 0 0 00:07:20.400 ==================================================================================== 00:07:20.400 Total 192224/s 750 MiB/s 0 0' 00:07:20.400 16:43:05 -- accel/accel.sh@20 -- # IFS=: 00:07:20.400 16:43:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:20.400 16:43:05 -- accel/accel.sh@20 -- # read -r var val 00:07:20.400 16:43:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:20.400 16:43:05 -- accel/accel.sh@12 -- # build_accel_config 00:07:20.400 16:43:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:20.400 16:43:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:20.400 16:43:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:20.400 16:43:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:20.400 16:43:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:20.400 16:43:05 -- accel/accel.sh@41 -- # local IFS=, 00:07:20.400 16:43:05 -- accel/accel.sh@42 -- # jq -r . 00:07:20.400 [2024-11-16 16:43:05.969164] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:20.400 [2024-11-16 16:43:05.969250] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087833 ] 00:07:20.400 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.400 [2024-11-16 16:43:06.029410] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.400 [2024-11-16 16:43:06.117638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val= 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val= 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val=0x1 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val= 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val= 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val=xor 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val=2 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val= 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val=software 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@23 -- # accel_module=software 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val=32 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val=32 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val=1 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val=Yes 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val= 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:20.658 16:43:06 -- accel/accel.sh@21 -- # val= 00:07:20.658 16:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # IFS=: 00:07:20.658 16:43:06 -- accel/accel.sh@20 -- # read -r var val 00:07:22.032 16:43:07 -- accel/accel.sh@21 -- # val= 00:07:22.032 16:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.032 16:43:07 -- accel/accel.sh@20 -- # IFS=: 00:07:22.032 16:43:07 -- accel/accel.sh@20 -- # read -r var val 00:07:22.032 16:43:07 -- accel/accel.sh@21 -- # val= 00:07:22.032 16:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.032 16:43:07 -- accel/accel.sh@20 -- # IFS=: 00:07:22.032 16:43:07 -- accel/accel.sh@20 -- # read -r var val 00:07:22.032 16:43:07 -- accel/accel.sh@21 -- # val= 00:07:22.032 16:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.032 16:43:07 -- accel/accel.sh@20 -- # IFS=: 00:07:22.032 16:43:07 -- accel/accel.sh@20 -- # read -r var val 00:07:22.032 16:43:07 -- accel/accel.sh@21 -- # val= 00:07:22.032 16:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.032 16:43:07 -- accel/accel.sh@20 -- # IFS=: 00:07:22.032 16:43:07 -- accel/accel.sh@20 -- # read -r var val 00:07:22.032 16:43:07 -- accel/accel.sh@21 -- # val= 00:07:22.032 16:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.032 16:43:07 -- accel/accel.sh@20 -- # IFS=: 00:07:22.032 16:43:07 -- accel/accel.sh@20 -- # read -r var val 00:07:22.032 16:43:07 -- accel/accel.sh@21 -- # val= 00:07:22.032 16:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.032 16:43:07 -- accel/accel.sh@20 -- # IFS=: 00:07:22.032 16:43:07 -- accel/accel.sh@20 -- # read -r var val 00:07:22.032 16:43:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:22.032 16:43:07 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:22.032 16:43:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:22.032 00:07:22.032 real 0m2.805s 00:07:22.032 user 0m2.517s 00:07:22.032 sys 0m0.279s 00:07:22.032 16:43:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:22.032 16:43:07 -- common/autotest_common.sh@10 -- # set +x 00:07:22.032 ************************************ 00:07:22.032 END TEST accel_xor 00:07:22.032 ************************************ 00:07:22.032 16:43:07 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:22.032 16:43:07 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:22.032 16:43:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:22.032 16:43:07 -- common/autotest_common.sh@10 -- # set +x 00:07:22.032 ************************************ 00:07:22.032 START TEST accel_xor 00:07:22.032 ************************************ 00:07:22.032 16:43:07 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:07:22.032 16:43:07 -- accel/accel.sh@16 -- # local accel_opc 00:07:22.032 16:43:07 -- accel/accel.sh@17 -- # local accel_module 00:07:22.032 16:43:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:07:22.032 16:43:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:22.032 16:43:07 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.032 16:43:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:22.032 16:43:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.032 16:43:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.032 16:43:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:22.032 16:43:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:22.032 16:43:07 -- accel/accel.sh@41 -- # local IFS=, 00:07:22.032 16:43:07 -- accel/accel.sh@42 -- # jq -r . 00:07:22.032 [2024-11-16 16:43:07.400204] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:22.032 [2024-11-16 16:43:07.400290] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088107 ] 00:07:22.032 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.032 [2024-11-16 16:43:07.464069] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.032 [2024-11-16 16:43:07.563364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.407 16:43:08 -- accel/accel.sh@18 -- # out=' 00:07:23.407 SPDK Configuration: 00:07:23.407 Core mask: 0x1 00:07:23.407 00:07:23.407 Accel Perf Configuration: 00:07:23.407 Workload Type: xor 00:07:23.407 Source buffers: 3 00:07:23.407 Transfer size: 4096 bytes 00:07:23.407 Vector count 1 00:07:23.407 Module: software 00:07:23.407 Queue depth: 32 00:07:23.407 Allocate depth: 32 00:07:23.407 # threads/core: 1 00:07:23.407 Run time: 1 seconds 00:07:23.407 Verify: Yes 00:07:23.407 00:07:23.407 Running for 1 seconds... 00:07:23.407 00:07:23.407 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:23.407 ------------------------------------------------------------------------------------ 00:07:23.407 0,0 184768/s 721 MiB/s 0 0 00:07:23.407 ==================================================================================== 00:07:23.407 Total 184768/s 721 MiB/s 0 0' 00:07:23.407 16:43:08 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:23.407 16:43:08 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:23.407 16:43:08 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.407 16:43:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:23.407 16:43:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.407 16:43:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.407 16:43:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:23.407 16:43:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:23.407 16:43:08 -- accel/accel.sh@41 -- # local IFS=, 00:07:23.407 16:43:08 -- accel/accel.sh@42 -- # jq -r . 00:07:23.407 [2024-11-16 16:43:08.812795] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:23.407 [2024-11-16 16:43:08.812885] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088261 ] 00:07:23.407 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.407 [2024-11-16 16:43:08.873333] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.407 [2024-11-16 16:43:08.963032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val= 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val= 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val=0x1 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val= 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val= 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val=xor 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val=3 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val= 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val=software 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@23 -- # accel_module=software 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val=32 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val=32 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val=1 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val=Yes 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val= 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:23.407 16:43:09 -- accel/accel.sh@21 -- # val= 00:07:23.407 16:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # IFS=: 00:07:23.407 16:43:09 -- accel/accel.sh@20 -- # read -r var val 00:07:24.782 16:43:10 -- accel/accel.sh@21 -- # val= 00:07:24.782 16:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.782 16:43:10 -- accel/accel.sh@20 -- # IFS=: 00:07:24.782 16:43:10 -- accel/accel.sh@20 -- # read -r var val 00:07:24.782 16:43:10 -- accel/accel.sh@21 -- # val= 00:07:24.782 16:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.782 16:43:10 -- accel/accel.sh@20 -- # IFS=: 00:07:24.782 16:43:10 -- accel/accel.sh@20 -- # read -r var val 00:07:24.782 16:43:10 -- accel/accel.sh@21 -- # val= 00:07:24.782 16:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.782 16:43:10 -- accel/accel.sh@20 -- # IFS=: 00:07:24.782 16:43:10 -- accel/accel.sh@20 -- # read -r var val 00:07:24.782 16:43:10 -- accel/accel.sh@21 -- # val= 00:07:24.782 16:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.782 16:43:10 -- accel/accel.sh@20 -- # IFS=: 00:07:24.782 16:43:10 -- accel/accel.sh@20 -- # read -r var val 00:07:24.782 16:43:10 -- accel/accel.sh@21 -- # val= 00:07:24.782 16:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.782 16:43:10 -- accel/accel.sh@20 -- # IFS=: 00:07:24.782 16:43:10 -- accel/accel.sh@20 -- # read -r var val 00:07:24.782 16:43:10 -- accel/accel.sh@21 -- # val= 00:07:24.782 16:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.782 16:43:10 -- accel/accel.sh@20 -- # IFS=: 00:07:24.782 16:43:10 -- accel/accel.sh@20 -- # read -r var val 00:07:24.782 16:43:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:24.782 16:43:10 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:24.782 16:43:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:24.782 00:07:24.782 real 0m2.819s 00:07:24.782 user 0m2.513s 00:07:24.782 sys 0m0.296s 00:07:24.782 16:43:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:24.782 16:43:10 -- common/autotest_common.sh@10 -- # set +x 00:07:24.782 ************************************ 00:07:24.782 END TEST accel_xor 00:07:24.782 ************************************ 00:07:24.782 16:43:10 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:24.782 16:43:10 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:24.782 16:43:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:24.782 16:43:10 -- common/autotest_common.sh@10 -- # set +x 00:07:24.782 ************************************ 00:07:24.782 START TEST accel_dif_verify 00:07:24.782 ************************************ 00:07:24.782 16:43:10 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:07:24.782 16:43:10 -- accel/accel.sh@16 -- # local accel_opc 00:07:24.782 16:43:10 -- accel/accel.sh@17 -- # local accel_module 00:07:24.782 16:43:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:24.782 16:43:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:24.782 16:43:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.782 16:43:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:24.782 16:43:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.782 16:43:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.782 16:43:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:24.782 16:43:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:24.782 16:43:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:24.782 16:43:10 -- accel/accel.sh@42 -- # jq -r . 00:07:24.782 [2024-11-16 16:43:10.244387] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:24.782 [2024-11-16 16:43:10.244474] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088414 ] 00:07:24.782 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.782 [2024-11-16 16:43:10.306626] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.782 [2024-11-16 16:43:10.398068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.156 16:43:11 -- accel/accel.sh@18 -- # out=' 00:07:26.156 SPDK Configuration: 00:07:26.156 Core mask: 0x1 00:07:26.156 00:07:26.156 Accel Perf Configuration: 00:07:26.156 Workload Type: dif_verify 00:07:26.156 Vector size: 4096 bytes 00:07:26.156 Transfer size: 4096 bytes 00:07:26.156 Block size: 512 bytes 00:07:26.156 Metadata size: 8 bytes 00:07:26.156 Vector count 1 00:07:26.156 Module: software 00:07:26.156 Queue depth: 32 00:07:26.156 Allocate depth: 32 00:07:26.156 # threads/core: 1 00:07:26.156 Run time: 1 seconds 00:07:26.156 Verify: No 00:07:26.156 00:07:26.156 Running for 1 seconds... 00:07:26.156 00:07:26.156 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:26.156 ------------------------------------------------------------------------------------ 00:07:26.156 0,0 82624/s 327 MiB/s 0 0 00:07:26.156 ==================================================================================== 00:07:26.156 Total 82624/s 322 MiB/s 0 0' 00:07:26.156 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.156 16:43:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:26.156 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.156 16:43:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:26.156 16:43:11 -- accel/accel.sh@12 -- # build_accel_config 00:07:26.156 16:43:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:26.156 16:43:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:26.157 16:43:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:26.157 16:43:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:26.157 16:43:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:26.157 16:43:11 -- accel/accel.sh@41 -- # local IFS=, 00:07:26.157 16:43:11 -- accel/accel.sh@42 -- # jq -r . 00:07:26.157 [2024-11-16 16:43:11.650094] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:26.157 [2024-11-16 16:43:11.650174] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088554 ] 00:07:26.157 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.157 [2024-11-16 16:43:11.711545] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:26.157 [2024-11-16 16:43:11.803007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val= 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val= 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val=0x1 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val= 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val= 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val=dif_verify 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val= 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val=software 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@23 -- # accel_module=software 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val=32 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val=32 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val=1 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val=No 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val= 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:26.157 16:43:11 -- accel/accel.sh@21 -- # val= 00:07:26.157 16:43:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # IFS=: 00:07:26.157 16:43:11 -- accel/accel.sh@20 -- # read -r var val 00:07:27.530 16:43:13 -- accel/accel.sh@21 -- # val= 00:07:27.531 16:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.531 16:43:13 -- accel/accel.sh@20 -- # IFS=: 00:07:27.531 16:43:13 -- accel/accel.sh@20 -- # read -r var val 00:07:27.531 16:43:13 -- accel/accel.sh@21 -- # val= 00:07:27.531 16:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.531 16:43:13 -- accel/accel.sh@20 -- # IFS=: 00:07:27.531 16:43:13 -- accel/accel.sh@20 -- # read -r var val 00:07:27.531 16:43:13 -- accel/accel.sh@21 -- # val= 00:07:27.531 16:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.531 16:43:13 -- accel/accel.sh@20 -- # IFS=: 00:07:27.531 16:43:13 -- accel/accel.sh@20 -- # read -r var val 00:07:27.531 16:43:13 -- accel/accel.sh@21 -- # val= 00:07:27.531 16:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.531 16:43:13 -- accel/accel.sh@20 -- # IFS=: 00:07:27.531 16:43:13 -- accel/accel.sh@20 -- # read -r var val 00:07:27.531 16:43:13 -- accel/accel.sh@21 -- # val= 00:07:27.531 16:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.531 16:43:13 -- accel/accel.sh@20 -- # IFS=: 00:07:27.531 16:43:13 -- accel/accel.sh@20 -- # read -r var val 00:07:27.531 16:43:13 -- accel/accel.sh@21 -- # val= 00:07:27.531 16:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.531 16:43:13 -- accel/accel.sh@20 -- # IFS=: 00:07:27.531 16:43:13 -- accel/accel.sh@20 -- # read -r var val 00:07:27.531 16:43:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:27.531 16:43:13 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:27.531 16:43:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:27.531 00:07:27.531 real 0m2.812s 00:07:27.531 user 0m2.516s 00:07:27.531 sys 0m0.289s 00:07:27.531 16:43:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.531 16:43:13 -- common/autotest_common.sh@10 -- # set +x 00:07:27.531 ************************************ 00:07:27.531 END TEST accel_dif_verify 00:07:27.531 ************************************ 00:07:27.531 16:43:13 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:27.531 16:43:13 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:27.531 16:43:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.531 16:43:13 -- common/autotest_common.sh@10 -- # set +x 00:07:27.531 ************************************ 00:07:27.531 START TEST accel_dif_generate 00:07:27.531 ************************************ 00:07:27.531 16:43:13 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:27.531 16:43:13 -- accel/accel.sh@16 -- # local accel_opc 00:07:27.531 16:43:13 -- accel/accel.sh@17 -- # local accel_module 00:07:27.531 16:43:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:27.531 16:43:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:27.531 16:43:13 -- accel/accel.sh@12 -- # build_accel_config 00:07:27.531 16:43:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:27.531 16:43:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:27.531 16:43:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:27.531 16:43:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:27.531 16:43:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:27.531 16:43:13 -- accel/accel.sh@41 -- # local IFS=, 00:07:27.531 16:43:13 -- accel/accel.sh@42 -- # jq -r . 00:07:27.531 [2024-11-16 16:43:13.080245] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:27.531 [2024-11-16 16:43:13.080322] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088832 ] 00:07:27.531 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.531 [2024-11-16 16:43:13.140688] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:27.531 [2024-11-16 16:43:13.229558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.905 16:43:14 -- accel/accel.sh@18 -- # out=' 00:07:28.905 SPDK Configuration: 00:07:28.905 Core mask: 0x1 00:07:28.905 00:07:28.905 Accel Perf Configuration: 00:07:28.905 Workload Type: dif_generate 00:07:28.905 Vector size: 4096 bytes 00:07:28.905 Transfer size: 4096 bytes 00:07:28.905 Block size: 512 bytes 00:07:28.905 Metadata size: 8 bytes 00:07:28.905 Vector count 1 00:07:28.905 Module: software 00:07:28.905 Queue depth: 32 00:07:28.905 Allocate depth: 32 00:07:28.905 # threads/core: 1 00:07:28.905 Run time: 1 seconds 00:07:28.905 Verify: No 00:07:28.905 00:07:28.905 Running for 1 seconds... 00:07:28.905 00:07:28.905 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:28.905 ------------------------------------------------------------------------------------ 00:07:28.905 0,0 95520/s 378 MiB/s 0 0 00:07:28.905 ==================================================================================== 00:07:28.905 Total 95520/s 373 MiB/s 0 0' 00:07:28.905 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:28.905 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:28.905 16:43:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:28.905 16:43:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:28.905 16:43:14 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.905 16:43:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:28.905 16:43:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.905 16:43:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.905 16:43:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:28.905 16:43:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:28.905 16:43:14 -- accel/accel.sh@41 -- # local IFS=, 00:07:28.905 16:43:14 -- accel/accel.sh@42 -- # jq -r . 00:07:28.905 [2024-11-16 16:43:14.467810] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:28.905 [2024-11-16 16:43:14.467895] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1088979 ] 00:07:28.905 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.905 [2024-11-16 16:43:14.529585] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.905 [2024-11-16 16:43:14.619787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val= 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val= 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val=0x1 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val= 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val= 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val=dif_generate 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val= 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val=software 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@23 -- # accel_module=software 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val=32 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val=32 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val=1 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val=No 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val= 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:29.164 16:43:14 -- accel/accel.sh@21 -- # val= 00:07:29.164 16:43:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # IFS=: 00:07:29.164 16:43:14 -- accel/accel.sh@20 -- # read -r var val 00:07:30.538 16:43:15 -- accel/accel.sh@21 -- # val= 00:07:30.538 16:43:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.538 16:43:15 -- accel/accel.sh@20 -- # IFS=: 00:07:30.538 16:43:15 -- accel/accel.sh@20 -- # read -r var val 00:07:30.538 16:43:15 -- accel/accel.sh@21 -- # val= 00:07:30.538 16:43:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.538 16:43:15 -- accel/accel.sh@20 -- # IFS=: 00:07:30.538 16:43:15 -- accel/accel.sh@20 -- # read -r var val 00:07:30.538 16:43:15 -- accel/accel.sh@21 -- # val= 00:07:30.538 16:43:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.538 16:43:15 -- accel/accel.sh@20 -- # IFS=: 00:07:30.538 16:43:15 -- accel/accel.sh@20 -- # read -r var val 00:07:30.538 16:43:15 -- accel/accel.sh@21 -- # val= 00:07:30.538 16:43:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.538 16:43:15 -- accel/accel.sh@20 -- # IFS=: 00:07:30.538 16:43:15 -- accel/accel.sh@20 -- # read -r var val 00:07:30.538 16:43:15 -- accel/accel.sh@21 -- # val= 00:07:30.538 16:43:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.538 16:43:15 -- accel/accel.sh@20 -- # IFS=: 00:07:30.538 16:43:15 -- accel/accel.sh@20 -- # read -r var val 00:07:30.538 16:43:15 -- accel/accel.sh@21 -- # val= 00:07:30.538 16:43:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.538 16:43:15 -- accel/accel.sh@20 -- # IFS=: 00:07:30.538 16:43:15 -- accel/accel.sh@20 -- # read -r var val 00:07:30.538 16:43:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:30.538 16:43:15 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:30.538 16:43:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:30.538 00:07:30.538 real 0m2.794s 00:07:30.538 user 0m2.508s 00:07:30.538 sys 0m0.280s 00:07:30.538 16:43:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.538 16:43:15 -- common/autotest_common.sh@10 -- # set +x 00:07:30.538 ************************************ 00:07:30.538 END TEST accel_dif_generate 00:07:30.538 ************************************ 00:07:30.538 16:43:15 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:30.538 16:43:15 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:30.538 16:43:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.538 16:43:15 -- common/autotest_common.sh@10 -- # set +x 00:07:30.538 ************************************ 00:07:30.538 START TEST accel_dif_generate_copy 00:07:30.538 ************************************ 00:07:30.538 16:43:15 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:30.538 16:43:15 -- accel/accel.sh@16 -- # local accel_opc 00:07:30.538 16:43:15 -- accel/accel.sh@17 -- # local accel_module 00:07:30.538 16:43:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:30.538 16:43:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:30.538 16:43:15 -- accel/accel.sh@12 -- # build_accel_config 00:07:30.538 16:43:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:30.538 16:43:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:30.538 16:43:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:30.538 16:43:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:30.538 16:43:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:30.538 16:43:15 -- accel/accel.sh@41 -- # local IFS=, 00:07:30.538 16:43:15 -- accel/accel.sh@42 -- # jq -r . 00:07:30.538 [2024-11-16 16:43:15.905297] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:30.538 [2024-11-16 16:43:15.905375] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1089141 ] 00:07:30.538 EAL: No free 2048 kB hugepages reported on node 1 00:07:30.538 [2024-11-16 16:43:15.967092] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:30.538 [2024-11-16 16:43:16.054958] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.913 16:43:17 -- accel/accel.sh@18 -- # out=' 00:07:31.913 SPDK Configuration: 00:07:31.913 Core mask: 0x1 00:07:31.913 00:07:31.913 Accel Perf Configuration: 00:07:31.913 Workload Type: dif_generate_copy 00:07:31.913 Vector size: 4096 bytes 00:07:31.913 Transfer size: 4096 bytes 00:07:31.913 Vector count 1 00:07:31.913 Module: software 00:07:31.913 Queue depth: 32 00:07:31.913 Allocate depth: 32 00:07:31.913 # threads/core: 1 00:07:31.913 Run time: 1 seconds 00:07:31.913 Verify: No 00:07:31.913 00:07:31.913 Running for 1 seconds... 00:07:31.913 00:07:31.913 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:31.913 ------------------------------------------------------------------------------------ 00:07:31.913 0,0 77440/s 307 MiB/s 0 0 00:07:31.913 ==================================================================================== 00:07:31.913 Total 77440/s 302 MiB/s 0 0' 00:07:31.913 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.913 16:43:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:31.913 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.913 16:43:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:31.913 16:43:17 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.913 16:43:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:31.913 16:43:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.913 16:43:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.914 16:43:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:31.914 16:43:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:31.914 16:43:17 -- accel/accel.sh@41 -- # local IFS=, 00:07:31.914 16:43:17 -- accel/accel.sh@42 -- # jq -r . 00:07:31.914 [2024-11-16 16:43:17.312647] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:31.914 [2024-11-16 16:43:17.312743] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1089279 ] 00:07:31.914 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.914 [2024-11-16 16:43:17.373383] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.914 [2024-11-16 16:43:17.461380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val= 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val= 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val=0x1 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val= 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val= 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val= 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val=software 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@23 -- # accel_module=software 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val=32 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val=32 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val=1 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val=No 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val= 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:31.914 16:43:17 -- accel/accel.sh@21 -- # val= 00:07:31.914 16:43:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # IFS=: 00:07:31.914 16:43:17 -- accel/accel.sh@20 -- # read -r var val 00:07:33.288 16:43:18 -- accel/accel.sh@21 -- # val= 00:07:33.288 16:43:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.288 16:43:18 -- accel/accel.sh@20 -- # IFS=: 00:07:33.288 16:43:18 -- accel/accel.sh@20 -- # read -r var val 00:07:33.288 16:43:18 -- accel/accel.sh@21 -- # val= 00:07:33.288 16:43:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.288 16:43:18 -- accel/accel.sh@20 -- # IFS=: 00:07:33.288 16:43:18 -- accel/accel.sh@20 -- # read -r var val 00:07:33.288 16:43:18 -- accel/accel.sh@21 -- # val= 00:07:33.288 16:43:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.288 16:43:18 -- accel/accel.sh@20 -- # IFS=: 00:07:33.288 16:43:18 -- accel/accel.sh@20 -- # read -r var val 00:07:33.288 16:43:18 -- accel/accel.sh@21 -- # val= 00:07:33.288 16:43:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.288 16:43:18 -- accel/accel.sh@20 -- # IFS=: 00:07:33.288 16:43:18 -- accel/accel.sh@20 -- # read -r var val 00:07:33.288 16:43:18 -- accel/accel.sh@21 -- # val= 00:07:33.288 16:43:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.288 16:43:18 -- accel/accel.sh@20 -- # IFS=: 00:07:33.288 16:43:18 -- accel/accel.sh@20 -- # read -r var val 00:07:33.288 16:43:18 -- accel/accel.sh@21 -- # val= 00:07:33.288 16:43:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.288 16:43:18 -- accel/accel.sh@20 -- # IFS=: 00:07:33.288 16:43:18 -- accel/accel.sh@20 -- # read -r var val 00:07:33.288 16:43:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:33.288 16:43:18 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:33.288 16:43:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:33.288 00:07:33.288 real 0m2.806s 00:07:33.288 user 0m2.504s 00:07:33.288 sys 0m0.294s 00:07:33.288 16:43:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:33.288 16:43:18 -- common/autotest_common.sh@10 -- # set +x 00:07:33.288 ************************************ 00:07:33.288 END TEST accel_dif_generate_copy 00:07:33.288 ************************************ 00:07:33.288 16:43:18 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:33.288 16:43:18 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:33.288 16:43:18 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:33.288 16:43:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:33.288 16:43:18 -- common/autotest_common.sh@10 -- # set +x 00:07:33.288 ************************************ 00:07:33.288 START TEST accel_comp 00:07:33.288 ************************************ 00:07:33.288 16:43:18 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:33.289 16:43:18 -- accel/accel.sh@16 -- # local accel_opc 00:07:33.289 16:43:18 -- accel/accel.sh@17 -- # local accel_module 00:07:33.289 16:43:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:33.289 16:43:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:33.289 16:43:18 -- accel/accel.sh@12 -- # build_accel_config 00:07:33.289 16:43:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:33.289 16:43:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:33.289 16:43:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:33.289 16:43:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:33.289 16:43:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:33.289 16:43:18 -- accel/accel.sh@41 -- # local IFS=, 00:07:33.289 16:43:18 -- accel/accel.sh@42 -- # jq -r . 00:07:33.289 [2024-11-16 16:43:18.737708] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:33.289 [2024-11-16 16:43:18.737795] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1089553 ] 00:07:33.289 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.289 [2024-11-16 16:43:18.797852] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:33.289 [2024-11-16 16:43:18.888759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.671 16:43:20 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:34.671 00:07:34.671 SPDK Configuration: 00:07:34.671 Core mask: 0x1 00:07:34.671 00:07:34.671 Accel Perf Configuration: 00:07:34.671 Workload Type: compress 00:07:34.671 Transfer size: 4096 bytes 00:07:34.671 Vector count 1 00:07:34.671 Module: software 00:07:34.671 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.671 Queue depth: 32 00:07:34.671 Allocate depth: 32 00:07:34.672 # threads/core: 1 00:07:34.672 Run time: 1 seconds 00:07:34.672 Verify: No 00:07:34.672 00:07:34.672 Running for 1 seconds... 00:07:34.672 00:07:34.672 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:34.672 ------------------------------------------------------------------------------------ 00:07:34.672 0,0 31520/s 131 MiB/s 0 0 00:07:34.672 ==================================================================================== 00:07:34.672 Total 31520/s 123 MiB/s 0 0' 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.672 16:43:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.672 16:43:20 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.672 16:43:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:34.672 16:43:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.672 16:43:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.672 16:43:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:34.672 16:43:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:34.672 16:43:20 -- accel/accel.sh@41 -- # local IFS=, 00:07:34.672 16:43:20 -- accel/accel.sh@42 -- # jq -r . 00:07:34.672 [2024-11-16 16:43:20.141690] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:34.672 [2024-11-16 16:43:20.141774] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1089702 ] 00:07:34.672 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.672 [2024-11-16 16:43:20.203730] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:34.672 [2024-11-16 16:43:20.305809] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val= 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val= 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val= 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val=0x1 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val= 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val= 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val=compress 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val= 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val=software 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@23 -- # accel_module=software 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val=32 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val=32 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val=1 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val=No 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val= 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:34.672 16:43:20 -- accel/accel.sh@21 -- # val= 00:07:34.672 16:43:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # IFS=: 00:07:34.672 16:43:20 -- accel/accel.sh@20 -- # read -r var val 00:07:36.046 16:43:21 -- accel/accel.sh@21 -- # val= 00:07:36.046 16:43:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.046 16:43:21 -- accel/accel.sh@20 -- # IFS=: 00:07:36.046 16:43:21 -- accel/accel.sh@20 -- # read -r var val 00:07:36.046 16:43:21 -- accel/accel.sh@21 -- # val= 00:07:36.046 16:43:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.046 16:43:21 -- accel/accel.sh@20 -- # IFS=: 00:07:36.046 16:43:21 -- accel/accel.sh@20 -- # read -r var val 00:07:36.046 16:43:21 -- accel/accel.sh@21 -- # val= 00:07:36.046 16:43:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.046 16:43:21 -- accel/accel.sh@20 -- # IFS=: 00:07:36.046 16:43:21 -- accel/accel.sh@20 -- # read -r var val 00:07:36.046 16:43:21 -- accel/accel.sh@21 -- # val= 00:07:36.046 16:43:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.046 16:43:21 -- accel/accel.sh@20 -- # IFS=: 00:07:36.046 16:43:21 -- accel/accel.sh@20 -- # read -r var val 00:07:36.046 16:43:21 -- accel/accel.sh@21 -- # val= 00:07:36.046 16:43:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.046 16:43:21 -- accel/accel.sh@20 -- # IFS=: 00:07:36.046 16:43:21 -- accel/accel.sh@20 -- # read -r var val 00:07:36.046 16:43:21 -- accel/accel.sh@21 -- # val= 00:07:36.046 16:43:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.046 16:43:21 -- accel/accel.sh@20 -- # IFS=: 00:07:36.046 16:43:21 -- accel/accel.sh@20 -- # read -r var val 00:07:36.046 16:43:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:36.046 16:43:21 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:36.046 16:43:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:36.046 00:07:36.046 real 0m2.821s 00:07:36.046 user 0m2.515s 00:07:36.046 sys 0m0.298s 00:07:36.046 16:43:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:36.046 16:43:21 -- common/autotest_common.sh@10 -- # set +x 00:07:36.046 ************************************ 00:07:36.046 END TEST accel_comp 00:07:36.046 ************************************ 00:07:36.046 16:43:21 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:36.046 16:43:21 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:36.046 16:43:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.046 16:43:21 -- common/autotest_common.sh@10 -- # set +x 00:07:36.046 ************************************ 00:07:36.046 START TEST accel_decomp 00:07:36.046 ************************************ 00:07:36.046 16:43:21 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:36.046 16:43:21 -- accel/accel.sh@16 -- # local accel_opc 00:07:36.046 16:43:21 -- accel/accel.sh@17 -- # local accel_module 00:07:36.046 16:43:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:36.046 16:43:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:36.046 16:43:21 -- accel/accel.sh@12 -- # build_accel_config 00:07:36.046 16:43:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:36.046 16:43:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:36.046 16:43:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:36.046 16:43:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:36.046 16:43:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:36.046 16:43:21 -- accel/accel.sh@41 -- # local IFS=, 00:07:36.046 16:43:21 -- accel/accel.sh@42 -- # jq -r . 00:07:36.046 [2024-11-16 16:43:21.585823] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:36.046 [2024-11-16 16:43:21.585905] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1089862 ] 00:07:36.046 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.046 [2024-11-16 16:43:21.647818] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:36.046 [2024-11-16 16:43:21.738317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.421 16:43:22 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:37.421 00:07:37.421 SPDK Configuration: 00:07:37.421 Core mask: 0x1 00:07:37.421 00:07:37.421 Accel Perf Configuration: 00:07:37.421 Workload Type: decompress 00:07:37.421 Transfer size: 4096 bytes 00:07:37.421 Vector count 1 00:07:37.421 Module: software 00:07:37.421 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.421 Queue depth: 32 00:07:37.421 Allocate depth: 32 00:07:37.421 # threads/core: 1 00:07:37.421 Run time: 1 seconds 00:07:37.421 Verify: Yes 00:07:37.421 00:07:37.421 Running for 1 seconds... 00:07:37.421 00:07:37.421 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:37.421 ------------------------------------------------------------------------------------ 00:07:37.421 0,0 55168/s 101 MiB/s 0 0 00:07:37.421 ==================================================================================== 00:07:37.421 Total 55168/s 215 MiB/s 0 0' 00:07:37.421 16:43:22 -- accel/accel.sh@20 -- # IFS=: 00:07:37.421 16:43:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:37.421 16:43:22 -- accel/accel.sh@20 -- # read -r var val 00:07:37.421 16:43:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:37.421 16:43:22 -- accel/accel.sh@12 -- # build_accel_config 00:07:37.421 16:43:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:37.421 16:43:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:37.421 16:43:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:37.421 16:43:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:37.421 16:43:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:37.421 16:43:22 -- accel/accel.sh@41 -- # local IFS=, 00:07:37.421 16:43:22 -- accel/accel.sh@42 -- # jq -r . 00:07:37.421 [2024-11-16 16:43:22.996222] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:37.421 [2024-11-16 16:43:22.996307] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090006 ] 00:07:37.421 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.421 [2024-11-16 16:43:23.059144] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:37.421 [2024-11-16 16:43:23.147891] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val= 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val= 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val= 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val=0x1 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val= 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val= 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val=decompress 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val= 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val=software 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@23 -- # accel_module=software 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val=32 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val=32 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val=1 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val=Yes 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val= 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:37.680 16:43:23 -- accel/accel.sh@21 -- # val= 00:07:37.680 16:43:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # IFS=: 00:07:37.680 16:43:23 -- accel/accel.sh@20 -- # read -r var val 00:07:39.055 16:43:24 -- accel/accel.sh@21 -- # val= 00:07:39.055 16:43:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.055 16:43:24 -- accel/accel.sh@20 -- # IFS=: 00:07:39.055 16:43:24 -- accel/accel.sh@20 -- # read -r var val 00:07:39.055 16:43:24 -- accel/accel.sh@21 -- # val= 00:07:39.055 16:43:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.055 16:43:24 -- accel/accel.sh@20 -- # IFS=: 00:07:39.055 16:43:24 -- accel/accel.sh@20 -- # read -r var val 00:07:39.055 16:43:24 -- accel/accel.sh@21 -- # val= 00:07:39.055 16:43:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.055 16:43:24 -- accel/accel.sh@20 -- # IFS=: 00:07:39.055 16:43:24 -- accel/accel.sh@20 -- # read -r var val 00:07:39.055 16:43:24 -- accel/accel.sh@21 -- # val= 00:07:39.055 16:43:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.055 16:43:24 -- accel/accel.sh@20 -- # IFS=: 00:07:39.055 16:43:24 -- accel/accel.sh@20 -- # read -r var val 00:07:39.055 16:43:24 -- accel/accel.sh@21 -- # val= 00:07:39.055 16:43:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.055 16:43:24 -- accel/accel.sh@20 -- # IFS=: 00:07:39.055 16:43:24 -- accel/accel.sh@20 -- # read -r var val 00:07:39.055 16:43:24 -- accel/accel.sh@21 -- # val= 00:07:39.055 16:43:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.055 16:43:24 -- accel/accel.sh@20 -- # IFS=: 00:07:39.055 16:43:24 -- accel/accel.sh@20 -- # read -r var val 00:07:39.055 16:43:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:39.055 16:43:24 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:39.055 16:43:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:39.055 00:07:39.055 real 0m2.815s 00:07:39.055 user 0m2.517s 00:07:39.055 sys 0m0.291s 00:07:39.055 16:43:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:39.055 16:43:24 -- common/autotest_common.sh@10 -- # set +x 00:07:39.055 ************************************ 00:07:39.055 END TEST accel_decomp 00:07:39.055 ************************************ 00:07:39.055 16:43:24 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:39.055 16:43:24 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:39.055 16:43:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:39.055 16:43:24 -- common/autotest_common.sh@10 -- # set +x 00:07:39.056 ************************************ 00:07:39.056 START TEST accel_decmop_full 00:07:39.056 ************************************ 00:07:39.056 16:43:24 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:39.056 16:43:24 -- accel/accel.sh@16 -- # local accel_opc 00:07:39.056 16:43:24 -- accel/accel.sh@17 -- # local accel_module 00:07:39.056 16:43:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:39.056 16:43:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:39.056 16:43:24 -- accel/accel.sh@12 -- # build_accel_config 00:07:39.056 16:43:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:39.056 16:43:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:39.056 16:43:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:39.056 16:43:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:39.056 16:43:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:39.056 16:43:24 -- accel/accel.sh@41 -- # local IFS=, 00:07:39.056 16:43:24 -- accel/accel.sh@42 -- # jq -r . 00:07:39.056 [2024-11-16 16:43:24.424853] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:39.056 [2024-11-16 16:43:24.424953] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090280 ] 00:07:39.056 EAL: No free 2048 kB hugepages reported on node 1 00:07:39.056 [2024-11-16 16:43:24.484837] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:39.056 [2024-11-16 16:43:24.575078] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.430 16:43:25 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:40.430 00:07:40.430 SPDK Configuration: 00:07:40.430 Core mask: 0x1 00:07:40.430 00:07:40.430 Accel Perf Configuration: 00:07:40.430 Workload Type: decompress 00:07:40.430 Transfer size: 111250 bytes 00:07:40.430 Vector count 1 00:07:40.430 Module: software 00:07:40.430 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:40.430 Queue depth: 32 00:07:40.430 Allocate depth: 32 00:07:40.430 # threads/core: 1 00:07:40.430 Run time: 1 seconds 00:07:40.430 Verify: Yes 00:07:40.430 00:07:40.430 Running for 1 seconds... 00:07:40.430 00:07:40.430 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:40.430 ------------------------------------------------------------------------------------ 00:07:40.430 0,0 3808/s 157 MiB/s 0 0 00:07:40.430 ==================================================================================== 00:07:40.430 Total 3808/s 404 MiB/s 0 0' 00:07:40.430 16:43:25 -- accel/accel.sh@20 -- # IFS=: 00:07:40.430 16:43:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:40.430 16:43:25 -- accel/accel.sh@20 -- # read -r var val 00:07:40.430 16:43:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:40.430 16:43:25 -- accel/accel.sh@12 -- # build_accel_config 00:07:40.430 16:43:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:40.430 16:43:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:40.430 16:43:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:40.430 16:43:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:40.430 16:43:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:40.430 16:43:25 -- accel/accel.sh@41 -- # local IFS=, 00:07:40.430 16:43:25 -- accel/accel.sh@42 -- # jq -r . 00:07:40.430 [2024-11-16 16:43:25.840854] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:40.430 [2024-11-16 16:43:25.840939] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090422 ] 00:07:40.430 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.430 [2024-11-16 16:43:25.901276] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:40.430 [2024-11-16 16:43:25.991831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.430 16:43:26 -- accel/accel.sh@21 -- # val= 00:07:40.430 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.430 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.430 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.430 16:43:26 -- accel/accel.sh@21 -- # val= 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val= 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val=0x1 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val= 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val= 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val=decompress 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val= 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val=software 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@23 -- # accel_module=software 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val=32 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val=32 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val=1 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val=Yes 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val= 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:40.431 16:43:26 -- accel/accel.sh@21 -- # val= 00:07:40.431 16:43:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # IFS=: 00:07:40.431 16:43:26 -- accel/accel.sh@20 -- # read -r var val 00:07:41.805 16:43:27 -- accel/accel.sh@21 -- # val= 00:07:41.805 16:43:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.805 16:43:27 -- accel/accel.sh@20 -- # IFS=: 00:07:41.805 16:43:27 -- accel/accel.sh@20 -- # read -r var val 00:07:41.805 16:43:27 -- accel/accel.sh@21 -- # val= 00:07:41.805 16:43:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.805 16:43:27 -- accel/accel.sh@20 -- # IFS=: 00:07:41.805 16:43:27 -- accel/accel.sh@20 -- # read -r var val 00:07:41.805 16:43:27 -- accel/accel.sh@21 -- # val= 00:07:41.805 16:43:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.805 16:43:27 -- accel/accel.sh@20 -- # IFS=: 00:07:41.805 16:43:27 -- accel/accel.sh@20 -- # read -r var val 00:07:41.805 16:43:27 -- accel/accel.sh@21 -- # val= 00:07:41.805 16:43:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.805 16:43:27 -- accel/accel.sh@20 -- # IFS=: 00:07:41.805 16:43:27 -- accel/accel.sh@20 -- # read -r var val 00:07:41.805 16:43:27 -- accel/accel.sh@21 -- # val= 00:07:41.805 16:43:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.805 16:43:27 -- accel/accel.sh@20 -- # IFS=: 00:07:41.805 16:43:27 -- accel/accel.sh@20 -- # read -r var val 00:07:41.805 16:43:27 -- accel/accel.sh@21 -- # val= 00:07:41.805 16:43:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.805 16:43:27 -- accel/accel.sh@20 -- # IFS=: 00:07:41.805 16:43:27 -- accel/accel.sh@20 -- # read -r var val 00:07:41.805 16:43:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:41.805 16:43:27 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:41.805 16:43:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:41.805 00:07:41.805 real 0m2.814s 00:07:41.805 user 0m2.531s 00:07:41.805 sys 0m0.276s 00:07:41.805 16:43:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:41.805 16:43:27 -- common/autotest_common.sh@10 -- # set +x 00:07:41.805 ************************************ 00:07:41.805 END TEST accel_decmop_full 00:07:41.805 ************************************ 00:07:41.805 16:43:27 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:41.805 16:43:27 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:41.805 16:43:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.805 16:43:27 -- common/autotest_common.sh@10 -- # set +x 00:07:41.805 ************************************ 00:07:41.805 START TEST accel_decomp_mcore 00:07:41.805 ************************************ 00:07:41.805 16:43:27 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:41.805 16:43:27 -- accel/accel.sh@16 -- # local accel_opc 00:07:41.805 16:43:27 -- accel/accel.sh@17 -- # local accel_module 00:07:41.805 16:43:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:41.805 16:43:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:41.805 16:43:27 -- accel/accel.sh@12 -- # build_accel_config 00:07:41.805 16:43:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:41.805 16:43:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:41.805 16:43:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:41.805 16:43:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:41.805 16:43:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:41.805 16:43:27 -- accel/accel.sh@41 -- # local IFS=, 00:07:41.805 16:43:27 -- accel/accel.sh@42 -- # jq -r . 00:07:41.805 [2024-11-16 16:43:27.267707] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:41.805 [2024-11-16 16:43:27.267795] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090589 ] 00:07:41.805 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.805 [2024-11-16 16:43:27.328949] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:41.805 [2024-11-16 16:43:27.422945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:41.805 [2024-11-16 16:43:27.422991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:41.805 [2024-11-16 16:43:27.423111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:41.805 [2024-11-16 16:43:27.423113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.178 16:43:28 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:43.178 00:07:43.178 SPDK Configuration: 00:07:43.178 Core mask: 0xf 00:07:43.178 00:07:43.178 Accel Perf Configuration: 00:07:43.178 Workload Type: decompress 00:07:43.178 Transfer size: 4096 bytes 00:07:43.178 Vector count 1 00:07:43.178 Module: software 00:07:43.178 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:43.178 Queue depth: 32 00:07:43.178 Allocate depth: 32 00:07:43.178 # threads/core: 1 00:07:43.178 Run time: 1 seconds 00:07:43.178 Verify: Yes 00:07:43.178 00:07:43.178 Running for 1 seconds... 00:07:43.178 00:07:43.178 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:43.178 ------------------------------------------------------------------------------------ 00:07:43.178 0,0 56864/s 104 MiB/s 0 0 00:07:43.178 3,0 57408/s 105 MiB/s 0 0 00:07:43.178 2,0 57216/s 105 MiB/s 0 0 00:07:43.178 1,0 57024/s 105 MiB/s 0 0 00:07:43.178 ==================================================================================== 00:07:43.178 Total 228512/s 892 MiB/s 0 0' 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:43.178 16:43:28 -- accel/accel.sh@12 -- # build_accel_config 00:07:43.178 16:43:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:43.178 16:43:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:43.178 16:43:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:43.178 16:43:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:43.178 16:43:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:43.178 16:43:28 -- accel/accel.sh@41 -- # local IFS=, 00:07:43.178 16:43:28 -- accel/accel.sh@42 -- # jq -r . 00:07:43.178 [2024-11-16 16:43:28.680567] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:43.178 [2024-11-16 16:43:28.680662] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1090730 ] 00:07:43.178 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.178 [2024-11-16 16:43:28.744850] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:43.178 [2024-11-16 16:43:28.836692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:43.178 [2024-11-16 16:43:28.836750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:43.178 [2024-11-16 16:43:28.836868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:43.178 [2024-11-16 16:43:28.836871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val= 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val= 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val= 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val=0xf 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val= 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val= 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val=decompress 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val= 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val=software 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@23 -- # accel_module=software 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val=32 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val=32 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val=1 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val=Yes 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val= 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:43.178 16:43:28 -- accel/accel.sh@21 -- # val= 00:07:43.178 16:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # IFS=: 00:07:43.178 16:43:28 -- accel/accel.sh@20 -- # read -r var val 00:07:44.550 16:43:30 -- accel/accel.sh@21 -- # val= 00:07:44.550 16:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # IFS=: 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # read -r var val 00:07:44.550 16:43:30 -- accel/accel.sh@21 -- # val= 00:07:44.550 16:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # IFS=: 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # read -r var val 00:07:44.550 16:43:30 -- accel/accel.sh@21 -- # val= 00:07:44.550 16:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # IFS=: 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # read -r var val 00:07:44.550 16:43:30 -- accel/accel.sh@21 -- # val= 00:07:44.550 16:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # IFS=: 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # read -r var val 00:07:44.550 16:43:30 -- accel/accel.sh@21 -- # val= 00:07:44.550 16:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # IFS=: 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # read -r var val 00:07:44.550 16:43:30 -- accel/accel.sh@21 -- # val= 00:07:44.550 16:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # IFS=: 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # read -r var val 00:07:44.550 16:43:30 -- accel/accel.sh@21 -- # val= 00:07:44.550 16:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # IFS=: 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # read -r var val 00:07:44.550 16:43:30 -- accel/accel.sh@21 -- # val= 00:07:44.550 16:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # IFS=: 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # read -r var val 00:07:44.550 16:43:30 -- accel/accel.sh@21 -- # val= 00:07:44.550 16:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # IFS=: 00:07:44.550 16:43:30 -- accel/accel.sh@20 -- # read -r var val 00:07:44.550 16:43:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:44.550 16:43:30 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:44.550 16:43:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:44.550 00:07:44.550 real 0m2.823s 00:07:44.550 user 0m4.721s 00:07:44.550 sys 0m0.154s 00:07:44.550 16:43:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:44.550 16:43:30 -- common/autotest_common.sh@10 -- # set +x 00:07:44.550 ************************************ 00:07:44.550 END TEST accel_decomp_mcore 00:07:44.550 ************************************ 00:07:44.550 16:43:30 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:44.550 16:43:30 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:44.550 16:43:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:44.550 16:43:30 -- common/autotest_common.sh@10 -- # set +x 00:07:44.550 ************************************ 00:07:44.550 START TEST accel_decomp_full_mcore 00:07:44.550 ************************************ 00:07:44.551 16:43:30 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:44.551 16:43:30 -- accel/accel.sh@16 -- # local accel_opc 00:07:44.551 16:43:30 -- accel/accel.sh@17 -- # local accel_module 00:07:44.551 16:43:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:44.551 16:43:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:44.551 16:43:30 -- accel/accel.sh@12 -- # build_accel_config 00:07:44.551 16:43:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:44.551 16:43:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:44.551 16:43:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:44.551 16:43:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:44.551 16:43:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:44.551 16:43:30 -- accel/accel.sh@41 -- # local IFS=, 00:07:44.551 16:43:30 -- accel/accel.sh@42 -- # jq -r . 00:07:44.551 [2024-11-16 16:43:30.115969] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:44.551 [2024-11-16 16:43:30.116056] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091013 ] 00:07:44.551 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.551 [2024-11-16 16:43:30.178533] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:44.551 [2024-11-16 16:43:30.273324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:44.551 [2024-11-16 16:43:30.273377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:44.551 [2024-11-16 16:43:30.273493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:44.551 [2024-11-16 16:43:30.273495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:45.924 16:43:31 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:45.924 00:07:45.924 SPDK Configuration: 00:07:45.924 Core mask: 0xf 00:07:45.924 00:07:45.924 Accel Perf Configuration: 00:07:45.924 Workload Type: decompress 00:07:45.924 Transfer size: 111250 bytes 00:07:45.924 Vector count 1 00:07:45.924 Module: software 00:07:45.924 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:45.924 Queue depth: 32 00:07:45.924 Allocate depth: 32 00:07:45.924 # threads/core: 1 00:07:45.924 Run time: 1 seconds 00:07:45.924 Verify: Yes 00:07:45.924 00:07:45.924 Running for 1 seconds... 00:07:45.924 00:07:45.924 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:45.924 ------------------------------------------------------------------------------------ 00:07:45.924 0,0 4256/s 175 MiB/s 0 0 00:07:45.924 3,0 4256/s 175 MiB/s 0 0 00:07:45.924 2,0 4256/s 175 MiB/s 0 0 00:07:45.924 1,0 4256/s 175 MiB/s 0 0 00:07:45.924 ==================================================================================== 00:07:45.924 Total 17024/s 1806 MiB/s 0 0' 00:07:45.924 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:45.924 16:43:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:45.924 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:45.924 16:43:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:45.924 16:43:31 -- accel/accel.sh@12 -- # build_accel_config 00:07:45.924 16:43:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:45.924 16:43:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:45.924 16:43:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:45.924 16:43:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:45.924 16:43:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:45.924 16:43:31 -- accel/accel.sh@41 -- # local IFS=, 00:07:45.924 16:43:31 -- accel/accel.sh@42 -- # jq -r . 00:07:45.924 [2024-11-16 16:43:31.543929] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:45.924 [2024-11-16 16:43:31.544015] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091156 ] 00:07:45.924 EAL: No free 2048 kB hugepages reported on node 1 00:07:45.924 [2024-11-16 16:43:31.606144] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:46.183 [2024-11-16 16:43:31.699631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:46.183 [2024-11-16 16:43:31.699683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:46.183 [2024-11-16 16:43:31.699775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:46.183 [2024-11-16 16:43:31.699778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val= 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val= 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val= 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val=0xf 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val= 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val= 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val=decompress 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val= 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val=software 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@23 -- # accel_module=software 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val=32 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val=32 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val=1 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val=Yes 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val= 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:46.183 16:43:31 -- accel/accel.sh@21 -- # val= 00:07:46.183 16:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # IFS=: 00:07:46.183 16:43:31 -- accel/accel.sh@20 -- # read -r var val 00:07:47.556 16:43:32 -- accel/accel.sh@21 -- # val= 00:07:47.556 16:43:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # IFS=: 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # read -r var val 00:07:47.556 16:43:32 -- accel/accel.sh@21 -- # val= 00:07:47.556 16:43:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # IFS=: 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # read -r var val 00:07:47.556 16:43:32 -- accel/accel.sh@21 -- # val= 00:07:47.556 16:43:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # IFS=: 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # read -r var val 00:07:47.556 16:43:32 -- accel/accel.sh@21 -- # val= 00:07:47.556 16:43:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # IFS=: 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # read -r var val 00:07:47.556 16:43:32 -- accel/accel.sh@21 -- # val= 00:07:47.556 16:43:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # IFS=: 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # read -r var val 00:07:47.556 16:43:32 -- accel/accel.sh@21 -- # val= 00:07:47.556 16:43:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # IFS=: 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # read -r var val 00:07:47.556 16:43:32 -- accel/accel.sh@21 -- # val= 00:07:47.556 16:43:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # IFS=: 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # read -r var val 00:07:47.556 16:43:32 -- accel/accel.sh@21 -- # val= 00:07:47.556 16:43:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # IFS=: 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # read -r var val 00:07:47.556 16:43:32 -- accel/accel.sh@21 -- # val= 00:07:47.556 16:43:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # IFS=: 00:07:47.556 16:43:32 -- accel/accel.sh@20 -- # read -r var val 00:07:47.556 16:43:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:47.556 16:43:32 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:47.557 16:43:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:47.557 00:07:47.557 real 0m2.834s 00:07:47.557 user 0m9.454s 00:07:47.557 sys 0m0.304s 00:07:47.557 16:43:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:47.557 16:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:47.557 ************************************ 00:07:47.557 END TEST accel_decomp_full_mcore 00:07:47.557 ************************************ 00:07:47.557 16:43:32 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:47.557 16:43:32 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:47.557 16:43:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:47.557 16:43:32 -- common/autotest_common.sh@10 -- # set +x 00:07:47.557 ************************************ 00:07:47.557 START TEST accel_decomp_mthread 00:07:47.557 ************************************ 00:07:47.557 16:43:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:47.557 16:43:32 -- accel/accel.sh@16 -- # local accel_opc 00:07:47.557 16:43:32 -- accel/accel.sh@17 -- # local accel_module 00:07:47.557 16:43:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:47.557 16:43:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:47.557 16:43:32 -- accel/accel.sh@12 -- # build_accel_config 00:07:47.557 16:43:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:47.557 16:43:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:47.557 16:43:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:47.557 16:43:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:47.557 16:43:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:47.557 16:43:32 -- accel/accel.sh@41 -- # local IFS=, 00:07:47.557 16:43:32 -- accel/accel.sh@42 -- # jq -r . 00:07:47.557 [2024-11-16 16:43:32.975890] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:47.557 [2024-11-16 16:43:32.975990] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091322 ] 00:07:47.557 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.557 [2024-11-16 16:43:33.035924] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:47.557 [2024-11-16 16:43:33.128480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.931 16:43:34 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:48.931 00:07:48.931 SPDK Configuration: 00:07:48.931 Core mask: 0x1 00:07:48.931 00:07:48.931 Accel Perf Configuration: 00:07:48.931 Workload Type: decompress 00:07:48.931 Transfer size: 4096 bytes 00:07:48.931 Vector count 1 00:07:48.931 Module: software 00:07:48.931 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:48.931 Queue depth: 32 00:07:48.931 Allocate depth: 32 00:07:48.931 # threads/core: 2 00:07:48.931 Run time: 1 seconds 00:07:48.931 Verify: Yes 00:07:48.931 00:07:48.931 Running for 1 seconds... 00:07:48.931 00:07:48.931 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:48.931 ------------------------------------------------------------------------------------ 00:07:48.931 0,1 28032/s 51 MiB/s 0 0 00:07:48.931 0,0 27936/s 51 MiB/s 0 0 00:07:48.931 ==================================================================================== 00:07:48.931 Total 55968/s 218 MiB/s 0 0' 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:48.931 16:43:34 -- accel/accel.sh@12 -- # build_accel_config 00:07:48.931 16:43:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:48.931 16:43:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:48.931 16:43:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:48.931 16:43:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:48.931 16:43:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:48.931 16:43:34 -- accel/accel.sh@41 -- # local IFS=, 00:07:48.931 16:43:34 -- accel/accel.sh@42 -- # jq -r . 00:07:48.931 [2024-11-16 16:43:34.391672] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:48.931 [2024-11-16 16:43:34.391762] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091471 ] 00:07:48.931 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.931 [2024-11-16 16:43:34.452142] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:48.931 [2024-11-16 16:43:34.540361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val= 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val= 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val= 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val=0x1 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val= 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val= 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val=decompress 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val= 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val=software 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@23 -- # accel_module=software 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val=32 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val=32 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val=2 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val=Yes 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val= 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:48.931 16:43:34 -- accel/accel.sh@21 -- # val= 00:07:48.931 16:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # IFS=: 00:07:48.931 16:43:34 -- accel/accel.sh@20 -- # read -r var val 00:07:50.405 16:43:35 -- accel/accel.sh@21 -- # val= 00:07:50.405 16:43:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.405 16:43:35 -- accel/accel.sh@20 -- # IFS=: 00:07:50.405 16:43:35 -- accel/accel.sh@20 -- # read -r var val 00:07:50.405 16:43:35 -- accel/accel.sh@21 -- # val= 00:07:50.405 16:43:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.405 16:43:35 -- accel/accel.sh@20 -- # IFS=: 00:07:50.405 16:43:35 -- accel/accel.sh@20 -- # read -r var val 00:07:50.405 16:43:35 -- accel/accel.sh@21 -- # val= 00:07:50.405 16:43:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.405 16:43:35 -- accel/accel.sh@20 -- # IFS=: 00:07:50.405 16:43:35 -- accel/accel.sh@20 -- # read -r var val 00:07:50.405 16:43:35 -- accel/accel.sh@21 -- # val= 00:07:50.405 16:43:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.405 16:43:35 -- accel/accel.sh@20 -- # IFS=: 00:07:50.405 16:43:35 -- accel/accel.sh@20 -- # read -r var val 00:07:50.405 16:43:35 -- accel/accel.sh@21 -- # val= 00:07:50.405 16:43:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.405 16:43:35 -- accel/accel.sh@20 -- # IFS=: 00:07:50.405 16:43:35 -- accel/accel.sh@20 -- # read -r var val 00:07:50.405 16:43:35 -- accel/accel.sh@21 -- # val= 00:07:50.405 16:43:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.405 16:43:35 -- accel/accel.sh@20 -- # IFS=: 00:07:50.405 16:43:35 -- accel/accel.sh@20 -- # read -r var val 00:07:50.405 16:43:35 -- accel/accel.sh@21 -- # val= 00:07:50.405 16:43:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.405 16:43:35 -- accel/accel.sh@20 -- # IFS=: 00:07:50.405 16:43:35 -- accel/accel.sh@20 -- # read -r var val 00:07:50.405 16:43:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:50.405 16:43:35 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:50.405 16:43:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:50.405 00:07:50.405 real 0m2.825s 00:07:50.405 user 0m2.529s 00:07:50.405 sys 0m0.288s 00:07:50.405 16:43:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:50.405 16:43:35 -- common/autotest_common.sh@10 -- # set +x 00:07:50.405 ************************************ 00:07:50.405 END TEST accel_decomp_mthread 00:07:50.405 ************************************ 00:07:50.405 16:43:35 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:50.405 16:43:35 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:50.405 16:43:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:50.405 16:43:35 -- common/autotest_common.sh@10 -- # set +x 00:07:50.405 ************************************ 00:07:50.405 START TEST accel_deomp_full_mthread 00:07:50.405 ************************************ 00:07:50.405 16:43:35 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:50.405 16:43:35 -- accel/accel.sh@16 -- # local accel_opc 00:07:50.405 16:43:35 -- accel/accel.sh@17 -- # local accel_module 00:07:50.405 16:43:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:50.405 16:43:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:50.405 16:43:35 -- accel/accel.sh@12 -- # build_accel_config 00:07:50.405 16:43:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:50.405 16:43:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:50.405 16:43:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:50.405 16:43:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:50.405 16:43:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:50.405 16:43:35 -- accel/accel.sh@41 -- # local IFS=, 00:07:50.405 16:43:35 -- accel/accel.sh@42 -- # jq -r . 00:07:50.405 [2024-11-16 16:43:35.826482] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:50.405 [2024-11-16 16:43:35.826571] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091744 ] 00:07:50.405 EAL: No free 2048 kB hugepages reported on node 1 00:07:50.405 [2024-11-16 16:43:35.887201] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:50.405 [2024-11-16 16:43:35.977482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:51.779 16:43:37 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:51.779 00:07:51.779 SPDK Configuration: 00:07:51.779 Core mask: 0x1 00:07:51.779 00:07:51.779 Accel Perf Configuration: 00:07:51.779 Workload Type: decompress 00:07:51.779 Transfer size: 111250 bytes 00:07:51.779 Vector count 1 00:07:51.779 Module: software 00:07:51.779 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:51.779 Queue depth: 32 00:07:51.779 Allocate depth: 32 00:07:51.779 # threads/core: 2 00:07:51.779 Run time: 1 seconds 00:07:51.779 Verify: Yes 00:07:51.779 00:07:51.779 Running for 1 seconds... 00:07:51.779 00:07:51.779 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:51.779 ------------------------------------------------------------------------------------ 00:07:51.779 0,1 1952/s 80 MiB/s 0 0 00:07:51.779 0,0 1920/s 79 MiB/s 0 0 00:07:51.779 ==================================================================================== 00:07:51.779 Total 3872/s 410 MiB/s 0 0' 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.779 16:43:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.779 16:43:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:51.779 16:43:37 -- accel/accel.sh@12 -- # build_accel_config 00:07:51.779 16:43:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:51.779 16:43:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:51.779 16:43:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:51.779 16:43:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:51.779 16:43:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:51.779 16:43:37 -- accel/accel.sh@41 -- # local IFS=, 00:07:51.779 16:43:37 -- accel/accel.sh@42 -- # jq -r . 00:07:51.779 [2024-11-16 16:43:37.262831] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:51.779 [2024-11-16 16:43:37.262915] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1091890 ] 00:07:51.779 EAL: No free 2048 kB hugepages reported on node 1 00:07:51.779 [2024-11-16 16:43:37.325908] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:51.779 [2024-11-16 16:43:37.414713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:51.779 16:43:37 -- accel/accel.sh@21 -- # val= 00:07:51.779 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.779 16:43:37 -- accel/accel.sh@21 -- # val= 00:07:51.779 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.779 16:43:37 -- accel/accel.sh@21 -- # val= 00:07:51.779 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.779 16:43:37 -- accel/accel.sh@21 -- # val=0x1 00:07:51.779 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.779 16:43:37 -- accel/accel.sh@21 -- # val= 00:07:51.779 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.779 16:43:37 -- accel/accel.sh@21 -- # val= 00:07:51.779 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.779 16:43:37 -- accel/accel.sh@21 -- # val=decompress 00:07:51.779 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.779 16:43:37 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.779 16:43:37 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:51.779 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.779 16:43:37 -- accel/accel.sh@21 -- # val= 00:07:51.779 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.779 16:43:37 -- accel/accel.sh@21 -- # val=software 00:07:51.779 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.779 16:43:37 -- accel/accel.sh@23 -- # accel_module=software 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.779 16:43:37 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:51.779 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.779 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.779 16:43:37 -- accel/accel.sh@21 -- # val=32 00:07:51.780 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.780 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.780 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.780 16:43:37 -- accel/accel.sh@21 -- # val=32 00:07:51.780 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.780 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.780 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.780 16:43:37 -- accel/accel.sh@21 -- # val=2 00:07:51.780 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.780 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.780 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.780 16:43:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:51.780 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.780 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.780 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.780 16:43:37 -- accel/accel.sh@21 -- # val=Yes 00:07:51.780 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.780 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.780 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.780 16:43:37 -- accel/accel.sh@21 -- # val= 00:07:51.780 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.780 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.780 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:51.780 16:43:37 -- accel/accel.sh@21 -- # val= 00:07:51.780 16:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:51.780 16:43:37 -- accel/accel.sh@20 -- # IFS=: 00:07:51.780 16:43:37 -- accel/accel.sh@20 -- # read -r var val 00:07:53.153 16:43:38 -- accel/accel.sh@21 -- # val= 00:07:53.153 16:43:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.153 16:43:38 -- accel/accel.sh@20 -- # IFS=: 00:07:53.153 16:43:38 -- accel/accel.sh@20 -- # read -r var val 00:07:53.153 16:43:38 -- accel/accel.sh@21 -- # val= 00:07:53.153 16:43:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.153 16:43:38 -- accel/accel.sh@20 -- # IFS=: 00:07:53.153 16:43:38 -- accel/accel.sh@20 -- # read -r var val 00:07:53.153 16:43:38 -- accel/accel.sh@21 -- # val= 00:07:53.153 16:43:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.153 16:43:38 -- accel/accel.sh@20 -- # IFS=: 00:07:53.153 16:43:38 -- accel/accel.sh@20 -- # read -r var val 00:07:53.153 16:43:38 -- accel/accel.sh@21 -- # val= 00:07:53.153 16:43:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.153 16:43:38 -- accel/accel.sh@20 -- # IFS=: 00:07:53.153 16:43:38 -- accel/accel.sh@20 -- # read -r var val 00:07:53.153 16:43:38 -- accel/accel.sh@21 -- # val= 00:07:53.153 16:43:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.153 16:43:38 -- accel/accel.sh@20 -- # IFS=: 00:07:53.153 16:43:38 -- accel/accel.sh@20 -- # read -r var val 00:07:53.153 16:43:38 -- accel/accel.sh@21 -- # val= 00:07:53.153 16:43:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.153 16:43:38 -- accel/accel.sh@20 -- # IFS=: 00:07:53.153 16:43:38 -- accel/accel.sh@20 -- # read -r var val 00:07:53.153 16:43:38 -- accel/accel.sh@21 -- # val= 00:07:53.153 16:43:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.153 16:43:38 -- accel/accel.sh@20 -- # IFS=: 00:07:53.153 16:43:38 -- accel/accel.sh@20 -- # read -r var val 00:07:53.153 16:43:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:53.153 16:43:38 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:53.153 16:43:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:53.153 00:07:53.153 real 0m2.866s 00:07:53.153 user 0m2.570s 00:07:53.153 sys 0m0.288s 00:07:53.153 16:43:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:53.153 16:43:38 -- common/autotest_common.sh@10 -- # set +x 00:07:53.153 ************************************ 00:07:53.153 END TEST accel_deomp_full_mthread 00:07:53.153 ************************************ 00:07:53.153 16:43:38 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:53.153 16:43:38 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:53.153 16:43:38 -- accel/accel.sh@129 -- # build_accel_config 00:07:53.153 16:43:38 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:53.153 16:43:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:53.153 16:43:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:53.153 16:43:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:53.153 16:43:38 -- common/autotest_common.sh@10 -- # set +x 00:07:53.153 16:43:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:53.153 16:43:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:53.153 16:43:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:53.153 16:43:38 -- accel/accel.sh@41 -- # local IFS=, 00:07:53.153 16:43:38 -- accel/accel.sh@42 -- # jq -r . 00:07:53.153 ************************************ 00:07:53.153 START TEST accel_dif_functional_tests 00:07:53.153 ************************************ 00:07:53.153 16:43:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:53.153 [2024-11-16 16:43:38.741353] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:53.153 [2024-11-16 16:43:38.741435] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092054 ] 00:07:53.153 EAL: No free 2048 kB hugepages reported on node 1 00:07:53.153 [2024-11-16 16:43:38.802374] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:53.153 [2024-11-16 16:43:38.893424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:53.153 [2024-11-16 16:43:38.893494] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:53.153 [2024-11-16 16:43:38.893496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:53.411 00:07:53.411 00:07:53.411 CUnit - A unit testing framework for C - Version 2.1-3 00:07:53.411 http://cunit.sourceforge.net/ 00:07:53.411 00:07:53.411 00:07:53.411 Suite: accel_dif 00:07:53.411 Test: verify: DIF generated, GUARD check ...passed 00:07:53.411 Test: verify: DIF generated, APPTAG check ...passed 00:07:53.411 Test: verify: DIF generated, REFTAG check ...passed 00:07:53.411 Test: verify: DIF not generated, GUARD check ...[2024-11-16 16:43:38.984257] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:53.411 [2024-11-16 16:43:38.984332] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:53.411 passed 00:07:53.411 Test: verify: DIF not generated, APPTAG check ...[2024-11-16 16:43:38.984380] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:53.411 [2024-11-16 16:43:38.984407] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:53.411 passed 00:07:53.411 Test: verify: DIF not generated, REFTAG check ...[2024-11-16 16:43:38.984436] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:53.411 [2024-11-16 16:43:38.984460] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:53.411 passed 00:07:53.411 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:53.411 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-16 16:43:38.984517] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:53.411 passed 00:07:53.411 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:53.411 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:53.411 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:53.411 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-16 16:43:38.984678] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:53.411 passed 00:07:53.411 Test: generate copy: DIF generated, GUARD check ...passed 00:07:53.411 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:53.411 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:53.411 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:53.411 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:53.411 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:53.411 Test: generate copy: iovecs-len validate ...[2024-11-16 16:43:38.984912] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:53.411 passed 00:07:53.411 Test: generate copy: buffer alignment validate ...passed 00:07:53.411 00:07:53.411 Run Summary: Type Total Ran Passed Failed Inactive 00:07:53.411 suites 1 1 n/a 0 0 00:07:53.411 tests 20 20 20 0 0 00:07:53.411 asserts 204 204 204 0 n/a 00:07:53.411 00:07:53.411 Elapsed time = 0.002 seconds 00:07:53.669 00:07:53.669 real 0m0.490s 00:07:53.669 user 0m0.752s 00:07:53.669 sys 0m0.180s 00:07:53.669 16:43:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:53.669 16:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:53.669 ************************************ 00:07:53.669 END TEST accel_dif_functional_tests 00:07:53.669 ************************************ 00:07:53.669 00:07:53.669 real 0m59.894s 00:07:53.669 user 1m7.627s 00:07:53.669 sys 0m7.232s 00:07:53.669 16:43:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:53.669 16:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:53.669 ************************************ 00:07:53.669 END TEST accel 00:07:53.669 ************************************ 00:07:53.669 16:43:39 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:53.669 16:43:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:53.669 16:43:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:53.669 16:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:53.669 ************************************ 00:07:53.669 START TEST accel_rpc 00:07:53.669 ************************************ 00:07:53.669 16:43:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:53.669 * Looking for test storage... 00:07:53.669 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:53.669 16:43:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:53.669 16:43:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:53.669 16:43:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:53.669 16:43:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:53.669 16:43:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:53.669 16:43:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:53.669 16:43:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:53.669 16:43:39 -- scripts/common.sh@335 -- # IFS=.-: 00:07:53.669 16:43:39 -- scripts/common.sh@335 -- # read -ra ver1 00:07:53.669 16:43:39 -- scripts/common.sh@336 -- # IFS=.-: 00:07:53.669 16:43:39 -- scripts/common.sh@336 -- # read -ra ver2 00:07:53.669 16:43:39 -- scripts/common.sh@337 -- # local 'op=<' 00:07:53.669 16:43:39 -- scripts/common.sh@339 -- # ver1_l=2 00:07:53.669 16:43:39 -- scripts/common.sh@340 -- # ver2_l=1 00:07:53.669 16:43:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:53.669 16:43:39 -- scripts/common.sh@343 -- # case "$op" in 00:07:53.669 16:43:39 -- scripts/common.sh@344 -- # : 1 00:07:53.669 16:43:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:53.669 16:43:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:53.669 16:43:39 -- scripts/common.sh@364 -- # decimal 1 00:07:53.669 16:43:39 -- scripts/common.sh@352 -- # local d=1 00:07:53.669 16:43:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:53.669 16:43:39 -- scripts/common.sh@354 -- # echo 1 00:07:53.669 16:43:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:53.669 16:43:39 -- scripts/common.sh@365 -- # decimal 2 00:07:53.669 16:43:39 -- scripts/common.sh@352 -- # local d=2 00:07:53.669 16:43:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:53.669 16:43:39 -- scripts/common.sh@354 -- # echo 2 00:07:53.669 16:43:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:53.669 16:43:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:53.669 16:43:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:53.669 16:43:39 -- scripts/common.sh@367 -- # return 0 00:07:53.669 16:43:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:53.669 16:43:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:53.669 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.669 --rc genhtml_branch_coverage=1 00:07:53.669 --rc genhtml_function_coverage=1 00:07:53.669 --rc genhtml_legend=1 00:07:53.669 --rc geninfo_all_blocks=1 00:07:53.669 --rc geninfo_unexecuted_blocks=1 00:07:53.669 00:07:53.669 ' 00:07:53.669 16:43:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:53.669 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.669 --rc genhtml_branch_coverage=1 00:07:53.669 --rc genhtml_function_coverage=1 00:07:53.669 --rc genhtml_legend=1 00:07:53.669 --rc geninfo_all_blocks=1 00:07:53.669 --rc geninfo_unexecuted_blocks=1 00:07:53.669 00:07:53.669 ' 00:07:53.669 16:43:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:53.669 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.669 --rc genhtml_branch_coverage=1 00:07:53.669 --rc genhtml_function_coverage=1 00:07:53.669 --rc genhtml_legend=1 00:07:53.669 --rc geninfo_all_blocks=1 00:07:53.669 --rc geninfo_unexecuted_blocks=1 00:07:53.669 00:07:53.670 ' 00:07:53.670 16:43:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:53.670 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.670 --rc genhtml_branch_coverage=1 00:07:53.670 --rc genhtml_function_coverage=1 00:07:53.670 --rc genhtml_legend=1 00:07:53.670 --rc geninfo_all_blocks=1 00:07:53.670 --rc geninfo_unexecuted_blocks=1 00:07:53.670 00:07:53.670 ' 00:07:53.670 16:43:39 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:53.670 16:43:39 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1092246 00:07:53.670 16:43:39 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:53.670 16:43:39 -- accel/accel_rpc.sh@15 -- # waitforlisten 1092246 00:07:53.670 16:43:39 -- common/autotest_common.sh@829 -- # '[' -z 1092246 ']' 00:07:53.670 16:43:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:53.670 16:43:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:53.670 16:43:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:53.670 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:53.670 16:43:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:53.670 16:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:53.928 [2024-11-16 16:43:39.429863] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:53.928 [2024-11-16 16:43:39.429963] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092246 ] 00:07:53.928 EAL: No free 2048 kB hugepages reported on node 1 00:07:53.928 [2024-11-16 16:43:39.486797] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:53.928 [2024-11-16 16:43:39.572261] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:53.928 [2024-11-16 16:43:39.572427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:53.928 16:43:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:53.928 16:43:39 -- common/autotest_common.sh@862 -- # return 0 00:07:53.928 16:43:39 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:53.928 16:43:39 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:53.928 16:43:39 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:53.928 16:43:39 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:53.928 16:43:39 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:53.928 16:43:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:53.928 16:43:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:53.928 16:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:53.928 ************************************ 00:07:53.928 START TEST accel_assign_opcode 00:07:53.928 ************************************ 00:07:53.928 16:43:39 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:07:53.928 16:43:39 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:53.928 16:43:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:53.928 16:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:53.928 [2024-11-16 16:43:39.645021] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:53.928 16:43:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:53.928 16:43:39 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:53.928 16:43:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:53.928 16:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:53.928 [2024-11-16 16:43:39.653037] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:53.928 16:43:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:53.928 16:43:39 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:53.928 16:43:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:53.928 16:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:54.187 16:43:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.187 16:43:39 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:54.187 16:43:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.187 16:43:39 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:54.187 16:43:39 -- accel/accel_rpc.sh@42 -- # grep software 00:07:54.187 16:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:54.187 16:43:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.187 software 00:07:54.187 00:07:54.187 real 0m0.273s 00:07:54.187 user 0m0.033s 00:07:54.187 sys 0m0.007s 00:07:54.187 16:43:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:54.187 16:43:39 -- common/autotest_common.sh@10 -- # set +x 00:07:54.187 ************************************ 00:07:54.187 END TEST accel_assign_opcode 00:07:54.187 ************************************ 00:07:54.187 16:43:39 -- accel/accel_rpc.sh@55 -- # killprocess 1092246 00:07:54.445 16:43:39 -- common/autotest_common.sh@936 -- # '[' -z 1092246 ']' 00:07:54.445 16:43:39 -- common/autotest_common.sh@940 -- # kill -0 1092246 00:07:54.445 16:43:39 -- common/autotest_common.sh@941 -- # uname 00:07:54.445 16:43:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:54.445 16:43:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1092246 00:07:54.445 16:43:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:54.445 16:43:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:54.445 16:43:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1092246' 00:07:54.445 killing process with pid 1092246 00:07:54.445 16:43:39 -- common/autotest_common.sh@955 -- # kill 1092246 00:07:54.445 16:43:39 -- common/autotest_common.sh@960 -- # wait 1092246 00:07:54.703 00:07:54.703 real 0m1.138s 00:07:54.703 user 0m1.061s 00:07:54.703 sys 0m0.431s 00:07:54.703 16:43:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:54.703 16:43:40 -- common/autotest_common.sh@10 -- # set +x 00:07:54.703 ************************************ 00:07:54.703 END TEST accel_rpc 00:07:54.703 ************************************ 00:07:54.703 16:43:40 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:54.703 16:43:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:54.703 16:43:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:54.703 16:43:40 -- common/autotest_common.sh@10 -- # set +x 00:07:54.703 ************************************ 00:07:54.703 START TEST app_cmdline 00:07:54.703 ************************************ 00:07:54.703 16:43:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:54.961 * Looking for test storage... 00:07:54.961 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:54.961 16:43:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:54.961 16:43:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:54.961 16:43:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:54.961 16:43:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:54.961 16:43:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:54.961 16:43:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:54.961 16:43:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:54.961 16:43:40 -- scripts/common.sh@335 -- # IFS=.-: 00:07:54.961 16:43:40 -- scripts/common.sh@335 -- # read -ra ver1 00:07:54.961 16:43:40 -- scripts/common.sh@336 -- # IFS=.-: 00:07:54.962 16:43:40 -- scripts/common.sh@336 -- # read -ra ver2 00:07:54.962 16:43:40 -- scripts/common.sh@337 -- # local 'op=<' 00:07:54.962 16:43:40 -- scripts/common.sh@339 -- # ver1_l=2 00:07:54.962 16:43:40 -- scripts/common.sh@340 -- # ver2_l=1 00:07:54.962 16:43:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:54.962 16:43:40 -- scripts/common.sh@343 -- # case "$op" in 00:07:54.962 16:43:40 -- scripts/common.sh@344 -- # : 1 00:07:54.962 16:43:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:54.962 16:43:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:54.962 16:43:40 -- scripts/common.sh@364 -- # decimal 1 00:07:54.962 16:43:40 -- scripts/common.sh@352 -- # local d=1 00:07:54.962 16:43:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:54.962 16:43:40 -- scripts/common.sh@354 -- # echo 1 00:07:54.962 16:43:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:54.962 16:43:40 -- scripts/common.sh@365 -- # decimal 2 00:07:54.962 16:43:40 -- scripts/common.sh@352 -- # local d=2 00:07:54.962 16:43:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:54.962 16:43:40 -- scripts/common.sh@354 -- # echo 2 00:07:54.962 16:43:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:54.962 16:43:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:54.962 16:43:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:54.962 16:43:40 -- scripts/common.sh@367 -- # return 0 00:07:54.962 16:43:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:54.962 16:43:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:54.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:54.962 --rc genhtml_branch_coverage=1 00:07:54.962 --rc genhtml_function_coverage=1 00:07:54.962 --rc genhtml_legend=1 00:07:54.962 --rc geninfo_all_blocks=1 00:07:54.962 --rc geninfo_unexecuted_blocks=1 00:07:54.962 00:07:54.962 ' 00:07:54.962 16:43:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:54.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:54.962 --rc genhtml_branch_coverage=1 00:07:54.962 --rc genhtml_function_coverage=1 00:07:54.962 --rc genhtml_legend=1 00:07:54.962 --rc geninfo_all_blocks=1 00:07:54.962 --rc geninfo_unexecuted_blocks=1 00:07:54.962 00:07:54.962 ' 00:07:54.962 16:43:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:54.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:54.962 --rc genhtml_branch_coverage=1 00:07:54.962 --rc genhtml_function_coverage=1 00:07:54.962 --rc genhtml_legend=1 00:07:54.962 --rc geninfo_all_blocks=1 00:07:54.962 --rc geninfo_unexecuted_blocks=1 00:07:54.962 00:07:54.962 ' 00:07:54.962 16:43:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:54.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:54.962 --rc genhtml_branch_coverage=1 00:07:54.962 --rc genhtml_function_coverage=1 00:07:54.962 --rc genhtml_legend=1 00:07:54.962 --rc geninfo_all_blocks=1 00:07:54.962 --rc geninfo_unexecuted_blocks=1 00:07:54.962 00:07:54.962 ' 00:07:54.962 16:43:40 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:54.962 16:43:40 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1092457 00:07:54.962 16:43:40 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:54.962 16:43:40 -- app/cmdline.sh@18 -- # waitforlisten 1092457 00:07:54.962 16:43:40 -- common/autotest_common.sh@829 -- # '[' -z 1092457 ']' 00:07:54.962 16:43:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:54.962 16:43:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:54.962 16:43:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:54.962 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:54.962 16:43:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:54.962 16:43:40 -- common/autotest_common.sh@10 -- # set +x 00:07:54.962 [2024-11-16 16:43:40.595537] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:54.962 [2024-11-16 16:43:40.595633] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1092457 ] 00:07:54.962 EAL: No free 2048 kB hugepages reported on node 1 00:07:54.962 [2024-11-16 16:43:40.651393] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:55.220 [2024-11-16 16:43:40.738835] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:55.220 [2024-11-16 16:43:40.739015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:56.154 16:43:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:56.154 16:43:41 -- common/autotest_common.sh@862 -- # return 0 00:07:56.154 16:43:41 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:56.154 { 00:07:56.154 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:07:56.154 "fields": { 00:07:56.154 "major": 24, 00:07:56.154 "minor": 1, 00:07:56.154 "patch": 1, 00:07:56.154 "suffix": "-pre", 00:07:56.154 "commit": "c13c99a5e" 00:07:56.154 } 00:07:56.154 } 00:07:56.154 16:43:41 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:56.154 16:43:41 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:56.154 16:43:41 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:56.154 16:43:41 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:56.154 16:43:41 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:56.154 16:43:41 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:56.154 16:43:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.154 16:43:41 -- common/autotest_common.sh@10 -- # set +x 00:07:56.154 16:43:41 -- app/cmdline.sh@26 -- # sort 00:07:56.154 16:43:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.154 16:43:41 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:56.154 16:43:41 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:56.154 16:43:41 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:56.154 16:43:41 -- common/autotest_common.sh@650 -- # local es=0 00:07:56.154 16:43:41 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:56.154 16:43:41 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:56.154 16:43:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:56.154 16:43:41 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:56.154 16:43:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:56.154 16:43:41 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:56.154 16:43:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:56.154 16:43:41 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:56.154 16:43:41 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:56.154 16:43:41 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:56.412 request: 00:07:56.412 { 00:07:56.412 "method": "env_dpdk_get_mem_stats", 00:07:56.412 "req_id": 1 00:07:56.412 } 00:07:56.412 Got JSON-RPC error response 00:07:56.412 response: 00:07:56.412 { 00:07:56.412 "code": -32601, 00:07:56.412 "message": "Method not found" 00:07:56.412 } 00:07:56.412 16:43:42 -- common/autotest_common.sh@653 -- # es=1 00:07:56.412 16:43:42 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:56.412 16:43:42 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:56.412 16:43:42 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:56.412 16:43:42 -- app/cmdline.sh@1 -- # killprocess 1092457 00:07:56.412 16:43:42 -- common/autotest_common.sh@936 -- # '[' -z 1092457 ']' 00:07:56.412 16:43:42 -- common/autotest_common.sh@940 -- # kill -0 1092457 00:07:56.412 16:43:42 -- common/autotest_common.sh@941 -- # uname 00:07:56.412 16:43:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:56.412 16:43:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1092457 00:07:56.412 16:43:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:56.412 16:43:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:56.412 16:43:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1092457' 00:07:56.412 killing process with pid 1092457 00:07:56.412 16:43:42 -- common/autotest_common.sh@955 -- # kill 1092457 00:07:56.412 16:43:42 -- common/autotest_common.sh@960 -- # wait 1092457 00:07:56.978 00:07:56.978 real 0m2.108s 00:07:56.978 user 0m2.632s 00:07:56.978 sys 0m0.500s 00:07:56.978 16:43:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:56.978 16:43:42 -- common/autotest_common.sh@10 -- # set +x 00:07:56.978 ************************************ 00:07:56.978 END TEST app_cmdline 00:07:56.978 ************************************ 00:07:56.978 16:43:42 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:56.978 16:43:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:56.978 16:43:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:56.978 16:43:42 -- common/autotest_common.sh@10 -- # set +x 00:07:56.978 ************************************ 00:07:56.978 START TEST version 00:07:56.978 ************************************ 00:07:56.978 16:43:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:56.978 * Looking for test storage... 00:07:56.978 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:56.978 16:43:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:56.978 16:43:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:56.978 16:43:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:56.978 16:43:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:56.978 16:43:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:56.978 16:43:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:56.978 16:43:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:56.978 16:43:42 -- scripts/common.sh@335 -- # IFS=.-: 00:07:56.978 16:43:42 -- scripts/common.sh@335 -- # read -ra ver1 00:07:56.978 16:43:42 -- scripts/common.sh@336 -- # IFS=.-: 00:07:56.978 16:43:42 -- scripts/common.sh@336 -- # read -ra ver2 00:07:56.978 16:43:42 -- scripts/common.sh@337 -- # local 'op=<' 00:07:56.978 16:43:42 -- scripts/common.sh@339 -- # ver1_l=2 00:07:56.978 16:43:42 -- scripts/common.sh@340 -- # ver2_l=1 00:07:56.978 16:43:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:56.978 16:43:42 -- scripts/common.sh@343 -- # case "$op" in 00:07:56.978 16:43:42 -- scripts/common.sh@344 -- # : 1 00:07:56.978 16:43:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:56.978 16:43:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:56.978 16:43:42 -- scripts/common.sh@364 -- # decimal 1 00:07:56.978 16:43:42 -- scripts/common.sh@352 -- # local d=1 00:07:56.978 16:43:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:56.978 16:43:42 -- scripts/common.sh@354 -- # echo 1 00:07:56.978 16:43:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:56.978 16:43:42 -- scripts/common.sh@365 -- # decimal 2 00:07:56.978 16:43:42 -- scripts/common.sh@352 -- # local d=2 00:07:56.978 16:43:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:56.978 16:43:42 -- scripts/common.sh@354 -- # echo 2 00:07:56.978 16:43:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:56.978 16:43:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:56.978 16:43:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:56.978 16:43:42 -- scripts/common.sh@367 -- # return 0 00:07:56.978 16:43:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:56.978 16:43:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:56.978 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:56.978 --rc genhtml_branch_coverage=1 00:07:56.978 --rc genhtml_function_coverage=1 00:07:56.978 --rc genhtml_legend=1 00:07:56.978 --rc geninfo_all_blocks=1 00:07:56.978 --rc geninfo_unexecuted_blocks=1 00:07:56.978 00:07:56.978 ' 00:07:56.978 16:43:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:56.978 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:56.978 --rc genhtml_branch_coverage=1 00:07:56.978 --rc genhtml_function_coverage=1 00:07:56.978 --rc genhtml_legend=1 00:07:56.978 --rc geninfo_all_blocks=1 00:07:56.978 --rc geninfo_unexecuted_blocks=1 00:07:56.978 00:07:56.978 ' 00:07:56.978 16:43:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:56.978 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:56.978 --rc genhtml_branch_coverage=1 00:07:56.978 --rc genhtml_function_coverage=1 00:07:56.978 --rc genhtml_legend=1 00:07:56.978 --rc geninfo_all_blocks=1 00:07:56.978 --rc geninfo_unexecuted_blocks=1 00:07:56.978 00:07:56.978 ' 00:07:56.978 16:43:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:56.978 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:56.978 --rc genhtml_branch_coverage=1 00:07:56.978 --rc genhtml_function_coverage=1 00:07:56.978 --rc genhtml_legend=1 00:07:56.978 --rc geninfo_all_blocks=1 00:07:56.978 --rc geninfo_unexecuted_blocks=1 00:07:56.978 00:07:56.978 ' 00:07:56.978 16:43:42 -- app/version.sh@17 -- # get_header_version major 00:07:56.978 16:43:42 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:56.978 16:43:42 -- app/version.sh@14 -- # cut -f2 00:07:56.978 16:43:42 -- app/version.sh@14 -- # tr -d '"' 00:07:56.978 16:43:42 -- app/version.sh@17 -- # major=24 00:07:56.978 16:43:42 -- app/version.sh@18 -- # get_header_version minor 00:07:56.978 16:43:42 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:56.978 16:43:42 -- app/version.sh@14 -- # tr -d '"' 00:07:56.978 16:43:42 -- app/version.sh@14 -- # cut -f2 00:07:56.978 16:43:42 -- app/version.sh@18 -- # minor=1 00:07:56.978 16:43:42 -- app/version.sh@19 -- # get_header_version patch 00:07:56.978 16:43:42 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:56.978 16:43:42 -- app/version.sh@14 -- # cut -f2 00:07:56.979 16:43:42 -- app/version.sh@14 -- # tr -d '"' 00:07:56.979 16:43:42 -- app/version.sh@19 -- # patch=1 00:07:56.979 16:43:42 -- app/version.sh@20 -- # get_header_version suffix 00:07:56.979 16:43:42 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:56.979 16:43:42 -- app/version.sh@14 -- # cut -f2 00:07:56.979 16:43:42 -- app/version.sh@14 -- # tr -d '"' 00:07:56.979 16:43:42 -- app/version.sh@20 -- # suffix=-pre 00:07:56.979 16:43:42 -- app/version.sh@22 -- # version=24.1 00:07:56.979 16:43:42 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:56.979 16:43:42 -- app/version.sh@25 -- # version=24.1.1 00:07:56.979 16:43:42 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:56.979 16:43:42 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:56.979 16:43:42 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:57.237 16:43:42 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:57.237 16:43:42 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:57.237 00:07:57.237 real 0m0.191s 00:07:57.237 user 0m0.128s 00:07:57.237 sys 0m0.090s 00:07:57.237 16:43:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:57.237 16:43:42 -- common/autotest_common.sh@10 -- # set +x 00:07:57.237 ************************************ 00:07:57.237 END TEST version 00:07:57.237 ************************************ 00:07:57.237 16:43:42 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:07:57.237 16:43:42 -- spdk/autotest.sh@191 -- # uname -s 00:07:57.237 16:43:42 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:07:57.237 16:43:42 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:57.237 16:43:42 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:57.237 16:43:42 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:07:57.237 16:43:42 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:07:57.237 16:43:42 -- spdk/autotest.sh@255 -- # timing_exit lib 00:07:57.237 16:43:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:57.237 16:43:42 -- common/autotest_common.sh@10 -- # set +x 00:07:57.237 16:43:42 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:07:57.237 16:43:42 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:07:57.237 16:43:42 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:07:57.237 16:43:42 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:07:57.237 16:43:42 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:07:57.237 16:43:42 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:07:57.237 16:43:42 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:57.238 16:43:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:57.238 16:43:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:57.238 16:43:42 -- common/autotest_common.sh@10 -- # set +x 00:07:57.238 ************************************ 00:07:57.238 START TEST nvmf_tcp 00:07:57.238 ************************************ 00:07:57.238 16:43:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:57.238 * Looking for test storage... 00:07:57.238 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:57.238 16:43:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:57.238 16:43:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:57.238 16:43:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:57.238 16:43:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:57.238 16:43:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:57.238 16:43:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:57.238 16:43:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:57.238 16:43:42 -- scripts/common.sh@335 -- # IFS=.-: 00:07:57.238 16:43:42 -- scripts/common.sh@335 -- # read -ra ver1 00:07:57.238 16:43:42 -- scripts/common.sh@336 -- # IFS=.-: 00:07:57.238 16:43:42 -- scripts/common.sh@336 -- # read -ra ver2 00:07:57.238 16:43:42 -- scripts/common.sh@337 -- # local 'op=<' 00:07:57.238 16:43:42 -- scripts/common.sh@339 -- # ver1_l=2 00:07:57.238 16:43:42 -- scripts/common.sh@340 -- # ver2_l=1 00:07:57.238 16:43:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:57.238 16:43:42 -- scripts/common.sh@343 -- # case "$op" in 00:07:57.238 16:43:42 -- scripts/common.sh@344 -- # : 1 00:07:57.238 16:43:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:57.238 16:43:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:57.238 16:43:42 -- scripts/common.sh@364 -- # decimal 1 00:07:57.238 16:43:42 -- scripts/common.sh@352 -- # local d=1 00:07:57.238 16:43:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:57.238 16:43:42 -- scripts/common.sh@354 -- # echo 1 00:07:57.238 16:43:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:57.238 16:43:42 -- scripts/common.sh@365 -- # decimal 2 00:07:57.238 16:43:42 -- scripts/common.sh@352 -- # local d=2 00:07:57.238 16:43:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:57.238 16:43:42 -- scripts/common.sh@354 -- # echo 2 00:07:57.238 16:43:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:57.238 16:43:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:57.238 16:43:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:57.238 16:43:42 -- scripts/common.sh@367 -- # return 0 00:07:57.238 16:43:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:57.238 16:43:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:57.238 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.238 --rc genhtml_branch_coverage=1 00:07:57.238 --rc genhtml_function_coverage=1 00:07:57.238 --rc genhtml_legend=1 00:07:57.238 --rc geninfo_all_blocks=1 00:07:57.238 --rc geninfo_unexecuted_blocks=1 00:07:57.238 00:07:57.238 ' 00:07:57.238 16:43:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:57.238 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.238 --rc genhtml_branch_coverage=1 00:07:57.238 --rc genhtml_function_coverage=1 00:07:57.238 --rc genhtml_legend=1 00:07:57.238 --rc geninfo_all_blocks=1 00:07:57.238 --rc geninfo_unexecuted_blocks=1 00:07:57.238 00:07:57.238 ' 00:07:57.238 16:43:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:57.238 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.238 --rc genhtml_branch_coverage=1 00:07:57.238 --rc genhtml_function_coverage=1 00:07:57.238 --rc genhtml_legend=1 00:07:57.238 --rc geninfo_all_blocks=1 00:07:57.238 --rc geninfo_unexecuted_blocks=1 00:07:57.238 00:07:57.238 ' 00:07:57.238 16:43:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:57.238 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.238 --rc genhtml_branch_coverage=1 00:07:57.238 --rc genhtml_function_coverage=1 00:07:57.238 --rc genhtml_legend=1 00:07:57.238 --rc geninfo_all_blocks=1 00:07:57.238 --rc geninfo_unexecuted_blocks=1 00:07:57.238 00:07:57.238 ' 00:07:57.238 16:43:42 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:57.238 16:43:42 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:57.238 16:43:42 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:57.238 16:43:42 -- nvmf/common.sh@7 -- # uname -s 00:07:57.238 16:43:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:57.238 16:43:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:57.238 16:43:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:57.238 16:43:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:57.238 16:43:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:57.238 16:43:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:57.238 16:43:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:57.238 16:43:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:57.238 16:43:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:57.238 16:43:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:57.238 16:43:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:57.238 16:43:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:57.238 16:43:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:57.238 16:43:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:57.238 16:43:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:57.238 16:43:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:57.238 16:43:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:57.238 16:43:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:57.238 16:43:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:57.238 16:43:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.238 16:43:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.238 16:43:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.238 16:43:42 -- paths/export.sh@5 -- # export PATH 00:07:57.238 16:43:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.238 16:43:42 -- nvmf/common.sh@46 -- # : 0 00:07:57.238 16:43:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:57.238 16:43:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:57.238 16:43:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:57.238 16:43:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:57.238 16:43:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:57.238 16:43:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:57.238 16:43:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:57.238 16:43:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:57.238 16:43:42 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:57.238 16:43:42 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:57.238 16:43:42 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:57.238 16:43:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:57.238 16:43:42 -- common/autotest_common.sh@10 -- # set +x 00:07:57.238 16:43:42 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:57.238 16:43:42 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:57.238 16:43:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:57.238 16:43:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:57.238 16:43:42 -- common/autotest_common.sh@10 -- # set +x 00:07:57.238 ************************************ 00:07:57.238 START TEST nvmf_example 00:07:57.238 ************************************ 00:07:57.238 16:43:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:57.497 * Looking for test storage... 00:07:57.497 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:57.497 16:43:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:57.497 16:43:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:57.497 16:43:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:57.497 16:43:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:57.497 16:43:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:57.497 16:43:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:57.497 16:43:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:57.497 16:43:43 -- scripts/common.sh@335 -- # IFS=.-: 00:07:57.497 16:43:43 -- scripts/common.sh@335 -- # read -ra ver1 00:07:57.497 16:43:43 -- scripts/common.sh@336 -- # IFS=.-: 00:07:57.497 16:43:43 -- scripts/common.sh@336 -- # read -ra ver2 00:07:57.497 16:43:43 -- scripts/common.sh@337 -- # local 'op=<' 00:07:57.497 16:43:43 -- scripts/common.sh@339 -- # ver1_l=2 00:07:57.497 16:43:43 -- scripts/common.sh@340 -- # ver2_l=1 00:07:57.497 16:43:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:57.497 16:43:43 -- scripts/common.sh@343 -- # case "$op" in 00:07:57.497 16:43:43 -- scripts/common.sh@344 -- # : 1 00:07:57.497 16:43:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:57.497 16:43:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:57.497 16:43:43 -- scripts/common.sh@364 -- # decimal 1 00:07:57.497 16:43:43 -- scripts/common.sh@352 -- # local d=1 00:07:57.497 16:43:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:57.497 16:43:43 -- scripts/common.sh@354 -- # echo 1 00:07:57.497 16:43:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:57.497 16:43:43 -- scripts/common.sh@365 -- # decimal 2 00:07:57.498 16:43:43 -- scripts/common.sh@352 -- # local d=2 00:07:57.498 16:43:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:57.498 16:43:43 -- scripts/common.sh@354 -- # echo 2 00:07:57.498 16:43:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:57.498 16:43:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:57.498 16:43:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:57.498 16:43:43 -- scripts/common.sh@367 -- # return 0 00:07:57.498 16:43:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:57.498 16:43:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:57.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.498 --rc genhtml_branch_coverage=1 00:07:57.498 --rc genhtml_function_coverage=1 00:07:57.498 --rc genhtml_legend=1 00:07:57.498 --rc geninfo_all_blocks=1 00:07:57.498 --rc geninfo_unexecuted_blocks=1 00:07:57.498 00:07:57.498 ' 00:07:57.498 16:43:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:57.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.498 --rc genhtml_branch_coverage=1 00:07:57.498 --rc genhtml_function_coverage=1 00:07:57.498 --rc genhtml_legend=1 00:07:57.498 --rc geninfo_all_blocks=1 00:07:57.498 --rc geninfo_unexecuted_blocks=1 00:07:57.498 00:07:57.498 ' 00:07:57.498 16:43:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:57.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.498 --rc genhtml_branch_coverage=1 00:07:57.498 --rc genhtml_function_coverage=1 00:07:57.498 --rc genhtml_legend=1 00:07:57.498 --rc geninfo_all_blocks=1 00:07:57.498 --rc geninfo_unexecuted_blocks=1 00:07:57.498 00:07:57.498 ' 00:07:57.498 16:43:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:57.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.498 --rc genhtml_branch_coverage=1 00:07:57.498 --rc genhtml_function_coverage=1 00:07:57.498 --rc genhtml_legend=1 00:07:57.498 --rc geninfo_all_blocks=1 00:07:57.498 --rc geninfo_unexecuted_blocks=1 00:07:57.498 00:07:57.498 ' 00:07:57.498 16:43:43 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:57.498 16:43:43 -- nvmf/common.sh@7 -- # uname -s 00:07:57.498 16:43:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:57.498 16:43:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:57.498 16:43:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:57.498 16:43:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:57.498 16:43:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:57.498 16:43:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:57.498 16:43:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:57.498 16:43:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:57.498 16:43:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:57.498 16:43:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:57.498 16:43:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:57.498 16:43:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:57.498 16:43:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:57.498 16:43:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:57.498 16:43:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:57.498 16:43:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:57.498 16:43:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:57.498 16:43:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:57.498 16:43:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:57.498 16:43:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.498 16:43:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.498 16:43:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.498 16:43:43 -- paths/export.sh@5 -- # export PATH 00:07:57.498 16:43:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.498 16:43:43 -- nvmf/common.sh@46 -- # : 0 00:07:57.498 16:43:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:57.498 16:43:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:57.498 16:43:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:57.498 16:43:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:57.498 16:43:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:57.498 16:43:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:57.498 16:43:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:57.498 16:43:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:57.498 16:43:43 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:57.498 16:43:43 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:57.498 16:43:43 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:57.498 16:43:43 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:57.498 16:43:43 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:57.498 16:43:43 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:57.498 16:43:43 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:57.498 16:43:43 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:57.498 16:43:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:57.498 16:43:43 -- common/autotest_common.sh@10 -- # set +x 00:07:57.498 16:43:43 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:57.498 16:43:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:57.498 16:43:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:57.498 16:43:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:57.498 16:43:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:57.498 16:43:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:57.498 16:43:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:57.498 16:43:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:57.498 16:43:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:57.498 16:43:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:57.498 16:43:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:57.498 16:43:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:57.498 16:43:43 -- common/autotest_common.sh@10 -- # set +x 00:07:59.399 16:43:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:59.399 16:43:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:59.399 16:43:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:59.399 16:43:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:59.400 16:43:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:59.400 16:43:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:59.400 16:43:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:59.400 16:43:45 -- nvmf/common.sh@294 -- # net_devs=() 00:07:59.400 16:43:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:59.400 16:43:45 -- nvmf/common.sh@295 -- # e810=() 00:07:59.400 16:43:45 -- nvmf/common.sh@295 -- # local -ga e810 00:07:59.400 16:43:45 -- nvmf/common.sh@296 -- # x722=() 00:07:59.400 16:43:45 -- nvmf/common.sh@296 -- # local -ga x722 00:07:59.400 16:43:45 -- nvmf/common.sh@297 -- # mlx=() 00:07:59.400 16:43:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:59.400 16:43:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:59.400 16:43:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:59.400 16:43:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:59.400 16:43:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:59.400 16:43:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:59.400 16:43:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:59.400 16:43:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:59.400 16:43:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:59.400 16:43:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:59.400 16:43:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:59.400 16:43:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:59.400 16:43:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:59.400 16:43:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:59.400 16:43:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:59.400 16:43:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:59.400 16:43:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:59.400 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:59.400 16:43:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:59.400 16:43:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:59.400 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:59.400 16:43:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:59.400 16:43:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:59.400 16:43:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:59.400 16:43:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:59.400 16:43:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:59.400 16:43:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:59.400 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:59.400 16:43:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:59.400 16:43:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:59.400 16:43:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:59.400 16:43:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:59.400 16:43:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:59.400 16:43:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:59.400 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:59.400 16:43:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:59.400 16:43:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:59.400 16:43:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:59.400 16:43:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:59.400 16:43:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:59.400 16:43:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:59.400 16:43:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:59.400 16:43:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:59.400 16:43:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:59.400 16:43:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:59.400 16:43:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:59.400 16:43:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:59.400 16:43:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:59.400 16:43:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:59.400 16:43:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:59.400 16:43:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:59.400 16:43:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:59.400 16:43:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:59.400 16:43:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:59.400 16:43:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:59.400 16:43:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:59.400 16:43:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:59.400 16:43:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:59.400 16:43:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:59.658 16:43:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:59.658 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:59.658 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:07:59.658 00:07:59.658 --- 10.0.0.2 ping statistics --- 00:07:59.658 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:59.658 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:07:59.658 16:43:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:59.658 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:59.658 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.180 ms 00:07:59.658 00:07:59.658 --- 10.0.0.1 ping statistics --- 00:07:59.658 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:59.658 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:07:59.658 16:43:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:59.658 16:43:45 -- nvmf/common.sh@410 -- # return 0 00:07:59.658 16:43:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:59.658 16:43:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:59.658 16:43:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:59.658 16:43:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:59.658 16:43:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:59.658 16:43:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:59.658 16:43:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:59.658 16:43:45 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:59.658 16:43:45 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:59.658 16:43:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:59.658 16:43:45 -- common/autotest_common.sh@10 -- # set +x 00:07:59.658 16:43:45 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:59.658 16:43:45 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:59.658 16:43:45 -- target/nvmf_example.sh@34 -- # nvmfpid=1094516 00:07:59.658 16:43:45 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:59.658 16:43:45 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:59.658 16:43:45 -- target/nvmf_example.sh@36 -- # waitforlisten 1094516 00:07:59.658 16:43:45 -- common/autotest_common.sh@829 -- # '[' -z 1094516 ']' 00:07:59.658 16:43:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:59.658 16:43:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:59.658 16:43:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:59.658 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:59.658 16:43:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:59.658 16:43:45 -- common/autotest_common.sh@10 -- # set +x 00:07:59.658 EAL: No free 2048 kB hugepages reported on node 1 00:08:00.593 16:43:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:00.593 16:43:46 -- common/autotest_common.sh@862 -- # return 0 00:08:00.593 16:43:46 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:08:00.593 16:43:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:00.593 16:43:46 -- common/autotest_common.sh@10 -- # set +x 00:08:00.593 16:43:46 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:00.593 16:43:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.593 16:43:46 -- common/autotest_common.sh@10 -- # set +x 00:08:00.593 16:43:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.593 16:43:46 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:08:00.593 16:43:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.593 16:43:46 -- common/autotest_common.sh@10 -- # set +x 00:08:00.593 16:43:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.593 16:43:46 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:08:00.593 16:43:46 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:00.593 16:43:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.593 16:43:46 -- common/autotest_common.sh@10 -- # set +x 00:08:00.593 16:43:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.593 16:43:46 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:08:00.593 16:43:46 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:00.593 16:43:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.593 16:43:46 -- common/autotest_common.sh@10 -- # set +x 00:08:00.593 16:43:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.593 16:43:46 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:00.593 16:43:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.593 16:43:46 -- common/autotest_common.sh@10 -- # set +x 00:08:00.593 16:43:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.593 16:43:46 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:08:00.593 16:43:46 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:08:00.593 EAL: No free 2048 kB hugepages reported on node 1 00:08:12.790 Initializing NVMe Controllers 00:08:12.790 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:12.790 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:12.790 Initialization complete. Launching workers. 00:08:12.790 ======================================================== 00:08:12.790 Latency(us) 00:08:12.790 Device Information : IOPS MiB/s Average min max 00:08:12.790 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15091.90 58.95 4241.66 855.72 17782.32 00:08:12.790 ======================================================== 00:08:12.790 Total : 15091.90 58.95 4241.66 855.72 17782.32 00:08:12.790 00:08:12.790 16:43:56 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:12.790 16:43:56 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:12.790 16:43:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:12.790 16:43:56 -- nvmf/common.sh@116 -- # sync 00:08:12.790 16:43:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:12.790 16:43:56 -- nvmf/common.sh@119 -- # set +e 00:08:12.790 16:43:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:12.790 16:43:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:12.790 rmmod nvme_tcp 00:08:12.790 rmmod nvme_fabrics 00:08:12.790 rmmod nvme_keyring 00:08:12.790 16:43:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:12.790 16:43:56 -- nvmf/common.sh@123 -- # set -e 00:08:12.790 16:43:56 -- nvmf/common.sh@124 -- # return 0 00:08:12.790 16:43:56 -- nvmf/common.sh@477 -- # '[' -n 1094516 ']' 00:08:12.790 16:43:56 -- nvmf/common.sh@478 -- # killprocess 1094516 00:08:12.790 16:43:56 -- common/autotest_common.sh@936 -- # '[' -z 1094516 ']' 00:08:12.790 16:43:56 -- common/autotest_common.sh@940 -- # kill -0 1094516 00:08:12.790 16:43:56 -- common/autotest_common.sh@941 -- # uname 00:08:12.790 16:43:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:12.790 16:43:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1094516 00:08:12.790 16:43:56 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:08:12.790 16:43:56 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:08:12.790 16:43:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1094516' 00:08:12.790 killing process with pid 1094516 00:08:12.790 16:43:56 -- common/autotest_common.sh@955 -- # kill 1094516 00:08:12.790 16:43:56 -- common/autotest_common.sh@960 -- # wait 1094516 00:08:12.790 nvmf threads initialize successfully 00:08:12.790 bdev subsystem init successfully 00:08:12.790 created a nvmf target service 00:08:12.790 create targets's poll groups done 00:08:12.790 all subsystems of target started 00:08:12.790 nvmf target is running 00:08:12.790 all subsystems of target stopped 00:08:12.790 destroy targets's poll groups done 00:08:12.790 destroyed the nvmf target service 00:08:12.790 bdev subsystem finish successfully 00:08:12.790 nvmf threads destroy successfully 00:08:12.790 16:43:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:12.790 16:43:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:12.790 16:43:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:12.790 16:43:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:12.790 16:43:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:12.790 16:43:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:12.790 16:43:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:12.790 16:43:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:13.049 16:43:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:13.049 16:43:58 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:13.049 16:43:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:13.049 16:43:58 -- common/autotest_common.sh@10 -- # set +x 00:08:13.049 00:08:13.049 real 0m15.847s 00:08:13.049 user 0m44.135s 00:08:13.049 sys 0m3.559s 00:08:13.049 16:43:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:13.049 16:43:58 -- common/autotest_common.sh@10 -- # set +x 00:08:13.049 ************************************ 00:08:13.049 END TEST nvmf_example 00:08:13.049 ************************************ 00:08:13.309 16:43:58 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:13.309 16:43:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:13.309 16:43:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:13.309 16:43:58 -- common/autotest_common.sh@10 -- # set +x 00:08:13.309 ************************************ 00:08:13.309 START TEST nvmf_filesystem 00:08:13.309 ************************************ 00:08:13.309 16:43:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:13.309 * Looking for test storage... 00:08:13.309 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:13.309 16:43:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:13.309 16:43:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:13.309 16:43:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:13.309 16:43:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:13.309 16:43:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:13.309 16:43:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:13.309 16:43:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:13.309 16:43:58 -- scripts/common.sh@335 -- # IFS=.-: 00:08:13.309 16:43:58 -- scripts/common.sh@335 -- # read -ra ver1 00:08:13.309 16:43:58 -- scripts/common.sh@336 -- # IFS=.-: 00:08:13.309 16:43:58 -- scripts/common.sh@336 -- # read -ra ver2 00:08:13.309 16:43:58 -- scripts/common.sh@337 -- # local 'op=<' 00:08:13.309 16:43:58 -- scripts/common.sh@339 -- # ver1_l=2 00:08:13.309 16:43:58 -- scripts/common.sh@340 -- # ver2_l=1 00:08:13.309 16:43:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:13.309 16:43:58 -- scripts/common.sh@343 -- # case "$op" in 00:08:13.309 16:43:58 -- scripts/common.sh@344 -- # : 1 00:08:13.309 16:43:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:13.309 16:43:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:13.309 16:43:58 -- scripts/common.sh@364 -- # decimal 1 00:08:13.309 16:43:58 -- scripts/common.sh@352 -- # local d=1 00:08:13.309 16:43:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:13.309 16:43:58 -- scripts/common.sh@354 -- # echo 1 00:08:13.309 16:43:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:13.309 16:43:58 -- scripts/common.sh@365 -- # decimal 2 00:08:13.309 16:43:58 -- scripts/common.sh@352 -- # local d=2 00:08:13.309 16:43:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:13.309 16:43:58 -- scripts/common.sh@354 -- # echo 2 00:08:13.309 16:43:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:13.309 16:43:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:13.309 16:43:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:13.309 16:43:58 -- scripts/common.sh@367 -- # return 0 00:08:13.309 16:43:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:13.309 16:43:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:13.309 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.310 --rc genhtml_branch_coverage=1 00:08:13.310 --rc genhtml_function_coverage=1 00:08:13.310 --rc genhtml_legend=1 00:08:13.310 --rc geninfo_all_blocks=1 00:08:13.310 --rc geninfo_unexecuted_blocks=1 00:08:13.310 00:08:13.310 ' 00:08:13.310 16:43:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:13.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.310 --rc genhtml_branch_coverage=1 00:08:13.310 --rc genhtml_function_coverage=1 00:08:13.310 --rc genhtml_legend=1 00:08:13.310 --rc geninfo_all_blocks=1 00:08:13.310 --rc geninfo_unexecuted_blocks=1 00:08:13.310 00:08:13.310 ' 00:08:13.310 16:43:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:13.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.310 --rc genhtml_branch_coverage=1 00:08:13.310 --rc genhtml_function_coverage=1 00:08:13.310 --rc genhtml_legend=1 00:08:13.310 --rc geninfo_all_blocks=1 00:08:13.310 --rc geninfo_unexecuted_blocks=1 00:08:13.310 00:08:13.310 ' 00:08:13.310 16:43:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:13.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.310 --rc genhtml_branch_coverage=1 00:08:13.310 --rc genhtml_function_coverage=1 00:08:13.310 --rc genhtml_legend=1 00:08:13.310 --rc geninfo_all_blocks=1 00:08:13.310 --rc geninfo_unexecuted_blocks=1 00:08:13.310 00:08:13.310 ' 00:08:13.310 16:43:58 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:08:13.310 16:43:58 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:13.310 16:43:58 -- common/autotest_common.sh@34 -- # set -e 00:08:13.310 16:43:58 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:13.310 16:43:58 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:13.310 16:43:58 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:13.310 16:43:58 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:08:13.310 16:43:58 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:13.310 16:43:58 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:13.310 16:43:58 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:13.310 16:43:58 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:13.310 16:43:58 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:13.310 16:43:58 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:13.310 16:43:58 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:13.310 16:43:58 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:13.310 16:43:58 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:13.310 16:43:58 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:13.310 16:43:58 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:13.310 16:43:58 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:13.310 16:43:58 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:13.310 16:43:58 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:13.310 16:43:58 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:13.310 16:43:58 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:13.310 16:43:58 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:13.310 16:43:58 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:13.310 16:43:58 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:13.310 16:43:58 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:13.310 16:43:58 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:13.310 16:43:58 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:13.310 16:43:58 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:13.310 16:43:58 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:13.310 16:43:58 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:13.310 16:43:58 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:13.310 16:43:58 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:13.310 16:43:58 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:13.310 16:43:58 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:13.310 16:43:58 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:13.310 16:43:58 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:13.310 16:43:58 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:13.310 16:43:58 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:13.310 16:43:58 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:13.310 16:43:58 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:13.310 16:43:58 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:13.310 16:43:58 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:13.310 16:43:58 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:13.310 16:43:58 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:13.310 16:43:58 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:13.310 16:43:58 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:13.310 16:43:58 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:13.310 16:43:58 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:13.310 16:43:58 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:13.310 16:43:58 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:13.310 16:43:58 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:13.310 16:43:58 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:13.310 16:43:58 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:13.310 16:43:58 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:13.310 16:43:58 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:13.310 16:43:58 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:08:13.310 16:43:58 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:13.310 16:43:58 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:08:13.310 16:43:58 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:08:13.310 16:43:58 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:08:13.310 16:43:58 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:08:13.310 16:43:58 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:08:13.310 16:43:58 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:08:13.310 16:43:58 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:08:13.310 16:43:58 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:08:13.310 16:43:58 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:13.310 16:43:58 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:08:13.310 16:43:58 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:08:13.310 16:43:58 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:08:13.310 16:43:58 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:08:13.310 16:43:58 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:13.310 16:43:58 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:08:13.310 16:43:58 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:08:13.310 16:43:58 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:08:13.310 16:43:58 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:08:13.310 16:43:58 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:08:13.310 16:43:58 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:08:13.310 16:43:58 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:08:13.310 16:43:58 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:08:13.310 16:43:58 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:08:13.310 16:43:58 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:08:13.310 16:43:58 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:13.310 16:43:58 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:08:13.310 16:43:58 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:08:13.310 16:43:58 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:13.310 16:43:58 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:13.310 16:43:58 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:13.310 16:43:58 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:13.310 16:43:58 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:13.310 16:43:58 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:13.310 16:43:59 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:13.310 16:43:59 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:13.311 16:43:59 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:13.311 16:43:59 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:13.311 16:43:59 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:13.311 16:43:59 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:13.311 16:43:59 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:13.311 16:43:59 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:13.311 16:43:59 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:08:13.311 16:43:59 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:13.311 #define SPDK_CONFIG_H 00:08:13.311 #define SPDK_CONFIG_APPS 1 00:08:13.311 #define SPDK_CONFIG_ARCH native 00:08:13.311 #undef SPDK_CONFIG_ASAN 00:08:13.311 #undef SPDK_CONFIG_AVAHI 00:08:13.311 #undef SPDK_CONFIG_CET 00:08:13.311 #define SPDK_CONFIG_COVERAGE 1 00:08:13.311 #define SPDK_CONFIG_CROSS_PREFIX 00:08:13.311 #undef SPDK_CONFIG_CRYPTO 00:08:13.311 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:13.311 #undef SPDK_CONFIG_CUSTOMOCF 00:08:13.311 #undef SPDK_CONFIG_DAOS 00:08:13.311 #define SPDK_CONFIG_DAOS_DIR 00:08:13.311 #define SPDK_CONFIG_DEBUG 1 00:08:13.311 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:13.311 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:13.311 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:13.311 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:13.311 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:13.311 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:13.311 #define SPDK_CONFIG_EXAMPLES 1 00:08:13.311 #undef SPDK_CONFIG_FC 00:08:13.311 #define SPDK_CONFIG_FC_PATH 00:08:13.311 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:13.311 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:13.311 #undef SPDK_CONFIG_FUSE 00:08:13.311 #undef SPDK_CONFIG_FUZZER 00:08:13.311 #define SPDK_CONFIG_FUZZER_LIB 00:08:13.311 #undef SPDK_CONFIG_GOLANG 00:08:13.311 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:13.311 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:13.311 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:13.311 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:13.311 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:13.311 #define SPDK_CONFIG_IDXD 1 00:08:13.311 #define SPDK_CONFIG_IDXD_KERNEL 1 00:08:13.311 #undef SPDK_CONFIG_IPSEC_MB 00:08:13.311 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:13.311 #define SPDK_CONFIG_ISAL 1 00:08:13.311 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:13.311 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:13.311 #define SPDK_CONFIG_LIBDIR 00:08:13.311 #undef SPDK_CONFIG_LTO 00:08:13.311 #define SPDK_CONFIG_MAX_LCORES 00:08:13.311 #define SPDK_CONFIG_NVME_CUSE 1 00:08:13.311 #undef SPDK_CONFIG_OCF 00:08:13.311 #define SPDK_CONFIG_OCF_PATH 00:08:13.311 #define SPDK_CONFIG_OPENSSL_PATH 00:08:13.311 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:13.311 #undef SPDK_CONFIG_PGO_USE 00:08:13.311 #define SPDK_CONFIG_PREFIX /usr/local 00:08:13.311 #undef SPDK_CONFIG_RAID5F 00:08:13.311 #undef SPDK_CONFIG_RBD 00:08:13.311 #define SPDK_CONFIG_RDMA 1 00:08:13.311 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:13.311 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:13.311 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:13.311 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:13.311 #define SPDK_CONFIG_SHARED 1 00:08:13.311 #undef SPDK_CONFIG_SMA 00:08:13.311 #define SPDK_CONFIG_TESTS 1 00:08:13.311 #undef SPDK_CONFIG_TSAN 00:08:13.311 #define SPDK_CONFIG_UBLK 1 00:08:13.311 #define SPDK_CONFIG_UBSAN 1 00:08:13.311 #undef SPDK_CONFIG_UNIT_TESTS 00:08:13.311 #undef SPDK_CONFIG_URING 00:08:13.311 #define SPDK_CONFIG_URING_PATH 00:08:13.311 #undef SPDK_CONFIG_URING_ZNS 00:08:13.311 #undef SPDK_CONFIG_USDT 00:08:13.311 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:13.311 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:13.311 #define SPDK_CONFIG_VFIO_USER 1 00:08:13.311 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:13.311 #define SPDK_CONFIG_VHOST 1 00:08:13.311 #define SPDK_CONFIG_VIRTIO 1 00:08:13.311 #undef SPDK_CONFIG_VTUNE 00:08:13.311 #define SPDK_CONFIG_VTUNE_DIR 00:08:13.311 #define SPDK_CONFIG_WERROR 1 00:08:13.311 #define SPDK_CONFIG_WPDK_DIR 00:08:13.311 #undef SPDK_CONFIG_XNVME 00:08:13.311 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:13.311 16:43:59 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:13.311 16:43:59 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:13.311 16:43:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:13.311 16:43:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:13.311 16:43:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:13.311 16:43:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.311 16:43:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.311 16:43:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.311 16:43:59 -- paths/export.sh@5 -- # export PATH 00:08:13.311 16:43:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.311 16:43:59 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:13.311 16:43:59 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:13.311 16:43:59 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:13.311 16:43:59 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:13.311 16:43:59 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:13.311 16:43:59 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:13.311 16:43:59 -- pm/common@16 -- # TEST_TAG=N/A 00:08:13.311 16:43:59 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:08:13.311 16:43:59 -- common/autotest_common.sh@52 -- # : 1 00:08:13.311 16:43:59 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:08:13.311 16:43:59 -- common/autotest_common.sh@56 -- # : 0 00:08:13.311 16:43:59 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:13.311 16:43:59 -- common/autotest_common.sh@58 -- # : 0 00:08:13.311 16:43:59 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:08:13.311 16:43:59 -- common/autotest_common.sh@60 -- # : 1 00:08:13.311 16:43:59 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:13.311 16:43:59 -- common/autotest_common.sh@62 -- # : 0 00:08:13.311 16:43:59 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:08:13.311 16:43:59 -- common/autotest_common.sh@64 -- # : 00:08:13.311 16:43:59 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:08:13.311 16:43:59 -- common/autotest_common.sh@66 -- # : 0 00:08:13.311 16:43:59 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:08:13.311 16:43:59 -- common/autotest_common.sh@68 -- # : 0 00:08:13.311 16:43:59 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:08:13.311 16:43:59 -- common/autotest_common.sh@70 -- # : 0 00:08:13.311 16:43:59 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:08:13.312 16:43:59 -- common/autotest_common.sh@72 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:13.312 16:43:59 -- common/autotest_common.sh@74 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:08:13.312 16:43:59 -- common/autotest_common.sh@76 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:08:13.312 16:43:59 -- common/autotest_common.sh@78 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:08:13.312 16:43:59 -- common/autotest_common.sh@80 -- # : 1 00:08:13.312 16:43:59 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:08:13.312 16:43:59 -- common/autotest_common.sh@82 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:08:13.312 16:43:59 -- common/autotest_common.sh@84 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:08:13.312 16:43:59 -- common/autotest_common.sh@86 -- # : 1 00:08:13.312 16:43:59 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:08:13.312 16:43:59 -- common/autotest_common.sh@88 -- # : 1 00:08:13.312 16:43:59 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:08:13.312 16:43:59 -- common/autotest_common.sh@90 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:13.312 16:43:59 -- common/autotest_common.sh@92 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:08:13.312 16:43:59 -- common/autotest_common.sh@94 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:08:13.312 16:43:59 -- common/autotest_common.sh@96 -- # : tcp 00:08:13.312 16:43:59 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:13.312 16:43:59 -- common/autotest_common.sh@98 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:08:13.312 16:43:59 -- common/autotest_common.sh@100 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:08:13.312 16:43:59 -- common/autotest_common.sh@102 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:08:13.312 16:43:59 -- common/autotest_common.sh@104 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:08:13.312 16:43:59 -- common/autotest_common.sh@106 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:08:13.312 16:43:59 -- common/autotest_common.sh@108 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:08:13.312 16:43:59 -- common/autotest_common.sh@110 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:08:13.312 16:43:59 -- common/autotest_common.sh@112 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:13.312 16:43:59 -- common/autotest_common.sh@114 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:08:13.312 16:43:59 -- common/autotest_common.sh@116 -- # : 1 00:08:13.312 16:43:59 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:08:13.312 16:43:59 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:13.312 16:43:59 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:13.312 16:43:59 -- common/autotest_common.sh@120 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:08:13.312 16:43:59 -- common/autotest_common.sh@122 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:08:13.312 16:43:59 -- common/autotest_common.sh@124 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:08:13.312 16:43:59 -- common/autotest_common.sh@126 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:08:13.312 16:43:59 -- common/autotest_common.sh@128 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:08:13.312 16:43:59 -- common/autotest_common.sh@130 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:08:13.312 16:43:59 -- common/autotest_common.sh@132 -- # : v22.11.4 00:08:13.312 16:43:59 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:08:13.312 16:43:59 -- common/autotest_common.sh@134 -- # : true 00:08:13.312 16:43:59 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:08:13.312 16:43:59 -- common/autotest_common.sh@136 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:08:13.312 16:43:59 -- common/autotest_common.sh@138 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:08:13.312 16:43:59 -- common/autotest_common.sh@140 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:08:13.312 16:43:59 -- common/autotest_common.sh@142 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:08:13.312 16:43:59 -- common/autotest_common.sh@144 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:08:13.312 16:43:59 -- common/autotest_common.sh@146 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:08:13.312 16:43:59 -- common/autotest_common.sh@148 -- # : e810 00:08:13.312 16:43:59 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:08:13.312 16:43:59 -- common/autotest_common.sh@150 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:08:13.312 16:43:59 -- common/autotest_common.sh@152 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:08:13.312 16:43:59 -- common/autotest_common.sh@154 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:08:13.312 16:43:59 -- common/autotest_common.sh@156 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:08:13.312 16:43:59 -- common/autotest_common.sh@158 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:08:13.312 16:43:59 -- common/autotest_common.sh@160 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:08:13.312 16:43:59 -- common/autotest_common.sh@163 -- # : 00:08:13.312 16:43:59 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:08:13.312 16:43:59 -- common/autotest_common.sh@165 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:08:13.312 16:43:59 -- common/autotest_common.sh@167 -- # : 0 00:08:13.312 16:43:59 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:13.312 16:43:59 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:13.312 16:43:59 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:13.312 16:43:59 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:13.312 16:43:59 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:13.312 16:43:59 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:13.312 16:43:59 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:13.312 16:43:59 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:13.312 16:43:59 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:13.312 16:43:59 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:13.312 16:43:59 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:13.313 16:43:59 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:13.313 16:43:59 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:13.313 16:43:59 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:13.313 16:43:59 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:08:13.313 16:43:59 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:13.313 16:43:59 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:13.313 16:43:59 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:13.313 16:43:59 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:13.313 16:43:59 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:13.313 16:43:59 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:08:13.313 16:43:59 -- common/autotest_common.sh@196 -- # cat 00:08:13.313 16:43:59 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:08:13.313 16:43:59 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:13.313 16:43:59 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:13.313 16:43:59 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:13.313 16:43:59 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:13.313 16:43:59 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:08:13.313 16:43:59 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:08:13.313 16:43:59 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:13.313 16:43:59 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:13.313 16:43:59 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:13.313 16:43:59 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:13.313 16:43:59 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:13.313 16:43:59 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:13.313 16:43:59 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:13.313 16:43:59 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:13.313 16:43:59 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:13.313 16:43:59 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:13.313 16:43:59 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:13.313 16:43:59 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:13.313 16:43:59 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:08:13.313 16:43:59 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:08:13.313 16:43:59 -- common/autotest_common.sh@249 -- # _LCOV= 00:08:13.313 16:43:59 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:08:13.313 16:43:59 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:08:13.313 16:43:59 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:08:13.313 16:43:59 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:08:13.313 16:43:59 -- common/autotest_common.sh@255 -- # lcov_opt= 00:08:13.313 16:43:59 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:08:13.313 16:43:59 -- common/autotest_common.sh@259 -- # export valgrind= 00:08:13.313 16:43:59 -- common/autotest_common.sh@259 -- # valgrind= 00:08:13.313 16:43:59 -- common/autotest_common.sh@265 -- # uname -s 00:08:13.313 16:43:59 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:08:13.313 16:43:59 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:08:13.313 16:43:59 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:08:13.313 16:43:59 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:08:13.313 16:43:59 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:13.313 16:43:59 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:13.313 16:43:59 -- common/autotest_common.sh@275 -- # MAKE=make 00:08:13.313 16:43:59 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:08:13.313 16:43:59 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:08:13.313 16:43:59 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:08:13.313 16:43:59 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:08:13.313 16:43:59 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:08:13.313 16:43:59 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:08:13.313 16:43:59 -- common/autotest_common.sh@301 -- # for i in "$@" 00:08:13.313 16:43:59 -- common/autotest_common.sh@302 -- # case "$i" in 00:08:13.313 16:43:59 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:08:13.313 16:43:59 -- common/autotest_common.sh@319 -- # [[ -z 1096270 ]] 00:08:13.313 16:43:59 -- common/autotest_common.sh@319 -- # kill -0 1096270 00:08:13.313 16:43:59 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:08:13.313 16:43:59 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:08:13.313 16:43:59 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:08:13.313 16:43:59 -- common/autotest_common.sh@332 -- # local mount target_dir 00:08:13.313 16:43:59 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:08:13.313 16:43:59 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:08:13.313 16:43:59 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:08:13.313 16:43:59 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:08:13.313 16:43:59 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.PapYz6 00:08:13.313 16:43:59 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:13.313 16:43:59 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:08:13.313 16:43:59 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:08:13.313 16:43:59 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.PapYz6/tests/target /tmp/spdk.PapYz6 00:08:13.313 16:43:59 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:08:13.313 16:43:59 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.313 16:43:59 -- common/autotest_common.sh@328 -- # df -T 00:08:13.313 16:43:59 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:08:13.573 16:43:59 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:08:13.573 16:43:59 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:08:13.573 16:43:59 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:08:13.573 16:43:59 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:08:13.573 16:43:59 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:08:13.573 16:43:59 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.573 16:43:59 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:08:13.573 16:43:59 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:08:13.573 16:43:59 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:08:13.573 16:43:59 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:08:13.573 16:43:59 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:08:13.573 16:43:59 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.573 16:43:59 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:08:13.573 16:43:59 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:08:13.573 16:43:59 -- common/autotest_common.sh@363 -- # avails["$mount"]=54000390144 00:08:13.573 16:43:59 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988532224 00:08:13.573 16:43:59 -- common/autotest_common.sh@364 -- # uses["$mount"]=7988142080 00:08:13.573 16:43:59 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.573 16:43:59 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:13.573 16:43:59 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:13.573 16:43:59 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993006592 00:08:13.573 16:43:59 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:08:13.573 16:43:59 -- common/autotest_common.sh@364 -- # uses["$mount"]=1257472 00:08:13.573 16:43:59 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.573 16:43:59 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:13.573 16:43:59 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:13.573 16:43:59 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388921344 00:08:13.573 16:43:59 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:08:13.573 16:43:59 -- common/autotest_common.sh@364 -- # uses["$mount"]=8785920 00:08:13.573 16:43:59 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.573 16:43:59 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:13.573 16:43:59 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:13.573 16:43:59 -- common/autotest_common.sh@363 -- # avails["$mount"]=30994042880 00:08:13.573 16:43:59 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994268160 00:08:13.573 16:43:59 -- common/autotest_common.sh@364 -- # uses["$mount"]=225280 00:08:13.573 16:43:59 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.573 16:43:59 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:13.573 16:43:59 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:13.573 16:43:59 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:08:13.573 16:43:59 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:08:13.573 16:43:59 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:08:13.573 16:43:59 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.573 16:43:59 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:08:13.573 * Looking for test storage... 00:08:13.573 16:43:59 -- common/autotest_common.sh@369 -- # local target_space new_size 00:08:13.573 16:43:59 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:08:13.573 16:43:59 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:13.573 16:43:59 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:13.573 16:43:59 -- common/autotest_common.sh@373 -- # mount=/ 00:08:13.573 16:43:59 -- common/autotest_common.sh@375 -- # target_space=54000390144 00:08:13.573 16:43:59 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:08:13.573 16:43:59 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:08:13.573 16:43:59 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:08:13.573 16:43:59 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:08:13.573 16:43:59 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:08:13.573 16:43:59 -- common/autotest_common.sh@382 -- # new_size=10202734592 00:08:13.573 16:43:59 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:13.573 16:43:59 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:13.573 16:43:59 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:13.573 16:43:59 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:13.573 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:13.574 16:43:59 -- common/autotest_common.sh@390 -- # return 0 00:08:13.574 16:43:59 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:08:13.574 16:43:59 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:08:13.574 16:43:59 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:13.574 16:43:59 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:13.574 16:43:59 -- common/autotest_common.sh@1682 -- # true 00:08:13.574 16:43:59 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:08:13.574 16:43:59 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:13.574 16:43:59 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:13.574 16:43:59 -- common/autotest_common.sh@27 -- # exec 00:08:13.574 16:43:59 -- common/autotest_common.sh@29 -- # exec 00:08:13.574 16:43:59 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:13.574 16:43:59 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:13.574 16:43:59 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:13.574 16:43:59 -- common/autotest_common.sh@18 -- # set -x 00:08:13.574 16:43:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:13.574 16:43:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:13.574 16:43:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:13.574 16:43:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:13.574 16:43:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:13.574 16:43:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:13.574 16:43:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:13.574 16:43:59 -- scripts/common.sh@335 -- # IFS=.-: 00:08:13.574 16:43:59 -- scripts/common.sh@335 -- # read -ra ver1 00:08:13.574 16:43:59 -- scripts/common.sh@336 -- # IFS=.-: 00:08:13.574 16:43:59 -- scripts/common.sh@336 -- # read -ra ver2 00:08:13.574 16:43:59 -- scripts/common.sh@337 -- # local 'op=<' 00:08:13.574 16:43:59 -- scripts/common.sh@339 -- # ver1_l=2 00:08:13.574 16:43:59 -- scripts/common.sh@340 -- # ver2_l=1 00:08:13.574 16:43:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:13.574 16:43:59 -- scripts/common.sh@343 -- # case "$op" in 00:08:13.574 16:43:59 -- scripts/common.sh@344 -- # : 1 00:08:13.574 16:43:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:13.574 16:43:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:13.574 16:43:59 -- scripts/common.sh@364 -- # decimal 1 00:08:13.574 16:43:59 -- scripts/common.sh@352 -- # local d=1 00:08:13.574 16:43:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:13.574 16:43:59 -- scripts/common.sh@354 -- # echo 1 00:08:13.574 16:43:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:13.574 16:43:59 -- scripts/common.sh@365 -- # decimal 2 00:08:13.574 16:43:59 -- scripts/common.sh@352 -- # local d=2 00:08:13.574 16:43:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:13.574 16:43:59 -- scripts/common.sh@354 -- # echo 2 00:08:13.574 16:43:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:13.574 16:43:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:13.574 16:43:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:13.574 16:43:59 -- scripts/common.sh@367 -- # return 0 00:08:13.574 16:43:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:13.574 16:43:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:13.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.574 --rc genhtml_branch_coverage=1 00:08:13.574 --rc genhtml_function_coverage=1 00:08:13.574 --rc genhtml_legend=1 00:08:13.574 --rc geninfo_all_blocks=1 00:08:13.574 --rc geninfo_unexecuted_blocks=1 00:08:13.574 00:08:13.574 ' 00:08:13.574 16:43:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:13.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.574 --rc genhtml_branch_coverage=1 00:08:13.574 --rc genhtml_function_coverage=1 00:08:13.574 --rc genhtml_legend=1 00:08:13.574 --rc geninfo_all_blocks=1 00:08:13.574 --rc geninfo_unexecuted_blocks=1 00:08:13.574 00:08:13.574 ' 00:08:13.574 16:43:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:13.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.574 --rc genhtml_branch_coverage=1 00:08:13.574 --rc genhtml_function_coverage=1 00:08:13.574 --rc genhtml_legend=1 00:08:13.574 --rc geninfo_all_blocks=1 00:08:13.574 --rc geninfo_unexecuted_blocks=1 00:08:13.574 00:08:13.574 ' 00:08:13.574 16:43:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:13.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.574 --rc genhtml_branch_coverage=1 00:08:13.574 --rc genhtml_function_coverage=1 00:08:13.574 --rc genhtml_legend=1 00:08:13.574 --rc geninfo_all_blocks=1 00:08:13.574 --rc geninfo_unexecuted_blocks=1 00:08:13.574 00:08:13.574 ' 00:08:13.574 16:43:59 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:13.574 16:43:59 -- nvmf/common.sh@7 -- # uname -s 00:08:13.574 16:43:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:13.574 16:43:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:13.574 16:43:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:13.574 16:43:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:13.574 16:43:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:13.574 16:43:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:13.574 16:43:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:13.574 16:43:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:13.574 16:43:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:13.574 16:43:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:13.574 16:43:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:13.574 16:43:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:13.574 16:43:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:13.574 16:43:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:13.574 16:43:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:13.574 16:43:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:13.574 16:43:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:13.574 16:43:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:13.574 16:43:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:13.574 16:43:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.574 16:43:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.574 16:43:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.574 16:43:59 -- paths/export.sh@5 -- # export PATH 00:08:13.574 16:43:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.574 16:43:59 -- nvmf/common.sh@46 -- # : 0 00:08:13.574 16:43:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:13.574 16:43:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:13.574 16:43:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:13.574 16:43:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:13.574 16:43:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:13.574 16:43:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:13.574 16:43:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:13.574 16:43:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:13.574 16:43:59 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:13.574 16:43:59 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:13.574 16:43:59 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:13.574 16:43:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:13.574 16:43:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:13.574 16:43:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:13.574 16:43:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:13.574 16:43:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:13.574 16:43:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:13.574 16:43:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:13.574 16:43:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:13.575 16:43:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:13.575 16:43:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:13.575 16:43:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:13.575 16:43:59 -- common/autotest_common.sh@10 -- # set +x 00:08:16.111 16:44:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:16.111 16:44:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:16.111 16:44:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:16.111 16:44:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:16.111 16:44:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:16.111 16:44:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:16.111 16:44:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:16.111 16:44:01 -- nvmf/common.sh@294 -- # net_devs=() 00:08:16.111 16:44:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:16.111 16:44:01 -- nvmf/common.sh@295 -- # e810=() 00:08:16.111 16:44:01 -- nvmf/common.sh@295 -- # local -ga e810 00:08:16.111 16:44:01 -- nvmf/common.sh@296 -- # x722=() 00:08:16.111 16:44:01 -- nvmf/common.sh@296 -- # local -ga x722 00:08:16.111 16:44:01 -- nvmf/common.sh@297 -- # mlx=() 00:08:16.111 16:44:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:16.111 16:44:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:16.111 16:44:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:16.111 16:44:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:16.111 16:44:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:16.111 16:44:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:16.111 16:44:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:16.111 16:44:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:16.111 16:44:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:16.111 16:44:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:16.111 16:44:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:16.111 16:44:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:16.111 16:44:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:16.111 16:44:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:16.111 16:44:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:16.111 16:44:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:16.111 16:44:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:16.111 16:44:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:16.111 16:44:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:16.112 16:44:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:16.112 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:16.112 16:44:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:16.112 16:44:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:16.112 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:16.112 16:44:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:16.112 16:44:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:16.112 16:44:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:16.112 16:44:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:16.112 16:44:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:16.112 16:44:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:16.112 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:16.112 16:44:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:16.112 16:44:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:16.112 16:44:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:16.112 16:44:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:16.112 16:44:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:16.112 16:44:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:16.112 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:16.112 16:44:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:16.112 16:44:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:16.112 16:44:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:16.112 16:44:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:16.112 16:44:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:16.112 16:44:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:16.112 16:44:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:16.112 16:44:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:16.112 16:44:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:16.112 16:44:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:16.112 16:44:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:16.112 16:44:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:16.112 16:44:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:16.112 16:44:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:16.112 16:44:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:16.112 16:44:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:16.112 16:44:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:16.112 16:44:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:16.112 16:44:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:16.112 16:44:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:16.112 16:44:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:16.112 16:44:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:16.112 16:44:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:16.112 16:44:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:16.112 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:16.112 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.263 ms 00:08:16.112 00:08:16.112 --- 10.0.0.2 ping statistics --- 00:08:16.112 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:16.112 rtt min/avg/max/mdev = 0.263/0.263/0.263/0.000 ms 00:08:16.112 16:44:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:16.112 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:16.112 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:08:16.112 00:08:16.112 --- 10.0.0.1 ping statistics --- 00:08:16.112 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:16.112 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:08:16.112 16:44:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:16.112 16:44:01 -- nvmf/common.sh@410 -- # return 0 00:08:16.112 16:44:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:16.112 16:44:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:16.112 16:44:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:16.112 16:44:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:16.112 16:44:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:16.112 16:44:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:16.112 16:44:01 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:16.112 16:44:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:16.112 16:44:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:16.112 16:44:01 -- common/autotest_common.sh@10 -- # set +x 00:08:16.112 ************************************ 00:08:16.112 START TEST nvmf_filesystem_no_in_capsule 00:08:16.112 ************************************ 00:08:16.112 16:44:01 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:08:16.112 16:44:01 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:16.112 16:44:01 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:16.112 16:44:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:16.112 16:44:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:16.112 16:44:01 -- common/autotest_common.sh@10 -- # set +x 00:08:16.112 16:44:01 -- nvmf/common.sh@469 -- # nvmfpid=1097926 00:08:16.112 16:44:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:16.112 16:44:01 -- nvmf/common.sh@470 -- # waitforlisten 1097926 00:08:16.112 16:44:01 -- common/autotest_common.sh@829 -- # '[' -z 1097926 ']' 00:08:16.112 16:44:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:16.112 16:44:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:16.112 16:44:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:16.112 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:16.112 16:44:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:16.112 16:44:01 -- common/autotest_common.sh@10 -- # set +x 00:08:16.112 [2024-11-16 16:44:01.509225] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:16.112 [2024-11-16 16:44:01.509323] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:16.112 EAL: No free 2048 kB hugepages reported on node 1 00:08:16.112 [2024-11-16 16:44:01.574353] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:16.112 [2024-11-16 16:44:01.665314] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:16.112 [2024-11-16 16:44:01.665470] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:16.112 [2024-11-16 16:44:01.665486] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:16.112 [2024-11-16 16:44:01.665497] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:16.112 [2024-11-16 16:44:01.665580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:16.112 [2024-11-16 16:44:01.665645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:16.112 [2024-11-16 16:44:01.665713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:16.112 [2024-11-16 16:44:01.665715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:17.047 16:44:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:17.047 16:44:02 -- common/autotest_common.sh@862 -- # return 0 00:08:17.047 16:44:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:17.047 16:44:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:17.047 16:44:02 -- common/autotest_common.sh@10 -- # set +x 00:08:17.047 16:44:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:17.047 16:44:02 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:17.047 16:44:02 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:17.047 16:44:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:17.047 16:44:02 -- common/autotest_common.sh@10 -- # set +x 00:08:17.047 [2024-11-16 16:44:02.549519] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:17.047 16:44:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:17.047 16:44:02 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:17.047 16:44:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:17.047 16:44:02 -- common/autotest_common.sh@10 -- # set +x 00:08:17.047 Malloc1 00:08:17.047 16:44:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:17.047 16:44:02 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:17.047 16:44:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:17.047 16:44:02 -- common/autotest_common.sh@10 -- # set +x 00:08:17.047 16:44:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:17.047 16:44:02 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:17.047 16:44:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:17.047 16:44:02 -- common/autotest_common.sh@10 -- # set +x 00:08:17.047 16:44:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:17.047 16:44:02 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:17.047 16:44:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:17.047 16:44:02 -- common/autotest_common.sh@10 -- # set +x 00:08:17.047 [2024-11-16 16:44:02.740096] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:17.047 16:44:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:17.047 16:44:02 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:17.047 16:44:02 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:17.047 16:44:02 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:17.047 16:44:02 -- common/autotest_common.sh@1369 -- # local bs 00:08:17.047 16:44:02 -- common/autotest_common.sh@1370 -- # local nb 00:08:17.047 16:44:02 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:17.047 16:44:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:17.047 16:44:02 -- common/autotest_common.sh@10 -- # set +x 00:08:17.047 16:44:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:17.047 16:44:02 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:17.047 { 00:08:17.047 "name": "Malloc1", 00:08:17.047 "aliases": [ 00:08:17.047 "877d17a8-c6ee-48ba-a901-6c41c9dd0329" 00:08:17.047 ], 00:08:17.047 "product_name": "Malloc disk", 00:08:17.047 "block_size": 512, 00:08:17.047 "num_blocks": 1048576, 00:08:17.047 "uuid": "877d17a8-c6ee-48ba-a901-6c41c9dd0329", 00:08:17.047 "assigned_rate_limits": { 00:08:17.047 "rw_ios_per_sec": 0, 00:08:17.047 "rw_mbytes_per_sec": 0, 00:08:17.047 "r_mbytes_per_sec": 0, 00:08:17.047 "w_mbytes_per_sec": 0 00:08:17.047 }, 00:08:17.047 "claimed": true, 00:08:17.047 "claim_type": "exclusive_write", 00:08:17.047 "zoned": false, 00:08:17.047 "supported_io_types": { 00:08:17.047 "read": true, 00:08:17.047 "write": true, 00:08:17.047 "unmap": true, 00:08:17.047 "write_zeroes": true, 00:08:17.047 "flush": true, 00:08:17.047 "reset": true, 00:08:17.047 "compare": false, 00:08:17.047 "compare_and_write": false, 00:08:17.047 "abort": true, 00:08:17.047 "nvme_admin": false, 00:08:17.047 "nvme_io": false 00:08:17.047 }, 00:08:17.047 "memory_domains": [ 00:08:17.047 { 00:08:17.047 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:17.047 "dma_device_type": 2 00:08:17.047 } 00:08:17.047 ], 00:08:17.047 "driver_specific": {} 00:08:17.047 } 00:08:17.047 ]' 00:08:17.047 16:44:02 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:17.306 16:44:02 -- common/autotest_common.sh@1372 -- # bs=512 00:08:17.306 16:44:02 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:17.306 16:44:02 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:17.306 16:44:02 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:17.306 16:44:02 -- common/autotest_common.sh@1377 -- # echo 512 00:08:17.306 16:44:02 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:17.306 16:44:02 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:17.872 16:44:03 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:17.872 16:44:03 -- common/autotest_common.sh@1187 -- # local i=0 00:08:17.872 16:44:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:17.872 16:44:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:17.872 16:44:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:20.400 16:44:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:20.400 16:44:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:20.400 16:44:05 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:20.400 16:44:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:20.400 16:44:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:20.400 16:44:05 -- common/autotest_common.sh@1197 -- # return 0 00:08:20.400 16:44:05 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:20.400 16:44:05 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:20.400 16:44:05 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:20.400 16:44:05 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:20.400 16:44:05 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:20.400 16:44:05 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:20.400 16:44:05 -- setup/common.sh@80 -- # echo 536870912 00:08:20.400 16:44:05 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:20.400 16:44:05 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:20.400 16:44:05 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:20.400 16:44:05 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:20.400 16:44:05 -- target/filesystem.sh@69 -- # partprobe 00:08:20.658 16:44:06 -- target/filesystem.sh@70 -- # sleep 1 00:08:21.592 16:44:07 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:21.592 16:44:07 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:21.592 16:44:07 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:21.592 16:44:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:21.592 16:44:07 -- common/autotest_common.sh@10 -- # set +x 00:08:21.592 ************************************ 00:08:21.592 START TEST filesystem_ext4 00:08:21.592 ************************************ 00:08:21.592 16:44:07 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:21.592 16:44:07 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:21.592 16:44:07 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:21.592 16:44:07 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:21.592 16:44:07 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:21.592 16:44:07 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:21.592 16:44:07 -- common/autotest_common.sh@914 -- # local i=0 00:08:21.592 16:44:07 -- common/autotest_common.sh@915 -- # local force 00:08:21.592 16:44:07 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:21.592 16:44:07 -- common/autotest_common.sh@918 -- # force=-F 00:08:21.592 16:44:07 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:21.592 mke2fs 1.47.0 (5-Feb-2023) 00:08:21.853 Discarding device blocks: 0/522240 done 00:08:21.853 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:21.853 Filesystem UUID: cda23193-af41-4b9a-b27d-3f2aca21ec40 00:08:21.853 Superblock backups stored on blocks: 00:08:21.853 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:21.853 00:08:21.853 Allocating group tables: 0/64 done 00:08:21.853 Writing inode tables: 0/64 done 00:08:21.853 Creating journal (8192 blocks): done 00:08:21.853 Writing superblocks and filesystem accounting information: 0/64 done 00:08:21.853 00:08:21.853 16:44:07 -- common/autotest_common.sh@931 -- # return 0 00:08:21.853 16:44:07 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:28.436 16:44:13 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:28.436 16:44:13 -- target/filesystem.sh@25 -- # sync 00:08:28.436 16:44:13 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:28.436 16:44:13 -- target/filesystem.sh@27 -- # sync 00:08:28.436 16:44:13 -- target/filesystem.sh@29 -- # i=0 00:08:28.436 16:44:13 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:28.436 16:44:13 -- target/filesystem.sh@37 -- # kill -0 1097926 00:08:28.436 16:44:13 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:28.437 16:44:13 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:28.437 16:44:13 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:28.437 16:44:13 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:28.437 00:08:28.437 real 0m5.891s 00:08:28.437 user 0m0.015s 00:08:28.437 sys 0m0.066s 00:08:28.437 16:44:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:28.437 16:44:13 -- common/autotest_common.sh@10 -- # set +x 00:08:28.437 ************************************ 00:08:28.437 END TEST filesystem_ext4 00:08:28.437 ************************************ 00:08:28.437 16:44:13 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:28.437 16:44:13 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:28.437 16:44:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:28.437 16:44:13 -- common/autotest_common.sh@10 -- # set +x 00:08:28.437 ************************************ 00:08:28.437 START TEST filesystem_btrfs 00:08:28.437 ************************************ 00:08:28.437 16:44:13 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:28.437 16:44:13 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:28.437 16:44:13 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:28.437 16:44:13 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:28.437 16:44:13 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:28.437 16:44:13 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:28.437 16:44:13 -- common/autotest_common.sh@914 -- # local i=0 00:08:28.437 16:44:13 -- common/autotest_common.sh@915 -- # local force 00:08:28.437 16:44:13 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:28.437 16:44:13 -- common/autotest_common.sh@920 -- # force=-f 00:08:28.437 16:44:13 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:28.437 btrfs-progs v6.8.1 00:08:28.437 See https://btrfs.readthedocs.io for more information. 00:08:28.437 00:08:28.437 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:28.437 NOTE: several default settings have changed in version 5.15, please make sure 00:08:28.437 this does not affect your deployments: 00:08:28.437 - DUP for metadata (-m dup) 00:08:28.437 - enabled no-holes (-O no-holes) 00:08:28.437 - enabled free-space-tree (-R free-space-tree) 00:08:28.437 00:08:28.437 Label: (null) 00:08:28.437 UUID: f75c9945-69cc-48f7-8deb-92fac92d6a9d 00:08:28.437 Node size: 16384 00:08:28.437 Sector size: 4096 (CPU page size: 4096) 00:08:28.437 Filesystem size: 510.00MiB 00:08:28.437 Block group profiles: 00:08:28.437 Data: single 8.00MiB 00:08:28.437 Metadata: DUP 32.00MiB 00:08:28.437 System: DUP 8.00MiB 00:08:28.437 SSD detected: yes 00:08:28.437 Zoned device: no 00:08:28.437 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:28.437 Checksum: crc32c 00:08:28.437 Number of devices: 1 00:08:28.437 Devices: 00:08:28.437 ID SIZE PATH 00:08:28.437 1 510.00MiB /dev/nvme0n1p1 00:08:28.437 00:08:28.437 16:44:13 -- common/autotest_common.sh@931 -- # return 0 00:08:28.437 16:44:13 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:28.437 16:44:13 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:28.437 16:44:13 -- target/filesystem.sh@25 -- # sync 00:08:28.437 16:44:13 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:28.437 16:44:13 -- target/filesystem.sh@27 -- # sync 00:08:28.437 16:44:13 -- target/filesystem.sh@29 -- # i=0 00:08:28.437 16:44:13 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:28.437 16:44:14 -- target/filesystem.sh@37 -- # kill -0 1097926 00:08:28.437 16:44:14 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:28.437 16:44:14 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:28.437 16:44:14 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:28.437 16:44:14 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:28.437 00:08:28.437 real 0m0.825s 00:08:28.437 user 0m0.017s 00:08:28.437 sys 0m0.099s 00:08:28.437 16:44:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:28.437 16:44:14 -- common/autotest_common.sh@10 -- # set +x 00:08:28.437 ************************************ 00:08:28.437 END TEST filesystem_btrfs 00:08:28.437 ************************************ 00:08:28.437 16:44:14 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:28.437 16:44:14 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:28.437 16:44:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:28.437 16:44:14 -- common/autotest_common.sh@10 -- # set +x 00:08:28.437 ************************************ 00:08:28.437 START TEST filesystem_xfs 00:08:28.437 ************************************ 00:08:28.437 16:44:14 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:28.437 16:44:14 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:28.437 16:44:14 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:28.437 16:44:14 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:28.437 16:44:14 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:28.437 16:44:14 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:28.437 16:44:14 -- common/autotest_common.sh@914 -- # local i=0 00:08:28.437 16:44:14 -- common/autotest_common.sh@915 -- # local force 00:08:28.437 16:44:14 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:28.437 16:44:14 -- common/autotest_common.sh@920 -- # force=-f 00:08:28.437 16:44:14 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:28.695 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:28.695 = sectsz=512 attr=2, projid32bit=1 00:08:28.695 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:28.695 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:28.695 data = bsize=4096 blocks=130560, imaxpct=25 00:08:28.695 = sunit=0 swidth=0 blks 00:08:28.695 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:28.695 log =internal log bsize=4096 blocks=16384, version=2 00:08:28.695 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:28.695 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:29.262 Discarding blocks...Done. 00:08:29.262 16:44:14 -- common/autotest_common.sh@931 -- # return 0 00:08:29.262 16:44:14 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:31.789 16:44:17 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:31.789 16:44:17 -- target/filesystem.sh@25 -- # sync 00:08:31.789 16:44:17 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:31.789 16:44:17 -- target/filesystem.sh@27 -- # sync 00:08:31.789 16:44:17 -- target/filesystem.sh@29 -- # i=0 00:08:31.789 16:44:17 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:31.789 16:44:17 -- target/filesystem.sh@37 -- # kill -0 1097926 00:08:31.789 16:44:17 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:31.789 16:44:17 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:31.789 16:44:17 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:31.789 16:44:17 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:31.789 00:08:31.789 real 0m3.132s 00:08:31.789 user 0m0.019s 00:08:31.789 sys 0m0.061s 00:08:31.789 16:44:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:31.789 16:44:17 -- common/autotest_common.sh@10 -- # set +x 00:08:31.789 ************************************ 00:08:31.789 END TEST filesystem_xfs 00:08:31.789 ************************************ 00:08:31.789 16:44:17 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:31.789 16:44:17 -- target/filesystem.sh@93 -- # sync 00:08:31.789 16:44:17 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:31.789 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:31.789 16:44:17 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:31.789 16:44:17 -- common/autotest_common.sh@1208 -- # local i=0 00:08:31.789 16:44:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:31.789 16:44:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:31.789 16:44:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:31.789 16:44:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:31.789 16:44:17 -- common/autotest_common.sh@1220 -- # return 0 00:08:31.789 16:44:17 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:31.789 16:44:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:31.789 16:44:17 -- common/autotest_common.sh@10 -- # set +x 00:08:31.789 16:44:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:31.789 16:44:17 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:31.789 16:44:17 -- target/filesystem.sh@101 -- # killprocess 1097926 00:08:31.789 16:44:17 -- common/autotest_common.sh@936 -- # '[' -z 1097926 ']' 00:08:32.047 16:44:17 -- common/autotest_common.sh@940 -- # kill -0 1097926 00:08:32.047 16:44:17 -- common/autotest_common.sh@941 -- # uname 00:08:32.047 16:44:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:32.047 16:44:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1097926 00:08:32.047 16:44:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:32.047 16:44:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:32.047 16:44:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1097926' 00:08:32.047 killing process with pid 1097926 00:08:32.047 16:44:17 -- common/autotest_common.sh@955 -- # kill 1097926 00:08:32.047 16:44:17 -- common/autotest_common.sh@960 -- # wait 1097926 00:08:32.307 16:44:18 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:32.307 00:08:32.307 real 0m16.544s 00:08:32.307 user 1m4.098s 00:08:32.307 sys 0m2.138s 00:08:32.307 16:44:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:32.307 16:44:18 -- common/autotest_common.sh@10 -- # set +x 00:08:32.307 ************************************ 00:08:32.307 END TEST nvmf_filesystem_no_in_capsule 00:08:32.307 ************************************ 00:08:32.307 16:44:18 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:32.307 16:44:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:32.307 16:44:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:32.307 16:44:18 -- common/autotest_common.sh@10 -- # set +x 00:08:32.307 ************************************ 00:08:32.307 START TEST nvmf_filesystem_in_capsule 00:08:32.307 ************************************ 00:08:32.307 16:44:18 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:32.307 16:44:18 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:32.307 16:44:18 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:32.307 16:44:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:32.307 16:44:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:32.307 16:44:18 -- common/autotest_common.sh@10 -- # set +x 00:08:32.307 16:44:18 -- nvmf/common.sh@469 -- # nvmfpid=1100198 00:08:32.307 16:44:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:32.307 16:44:18 -- nvmf/common.sh@470 -- # waitforlisten 1100198 00:08:32.307 16:44:18 -- common/autotest_common.sh@829 -- # '[' -z 1100198 ']' 00:08:32.307 16:44:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:32.307 16:44:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:32.307 16:44:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:32.307 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:32.307 16:44:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:32.307 16:44:18 -- common/autotest_common.sh@10 -- # set +x 00:08:32.565 [2024-11-16 16:44:18.088557] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:32.565 [2024-11-16 16:44:18.088643] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:32.565 EAL: No free 2048 kB hugepages reported on node 1 00:08:32.565 [2024-11-16 16:44:18.155190] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:32.565 [2024-11-16 16:44:18.242441] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:32.565 [2024-11-16 16:44:18.242605] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:32.565 [2024-11-16 16:44:18.242635] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:32.565 [2024-11-16 16:44:18.242650] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:32.565 [2024-11-16 16:44:18.242708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:32.565 [2024-11-16 16:44:18.242763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:32.565 [2024-11-16 16:44:18.242876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:32.565 [2024-11-16 16:44:18.242879] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:33.496 16:44:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:33.496 16:44:19 -- common/autotest_common.sh@862 -- # return 0 00:08:33.496 16:44:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:33.496 16:44:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:33.496 16:44:19 -- common/autotest_common.sh@10 -- # set +x 00:08:33.496 16:44:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:33.496 16:44:19 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:33.496 16:44:19 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:33.496 16:44:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.496 16:44:19 -- common/autotest_common.sh@10 -- # set +x 00:08:33.496 [2024-11-16 16:44:19.076332] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:33.496 16:44:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.496 16:44:19 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:33.496 16:44:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.496 16:44:19 -- common/autotest_common.sh@10 -- # set +x 00:08:33.496 Malloc1 00:08:33.496 16:44:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.496 16:44:19 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:33.496 16:44:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.496 16:44:19 -- common/autotest_common.sh@10 -- # set +x 00:08:33.753 16:44:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.753 16:44:19 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:33.753 16:44:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.753 16:44:19 -- common/autotest_common.sh@10 -- # set +x 00:08:33.753 16:44:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.753 16:44:19 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:33.753 16:44:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.753 16:44:19 -- common/autotest_common.sh@10 -- # set +x 00:08:33.753 [2024-11-16 16:44:19.263069] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:33.753 16:44:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.753 16:44:19 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:33.753 16:44:19 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:33.753 16:44:19 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:33.753 16:44:19 -- common/autotest_common.sh@1369 -- # local bs 00:08:33.753 16:44:19 -- common/autotest_common.sh@1370 -- # local nb 00:08:33.753 16:44:19 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:33.753 16:44:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.753 16:44:19 -- common/autotest_common.sh@10 -- # set +x 00:08:33.753 16:44:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.753 16:44:19 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:33.753 { 00:08:33.753 "name": "Malloc1", 00:08:33.753 "aliases": [ 00:08:33.753 "01bad8df-9763-460b-9d2e-b729d4e8d556" 00:08:33.753 ], 00:08:33.753 "product_name": "Malloc disk", 00:08:33.753 "block_size": 512, 00:08:33.753 "num_blocks": 1048576, 00:08:33.753 "uuid": "01bad8df-9763-460b-9d2e-b729d4e8d556", 00:08:33.753 "assigned_rate_limits": { 00:08:33.753 "rw_ios_per_sec": 0, 00:08:33.753 "rw_mbytes_per_sec": 0, 00:08:33.753 "r_mbytes_per_sec": 0, 00:08:33.753 "w_mbytes_per_sec": 0 00:08:33.753 }, 00:08:33.753 "claimed": true, 00:08:33.753 "claim_type": "exclusive_write", 00:08:33.753 "zoned": false, 00:08:33.753 "supported_io_types": { 00:08:33.753 "read": true, 00:08:33.753 "write": true, 00:08:33.753 "unmap": true, 00:08:33.753 "write_zeroes": true, 00:08:33.753 "flush": true, 00:08:33.753 "reset": true, 00:08:33.753 "compare": false, 00:08:33.753 "compare_and_write": false, 00:08:33.753 "abort": true, 00:08:33.753 "nvme_admin": false, 00:08:33.753 "nvme_io": false 00:08:33.753 }, 00:08:33.753 "memory_domains": [ 00:08:33.753 { 00:08:33.753 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:33.753 "dma_device_type": 2 00:08:33.753 } 00:08:33.753 ], 00:08:33.753 "driver_specific": {} 00:08:33.753 } 00:08:33.753 ]' 00:08:33.753 16:44:19 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:33.753 16:44:19 -- common/autotest_common.sh@1372 -- # bs=512 00:08:33.753 16:44:19 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:33.753 16:44:19 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:33.753 16:44:19 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:33.753 16:44:19 -- common/autotest_common.sh@1377 -- # echo 512 00:08:33.753 16:44:19 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:33.753 16:44:19 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:34.316 16:44:19 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:34.316 16:44:19 -- common/autotest_common.sh@1187 -- # local i=0 00:08:34.316 16:44:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:34.316 16:44:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:34.316 16:44:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:36.843 16:44:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:36.843 16:44:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:36.843 16:44:21 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:36.843 16:44:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:36.843 16:44:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:36.843 16:44:21 -- common/autotest_common.sh@1197 -- # return 0 00:08:36.843 16:44:21 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:36.843 16:44:21 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:36.843 16:44:22 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:36.843 16:44:22 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:36.843 16:44:22 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:36.843 16:44:22 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:36.843 16:44:22 -- setup/common.sh@80 -- # echo 536870912 00:08:36.843 16:44:22 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:36.843 16:44:22 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:36.843 16:44:22 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:36.843 16:44:22 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:36.843 16:44:22 -- target/filesystem.sh@69 -- # partprobe 00:08:37.102 16:44:22 -- target/filesystem.sh@70 -- # sleep 1 00:08:38.477 16:44:23 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:38.477 16:44:23 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:38.477 16:44:23 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:38.477 16:44:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:38.477 16:44:23 -- common/autotest_common.sh@10 -- # set +x 00:08:38.477 ************************************ 00:08:38.477 START TEST filesystem_in_capsule_ext4 00:08:38.477 ************************************ 00:08:38.477 16:44:23 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:38.477 16:44:23 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:38.477 16:44:23 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:38.477 16:44:23 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:38.477 16:44:23 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:38.477 16:44:23 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:38.477 16:44:23 -- common/autotest_common.sh@914 -- # local i=0 00:08:38.477 16:44:23 -- common/autotest_common.sh@915 -- # local force 00:08:38.477 16:44:23 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:38.477 16:44:23 -- common/autotest_common.sh@918 -- # force=-F 00:08:38.477 16:44:23 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:38.477 mke2fs 1.47.0 (5-Feb-2023) 00:08:38.477 Discarding device blocks: 0/522240 done 00:08:38.477 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:38.477 Filesystem UUID: 80f2f57f-3e80-4a47-b596-a0bda9b66b82 00:08:38.477 Superblock backups stored on blocks: 00:08:38.477 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:38.477 00:08:38.477 Allocating group tables: 0/64 done 00:08:38.477 Writing inode tables: 0/64 done 00:08:38.477 Creating journal (8192 blocks): done 00:08:39.973 Writing superblocks and filesystem accounting information: 0/64 1/64 done 00:08:39.973 00:08:39.973 16:44:25 -- common/autotest_common.sh@931 -- # return 0 00:08:39.973 16:44:25 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:45.232 16:44:30 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:45.232 16:44:30 -- target/filesystem.sh@25 -- # sync 00:08:45.232 16:44:30 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:45.232 16:44:30 -- target/filesystem.sh@27 -- # sync 00:08:45.232 16:44:30 -- target/filesystem.sh@29 -- # i=0 00:08:45.232 16:44:30 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:45.232 16:44:30 -- target/filesystem.sh@37 -- # kill -0 1100198 00:08:45.232 16:44:30 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:45.232 16:44:30 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:45.232 16:44:30 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:45.232 16:44:30 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:45.232 00:08:45.232 real 0m7.078s 00:08:45.232 user 0m0.016s 00:08:45.232 sys 0m0.070s 00:08:45.232 16:44:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:45.232 16:44:30 -- common/autotest_common.sh@10 -- # set +x 00:08:45.232 ************************************ 00:08:45.232 END TEST filesystem_in_capsule_ext4 00:08:45.232 ************************************ 00:08:45.233 16:44:30 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:45.233 16:44:30 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:45.233 16:44:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:45.233 16:44:30 -- common/autotest_common.sh@10 -- # set +x 00:08:45.233 ************************************ 00:08:45.233 START TEST filesystem_in_capsule_btrfs 00:08:45.233 ************************************ 00:08:45.233 16:44:30 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:45.233 16:44:30 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:45.233 16:44:30 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:45.233 16:44:30 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:45.233 16:44:30 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:45.233 16:44:30 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:45.233 16:44:30 -- common/autotest_common.sh@914 -- # local i=0 00:08:45.233 16:44:30 -- common/autotest_common.sh@915 -- # local force 00:08:45.233 16:44:30 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:45.233 16:44:30 -- common/autotest_common.sh@920 -- # force=-f 00:08:45.233 16:44:30 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:45.490 btrfs-progs v6.8.1 00:08:45.490 See https://btrfs.readthedocs.io for more information. 00:08:45.490 00:08:45.490 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:45.490 NOTE: several default settings have changed in version 5.15, please make sure 00:08:45.490 this does not affect your deployments: 00:08:45.490 - DUP for metadata (-m dup) 00:08:45.490 - enabled no-holes (-O no-holes) 00:08:45.490 - enabled free-space-tree (-R free-space-tree) 00:08:45.490 00:08:45.490 Label: (null) 00:08:45.490 UUID: 635b9f89-74b1-4880-af89-7bf6c8b41db5 00:08:45.490 Node size: 16384 00:08:45.490 Sector size: 4096 (CPU page size: 4096) 00:08:45.490 Filesystem size: 510.00MiB 00:08:45.490 Block group profiles: 00:08:45.491 Data: single 8.00MiB 00:08:45.491 Metadata: DUP 32.00MiB 00:08:45.491 System: DUP 8.00MiB 00:08:45.491 SSD detected: yes 00:08:45.491 Zoned device: no 00:08:45.491 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:45.491 Checksum: crc32c 00:08:45.491 Number of devices: 1 00:08:45.491 Devices: 00:08:45.491 ID SIZE PATH 00:08:45.491 1 510.00MiB /dev/nvme0n1p1 00:08:45.491 00:08:45.491 16:44:31 -- common/autotest_common.sh@931 -- # return 0 00:08:45.491 16:44:31 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:46.423 16:44:31 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:46.423 16:44:31 -- target/filesystem.sh@25 -- # sync 00:08:46.423 16:44:31 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:46.423 16:44:31 -- target/filesystem.sh@27 -- # sync 00:08:46.423 16:44:31 -- target/filesystem.sh@29 -- # i=0 00:08:46.423 16:44:31 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:46.423 16:44:32 -- target/filesystem.sh@37 -- # kill -0 1100198 00:08:46.423 16:44:32 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:46.423 16:44:32 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:46.423 16:44:32 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:46.423 16:44:32 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:46.423 00:08:46.423 real 0m1.117s 00:08:46.423 user 0m0.021s 00:08:46.423 sys 0m0.099s 00:08:46.423 16:44:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:46.423 16:44:32 -- common/autotest_common.sh@10 -- # set +x 00:08:46.423 ************************************ 00:08:46.423 END TEST filesystem_in_capsule_btrfs 00:08:46.423 ************************************ 00:08:46.423 16:44:32 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:46.423 16:44:32 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:46.423 16:44:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:46.423 16:44:32 -- common/autotest_common.sh@10 -- # set +x 00:08:46.423 ************************************ 00:08:46.423 START TEST filesystem_in_capsule_xfs 00:08:46.423 ************************************ 00:08:46.423 16:44:32 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:46.423 16:44:32 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:46.423 16:44:32 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:46.423 16:44:32 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:46.423 16:44:32 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:46.423 16:44:32 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:46.423 16:44:32 -- common/autotest_common.sh@914 -- # local i=0 00:08:46.423 16:44:32 -- common/autotest_common.sh@915 -- # local force 00:08:46.423 16:44:32 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:46.423 16:44:32 -- common/autotest_common.sh@920 -- # force=-f 00:08:46.423 16:44:32 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:46.681 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:46.681 = sectsz=512 attr=2, projid32bit=1 00:08:46.681 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:46.681 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:46.681 data = bsize=4096 blocks=130560, imaxpct=25 00:08:46.681 = sunit=0 swidth=0 blks 00:08:46.681 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:46.681 log =internal log bsize=4096 blocks=16384, version=2 00:08:46.681 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:46.681 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:47.613 Discarding blocks...Done. 00:08:47.613 16:44:33 -- common/autotest_common.sh@931 -- # return 0 00:08:47.613 16:44:33 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:49.511 16:44:34 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:49.511 16:44:34 -- target/filesystem.sh@25 -- # sync 00:08:49.511 16:44:34 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:49.511 16:44:34 -- target/filesystem.sh@27 -- # sync 00:08:49.511 16:44:34 -- target/filesystem.sh@29 -- # i=0 00:08:49.511 16:44:34 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:49.511 16:44:34 -- target/filesystem.sh@37 -- # kill -0 1100198 00:08:49.511 16:44:34 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:49.511 16:44:34 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:49.511 16:44:34 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:49.511 16:44:34 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:49.511 00:08:49.511 real 0m2.886s 00:08:49.511 user 0m0.009s 00:08:49.511 sys 0m0.065s 00:08:49.511 16:44:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:49.511 16:44:34 -- common/autotest_common.sh@10 -- # set +x 00:08:49.511 ************************************ 00:08:49.511 END TEST filesystem_in_capsule_xfs 00:08:49.511 ************************************ 00:08:49.511 16:44:34 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:49.511 16:44:35 -- target/filesystem.sh@93 -- # sync 00:08:49.511 16:44:35 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:49.769 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.769 16:44:35 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:49.769 16:44:35 -- common/autotest_common.sh@1208 -- # local i=0 00:08:49.769 16:44:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:49.769 16:44:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:49.769 16:44:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:49.769 16:44:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:49.769 16:44:35 -- common/autotest_common.sh@1220 -- # return 0 00:08:49.769 16:44:35 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:49.769 16:44:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:49.769 16:44:35 -- common/autotest_common.sh@10 -- # set +x 00:08:49.769 16:44:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:49.769 16:44:35 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:49.769 16:44:35 -- target/filesystem.sh@101 -- # killprocess 1100198 00:08:49.769 16:44:35 -- common/autotest_common.sh@936 -- # '[' -z 1100198 ']' 00:08:49.769 16:44:35 -- common/autotest_common.sh@940 -- # kill -0 1100198 00:08:49.769 16:44:35 -- common/autotest_common.sh@941 -- # uname 00:08:49.769 16:44:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:49.769 16:44:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1100198 00:08:49.769 16:44:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:49.769 16:44:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:49.769 16:44:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1100198' 00:08:49.769 killing process with pid 1100198 00:08:49.769 16:44:35 -- common/autotest_common.sh@955 -- # kill 1100198 00:08:49.769 16:44:35 -- common/autotest_common.sh@960 -- # wait 1100198 00:08:50.336 16:44:35 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:50.336 00:08:50.336 real 0m17.795s 00:08:50.336 user 1m8.949s 00:08:50.336 sys 0m2.242s 00:08:50.336 16:44:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:50.336 16:44:35 -- common/autotest_common.sh@10 -- # set +x 00:08:50.336 ************************************ 00:08:50.336 END TEST nvmf_filesystem_in_capsule 00:08:50.336 ************************************ 00:08:50.336 16:44:35 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:50.336 16:44:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:50.336 16:44:35 -- nvmf/common.sh@116 -- # sync 00:08:50.336 16:44:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:50.336 16:44:35 -- nvmf/common.sh@119 -- # set +e 00:08:50.336 16:44:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:50.336 16:44:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:50.336 rmmod nvme_tcp 00:08:50.336 rmmod nvme_fabrics 00:08:50.336 rmmod nvme_keyring 00:08:50.336 16:44:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:50.336 16:44:35 -- nvmf/common.sh@123 -- # set -e 00:08:50.336 16:44:35 -- nvmf/common.sh@124 -- # return 0 00:08:50.336 16:44:35 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:50.336 16:44:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:50.336 16:44:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:50.336 16:44:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:50.336 16:44:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:50.336 16:44:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:50.336 16:44:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:50.336 16:44:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:50.336 16:44:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:52.239 16:44:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:52.239 00:08:52.239 real 0m39.130s 00:08:52.239 user 2m14.108s 00:08:52.239 sys 0m6.122s 00:08:52.239 16:44:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:52.239 16:44:37 -- common/autotest_common.sh@10 -- # set +x 00:08:52.239 ************************************ 00:08:52.239 END TEST nvmf_filesystem 00:08:52.239 ************************************ 00:08:52.239 16:44:37 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:52.239 16:44:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:52.239 16:44:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:52.239 16:44:37 -- common/autotest_common.sh@10 -- # set +x 00:08:52.239 ************************************ 00:08:52.239 START TEST nvmf_discovery 00:08:52.239 ************************************ 00:08:52.239 16:44:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:52.498 * Looking for test storage... 00:08:52.498 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:52.498 16:44:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:52.498 16:44:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:52.498 16:44:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:52.498 16:44:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:52.498 16:44:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:52.498 16:44:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:52.498 16:44:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:52.498 16:44:38 -- scripts/common.sh@335 -- # IFS=.-: 00:08:52.498 16:44:38 -- scripts/common.sh@335 -- # read -ra ver1 00:08:52.498 16:44:38 -- scripts/common.sh@336 -- # IFS=.-: 00:08:52.498 16:44:38 -- scripts/common.sh@336 -- # read -ra ver2 00:08:52.498 16:44:38 -- scripts/common.sh@337 -- # local 'op=<' 00:08:52.498 16:44:38 -- scripts/common.sh@339 -- # ver1_l=2 00:08:52.498 16:44:38 -- scripts/common.sh@340 -- # ver2_l=1 00:08:52.498 16:44:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:52.498 16:44:38 -- scripts/common.sh@343 -- # case "$op" in 00:08:52.498 16:44:38 -- scripts/common.sh@344 -- # : 1 00:08:52.498 16:44:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:52.498 16:44:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:52.498 16:44:38 -- scripts/common.sh@364 -- # decimal 1 00:08:52.498 16:44:38 -- scripts/common.sh@352 -- # local d=1 00:08:52.498 16:44:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:52.498 16:44:38 -- scripts/common.sh@354 -- # echo 1 00:08:52.498 16:44:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:52.498 16:44:38 -- scripts/common.sh@365 -- # decimal 2 00:08:52.498 16:44:38 -- scripts/common.sh@352 -- # local d=2 00:08:52.498 16:44:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:52.498 16:44:38 -- scripts/common.sh@354 -- # echo 2 00:08:52.498 16:44:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:52.498 16:44:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:52.498 16:44:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:52.498 16:44:38 -- scripts/common.sh@367 -- # return 0 00:08:52.498 16:44:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:52.498 16:44:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:52.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:52.498 --rc genhtml_branch_coverage=1 00:08:52.498 --rc genhtml_function_coverage=1 00:08:52.498 --rc genhtml_legend=1 00:08:52.498 --rc geninfo_all_blocks=1 00:08:52.498 --rc geninfo_unexecuted_blocks=1 00:08:52.498 00:08:52.498 ' 00:08:52.498 16:44:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:52.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:52.498 --rc genhtml_branch_coverage=1 00:08:52.498 --rc genhtml_function_coverage=1 00:08:52.498 --rc genhtml_legend=1 00:08:52.498 --rc geninfo_all_blocks=1 00:08:52.498 --rc geninfo_unexecuted_blocks=1 00:08:52.498 00:08:52.498 ' 00:08:52.498 16:44:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:52.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:52.498 --rc genhtml_branch_coverage=1 00:08:52.498 --rc genhtml_function_coverage=1 00:08:52.498 --rc genhtml_legend=1 00:08:52.498 --rc geninfo_all_blocks=1 00:08:52.498 --rc geninfo_unexecuted_blocks=1 00:08:52.498 00:08:52.498 ' 00:08:52.498 16:44:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:52.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:52.498 --rc genhtml_branch_coverage=1 00:08:52.498 --rc genhtml_function_coverage=1 00:08:52.498 --rc genhtml_legend=1 00:08:52.498 --rc geninfo_all_blocks=1 00:08:52.498 --rc geninfo_unexecuted_blocks=1 00:08:52.498 00:08:52.498 ' 00:08:52.498 16:44:38 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:52.498 16:44:38 -- nvmf/common.sh@7 -- # uname -s 00:08:52.498 16:44:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:52.498 16:44:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:52.498 16:44:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:52.498 16:44:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:52.498 16:44:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:52.498 16:44:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:52.498 16:44:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:52.498 16:44:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:52.498 16:44:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:52.498 16:44:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:52.498 16:44:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:52.498 16:44:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:52.498 16:44:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:52.498 16:44:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:52.498 16:44:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:52.498 16:44:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:52.498 16:44:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:52.498 16:44:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:52.498 16:44:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:52.498 16:44:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:52.498 16:44:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:52.498 16:44:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:52.498 16:44:38 -- paths/export.sh@5 -- # export PATH 00:08:52.498 16:44:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:52.498 16:44:38 -- nvmf/common.sh@46 -- # : 0 00:08:52.498 16:44:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:52.498 16:44:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:52.498 16:44:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:52.498 16:44:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:52.498 16:44:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:52.498 16:44:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:52.498 16:44:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:52.498 16:44:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:52.498 16:44:38 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:52.498 16:44:38 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:52.498 16:44:38 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:52.498 16:44:38 -- target/discovery.sh@15 -- # hash nvme 00:08:52.498 16:44:38 -- target/discovery.sh@20 -- # nvmftestinit 00:08:52.498 16:44:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:52.498 16:44:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:52.498 16:44:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:52.498 16:44:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:52.498 16:44:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:52.498 16:44:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:52.498 16:44:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:52.498 16:44:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:52.498 16:44:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:52.498 16:44:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:52.498 16:44:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:52.498 16:44:38 -- common/autotest_common.sh@10 -- # set +x 00:08:55.032 16:44:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:55.032 16:44:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:55.032 16:44:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:55.032 16:44:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:55.032 16:44:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:55.032 16:44:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:55.032 16:44:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:55.032 16:44:40 -- nvmf/common.sh@294 -- # net_devs=() 00:08:55.032 16:44:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:55.032 16:44:40 -- nvmf/common.sh@295 -- # e810=() 00:08:55.032 16:44:40 -- nvmf/common.sh@295 -- # local -ga e810 00:08:55.032 16:44:40 -- nvmf/common.sh@296 -- # x722=() 00:08:55.032 16:44:40 -- nvmf/common.sh@296 -- # local -ga x722 00:08:55.032 16:44:40 -- nvmf/common.sh@297 -- # mlx=() 00:08:55.032 16:44:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:55.032 16:44:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:55.032 16:44:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:55.032 16:44:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:55.032 16:44:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:55.032 16:44:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:55.032 16:44:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:55.032 16:44:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:55.032 16:44:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:55.032 16:44:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:55.032 16:44:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:55.032 16:44:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:55.032 16:44:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:55.032 16:44:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:55.032 16:44:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:55.032 16:44:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:55.032 16:44:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:55.032 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:55.032 16:44:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:55.032 16:44:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:55.032 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:55.032 16:44:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:55.032 16:44:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:55.032 16:44:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:55.032 16:44:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:55.032 16:44:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:55.032 16:44:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:55.032 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:55.032 16:44:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:55.032 16:44:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:55.032 16:44:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:55.032 16:44:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:55.032 16:44:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:55.032 16:44:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:55.032 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:55.032 16:44:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:55.032 16:44:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:55.032 16:44:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:55.032 16:44:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:55.032 16:44:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:55.032 16:44:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:55.032 16:44:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:55.032 16:44:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:55.032 16:44:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:55.032 16:44:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:55.032 16:44:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:55.032 16:44:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:55.032 16:44:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:55.032 16:44:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:55.032 16:44:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:55.032 16:44:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:55.032 16:44:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:55.032 16:44:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:55.032 16:44:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:55.032 16:44:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:55.032 16:44:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:55.032 16:44:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:55.032 16:44:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:55.032 16:44:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:55.032 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:55.032 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.158 ms 00:08:55.032 00:08:55.032 --- 10.0.0.2 ping statistics --- 00:08:55.032 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:55.032 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:08:55.032 16:44:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:55.032 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:55.032 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:08:55.032 00:08:55.032 --- 10.0.0.1 ping statistics --- 00:08:55.032 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:55.032 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:08:55.032 16:44:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:55.032 16:44:40 -- nvmf/common.sh@410 -- # return 0 00:08:55.032 16:44:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:55.032 16:44:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:55.032 16:44:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:55.032 16:44:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:55.032 16:44:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:55.032 16:44:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:55.032 16:44:40 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:55.032 16:44:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:55.032 16:44:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:55.032 16:44:40 -- common/autotest_common.sh@10 -- # set +x 00:08:55.032 16:44:40 -- nvmf/common.sh@469 -- # nvmfpid=1104442 00:08:55.033 16:44:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:55.033 16:44:40 -- nvmf/common.sh@470 -- # waitforlisten 1104442 00:08:55.033 16:44:40 -- common/autotest_common.sh@829 -- # '[' -z 1104442 ']' 00:08:55.033 16:44:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:55.033 16:44:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:55.033 16:44:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:55.033 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:55.033 16:44:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:55.033 16:44:40 -- common/autotest_common.sh@10 -- # set +x 00:08:55.033 [2024-11-16 16:44:40.438209] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:55.033 [2024-11-16 16:44:40.438296] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:55.033 EAL: No free 2048 kB hugepages reported on node 1 00:08:55.033 [2024-11-16 16:44:40.506821] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:55.033 [2024-11-16 16:44:40.597468] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:55.033 [2024-11-16 16:44:40.597643] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:55.033 [2024-11-16 16:44:40.597662] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:55.033 [2024-11-16 16:44:40.597675] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:55.033 [2024-11-16 16:44:40.597745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:55.033 [2024-11-16 16:44:40.597815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:55.033 [2024-11-16 16:44:40.597881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:55.033 [2024-11-16 16:44:40.597884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:55.966 16:44:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:55.966 16:44:41 -- common/autotest_common.sh@862 -- # return 0 00:08:55.966 16:44:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:55.966 16:44:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 16:44:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:55.966 16:44:41 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 [2024-11-16 16:44:41.492535] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@26 -- # seq 1 4 00:08:55.966 16:44:41 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:55.966 16:44:41 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 Null1 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 [2024-11-16 16:44:41.532848] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:55.966 16:44:41 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 Null2 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:55.966 16:44:41 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 Null3 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:55.966 16:44:41 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 Null4 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:55.966 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.966 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:55.966 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.966 16:44:41 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:08:56.225 00:08:56.225 Discovery Log Number of Records 6, Generation counter 6 00:08:56.225 =====Discovery Log Entry 0====== 00:08:56.225 trtype: tcp 00:08:56.225 adrfam: ipv4 00:08:56.225 subtype: current discovery subsystem 00:08:56.225 treq: not required 00:08:56.225 portid: 0 00:08:56.225 trsvcid: 4420 00:08:56.225 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:56.225 traddr: 10.0.0.2 00:08:56.225 eflags: explicit discovery connections, duplicate discovery information 00:08:56.225 sectype: none 00:08:56.225 =====Discovery Log Entry 1====== 00:08:56.225 trtype: tcp 00:08:56.225 adrfam: ipv4 00:08:56.225 subtype: nvme subsystem 00:08:56.225 treq: not required 00:08:56.225 portid: 0 00:08:56.225 trsvcid: 4420 00:08:56.225 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:56.225 traddr: 10.0.0.2 00:08:56.225 eflags: none 00:08:56.225 sectype: none 00:08:56.225 =====Discovery Log Entry 2====== 00:08:56.225 trtype: tcp 00:08:56.225 adrfam: ipv4 00:08:56.225 subtype: nvme subsystem 00:08:56.225 treq: not required 00:08:56.225 portid: 0 00:08:56.225 trsvcid: 4420 00:08:56.225 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:56.225 traddr: 10.0.0.2 00:08:56.225 eflags: none 00:08:56.225 sectype: none 00:08:56.225 =====Discovery Log Entry 3====== 00:08:56.225 trtype: tcp 00:08:56.225 adrfam: ipv4 00:08:56.225 subtype: nvme subsystem 00:08:56.225 treq: not required 00:08:56.225 portid: 0 00:08:56.225 trsvcid: 4420 00:08:56.225 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:56.225 traddr: 10.0.0.2 00:08:56.225 eflags: none 00:08:56.225 sectype: none 00:08:56.225 =====Discovery Log Entry 4====== 00:08:56.225 trtype: tcp 00:08:56.225 adrfam: ipv4 00:08:56.225 subtype: nvme subsystem 00:08:56.225 treq: not required 00:08:56.225 portid: 0 00:08:56.225 trsvcid: 4420 00:08:56.225 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:56.225 traddr: 10.0.0.2 00:08:56.225 eflags: none 00:08:56.225 sectype: none 00:08:56.225 =====Discovery Log Entry 5====== 00:08:56.225 trtype: tcp 00:08:56.225 adrfam: ipv4 00:08:56.225 subtype: discovery subsystem referral 00:08:56.225 treq: not required 00:08:56.225 portid: 0 00:08:56.225 trsvcid: 4430 00:08:56.225 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:56.225 traddr: 10.0.0.2 00:08:56.225 eflags: none 00:08:56.225 sectype: none 00:08:56.225 16:44:41 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:56.225 Perform nvmf subsystem discovery via RPC 00:08:56.225 16:44:41 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:56.225 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.225 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:56.225 [2024-11-16 16:44:41.889877] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:56.225 [ 00:08:56.225 { 00:08:56.225 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:56.225 "subtype": "Discovery", 00:08:56.225 "listen_addresses": [ 00:08:56.225 { 00:08:56.225 "transport": "TCP", 00:08:56.225 "trtype": "TCP", 00:08:56.225 "adrfam": "IPv4", 00:08:56.225 "traddr": "10.0.0.2", 00:08:56.225 "trsvcid": "4420" 00:08:56.225 } 00:08:56.225 ], 00:08:56.225 "allow_any_host": true, 00:08:56.225 "hosts": [] 00:08:56.225 }, 00:08:56.225 { 00:08:56.225 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:56.225 "subtype": "NVMe", 00:08:56.225 "listen_addresses": [ 00:08:56.225 { 00:08:56.225 "transport": "TCP", 00:08:56.225 "trtype": "TCP", 00:08:56.225 "adrfam": "IPv4", 00:08:56.225 "traddr": "10.0.0.2", 00:08:56.225 "trsvcid": "4420" 00:08:56.225 } 00:08:56.225 ], 00:08:56.225 "allow_any_host": true, 00:08:56.225 "hosts": [], 00:08:56.225 "serial_number": "SPDK00000000000001", 00:08:56.225 "model_number": "SPDK bdev Controller", 00:08:56.225 "max_namespaces": 32, 00:08:56.225 "min_cntlid": 1, 00:08:56.225 "max_cntlid": 65519, 00:08:56.225 "namespaces": [ 00:08:56.225 { 00:08:56.225 "nsid": 1, 00:08:56.225 "bdev_name": "Null1", 00:08:56.225 "name": "Null1", 00:08:56.225 "nguid": "BCF8FF5A09B14D8597577DF06011E930", 00:08:56.225 "uuid": "bcf8ff5a-09b1-4d85-9757-7df06011e930" 00:08:56.225 } 00:08:56.225 ] 00:08:56.225 }, 00:08:56.225 { 00:08:56.225 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:56.225 "subtype": "NVMe", 00:08:56.225 "listen_addresses": [ 00:08:56.225 { 00:08:56.225 "transport": "TCP", 00:08:56.225 "trtype": "TCP", 00:08:56.225 "adrfam": "IPv4", 00:08:56.225 "traddr": "10.0.0.2", 00:08:56.225 "trsvcid": "4420" 00:08:56.225 } 00:08:56.225 ], 00:08:56.225 "allow_any_host": true, 00:08:56.225 "hosts": [], 00:08:56.225 "serial_number": "SPDK00000000000002", 00:08:56.225 "model_number": "SPDK bdev Controller", 00:08:56.225 "max_namespaces": 32, 00:08:56.225 "min_cntlid": 1, 00:08:56.225 "max_cntlid": 65519, 00:08:56.225 "namespaces": [ 00:08:56.225 { 00:08:56.225 "nsid": 1, 00:08:56.225 "bdev_name": "Null2", 00:08:56.225 "name": "Null2", 00:08:56.225 "nguid": "DFF1C3B18D084FD989888B4EE01D2512", 00:08:56.226 "uuid": "dff1c3b1-8d08-4fd9-8988-8b4ee01d2512" 00:08:56.226 } 00:08:56.226 ] 00:08:56.226 }, 00:08:56.226 { 00:08:56.226 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:56.226 "subtype": "NVMe", 00:08:56.226 "listen_addresses": [ 00:08:56.226 { 00:08:56.226 "transport": "TCP", 00:08:56.226 "trtype": "TCP", 00:08:56.226 "adrfam": "IPv4", 00:08:56.226 "traddr": "10.0.0.2", 00:08:56.226 "trsvcid": "4420" 00:08:56.226 } 00:08:56.226 ], 00:08:56.226 "allow_any_host": true, 00:08:56.226 "hosts": [], 00:08:56.226 "serial_number": "SPDK00000000000003", 00:08:56.226 "model_number": "SPDK bdev Controller", 00:08:56.226 "max_namespaces": 32, 00:08:56.226 "min_cntlid": 1, 00:08:56.226 "max_cntlid": 65519, 00:08:56.226 "namespaces": [ 00:08:56.226 { 00:08:56.226 "nsid": 1, 00:08:56.226 "bdev_name": "Null3", 00:08:56.226 "name": "Null3", 00:08:56.226 "nguid": "401744D2B0E6488387A246E85571FB56", 00:08:56.226 "uuid": "401744d2-b0e6-4883-87a2-46e85571fb56" 00:08:56.226 } 00:08:56.226 ] 00:08:56.226 }, 00:08:56.226 { 00:08:56.226 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:56.226 "subtype": "NVMe", 00:08:56.226 "listen_addresses": [ 00:08:56.226 { 00:08:56.226 "transport": "TCP", 00:08:56.226 "trtype": "TCP", 00:08:56.226 "adrfam": "IPv4", 00:08:56.226 "traddr": "10.0.0.2", 00:08:56.226 "trsvcid": "4420" 00:08:56.226 } 00:08:56.226 ], 00:08:56.226 "allow_any_host": true, 00:08:56.226 "hosts": [], 00:08:56.226 "serial_number": "SPDK00000000000004", 00:08:56.226 "model_number": "SPDK bdev Controller", 00:08:56.226 "max_namespaces": 32, 00:08:56.226 "min_cntlid": 1, 00:08:56.226 "max_cntlid": 65519, 00:08:56.226 "namespaces": [ 00:08:56.226 { 00:08:56.226 "nsid": 1, 00:08:56.226 "bdev_name": "Null4", 00:08:56.226 "name": "Null4", 00:08:56.226 "nguid": "9528ED45D1B448CB8165241534A3DE73", 00:08:56.226 "uuid": "9528ed45-d1b4-48cb-8165-241534a3de73" 00:08:56.226 } 00:08:56.226 ] 00:08:56.226 } 00:08:56.226 ] 00:08:56.226 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.226 16:44:41 -- target/discovery.sh@42 -- # seq 1 4 00:08:56.226 16:44:41 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:56.226 16:44:41 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:56.226 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.226 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:56.226 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.226 16:44:41 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:56.226 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.226 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:56.226 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.226 16:44:41 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:56.226 16:44:41 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:56.226 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.226 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:56.226 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.226 16:44:41 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:56.226 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.226 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:56.226 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.226 16:44:41 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:56.226 16:44:41 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:56.226 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.226 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:56.226 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.226 16:44:41 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:56.226 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.226 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:56.226 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.226 16:44:41 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:56.226 16:44:41 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:56.226 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.226 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:56.226 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.226 16:44:41 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:56.226 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.226 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:56.226 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.226 16:44:41 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:56.226 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.226 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:56.484 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.484 16:44:41 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:56.484 16:44:41 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:56.484 16:44:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.484 16:44:41 -- common/autotest_common.sh@10 -- # set +x 00:08:56.484 16:44:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.484 16:44:42 -- target/discovery.sh@49 -- # check_bdevs= 00:08:56.484 16:44:42 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:56.484 16:44:42 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:56.484 16:44:42 -- target/discovery.sh@57 -- # nvmftestfini 00:08:56.484 16:44:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:56.484 16:44:42 -- nvmf/common.sh@116 -- # sync 00:08:56.484 16:44:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:56.484 16:44:42 -- nvmf/common.sh@119 -- # set +e 00:08:56.484 16:44:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:56.484 16:44:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:56.484 rmmod nvme_tcp 00:08:56.484 rmmod nvme_fabrics 00:08:56.484 rmmod nvme_keyring 00:08:56.484 16:44:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:56.484 16:44:42 -- nvmf/common.sh@123 -- # set -e 00:08:56.484 16:44:42 -- nvmf/common.sh@124 -- # return 0 00:08:56.484 16:44:42 -- nvmf/common.sh@477 -- # '[' -n 1104442 ']' 00:08:56.484 16:44:42 -- nvmf/common.sh@478 -- # killprocess 1104442 00:08:56.484 16:44:42 -- common/autotest_common.sh@936 -- # '[' -z 1104442 ']' 00:08:56.484 16:44:42 -- common/autotest_common.sh@940 -- # kill -0 1104442 00:08:56.484 16:44:42 -- common/autotest_common.sh@941 -- # uname 00:08:56.484 16:44:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:56.484 16:44:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1104442 00:08:56.484 16:44:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:56.484 16:44:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:56.484 16:44:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1104442' 00:08:56.484 killing process with pid 1104442 00:08:56.484 16:44:42 -- common/autotest_common.sh@955 -- # kill 1104442 00:08:56.484 [2024-11-16 16:44:42.137634] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:56.484 16:44:42 -- common/autotest_common.sh@960 -- # wait 1104442 00:08:56.743 16:44:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:56.743 16:44:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:56.743 16:44:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:56.743 16:44:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:56.743 16:44:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:56.743 16:44:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:56.743 16:44:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:56.743 16:44:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:59.277 16:44:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:59.277 00:08:59.277 real 0m6.436s 00:08:59.277 user 0m8.217s 00:08:59.277 sys 0m1.951s 00:08:59.277 16:44:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:59.277 16:44:44 -- common/autotest_common.sh@10 -- # set +x 00:08:59.277 ************************************ 00:08:59.277 END TEST nvmf_discovery 00:08:59.277 ************************************ 00:08:59.277 16:44:44 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:59.277 16:44:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:59.277 16:44:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:59.277 16:44:44 -- common/autotest_common.sh@10 -- # set +x 00:08:59.277 ************************************ 00:08:59.277 START TEST nvmf_referrals 00:08:59.277 ************************************ 00:08:59.277 16:44:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:59.277 * Looking for test storage... 00:08:59.278 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:59.278 16:44:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:59.278 16:44:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:59.278 16:44:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:59.278 16:44:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:59.278 16:44:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:59.278 16:44:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:59.278 16:44:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:59.278 16:44:44 -- scripts/common.sh@335 -- # IFS=.-: 00:08:59.278 16:44:44 -- scripts/common.sh@335 -- # read -ra ver1 00:08:59.278 16:44:44 -- scripts/common.sh@336 -- # IFS=.-: 00:08:59.278 16:44:44 -- scripts/common.sh@336 -- # read -ra ver2 00:08:59.278 16:44:44 -- scripts/common.sh@337 -- # local 'op=<' 00:08:59.278 16:44:44 -- scripts/common.sh@339 -- # ver1_l=2 00:08:59.278 16:44:44 -- scripts/common.sh@340 -- # ver2_l=1 00:08:59.278 16:44:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:59.278 16:44:44 -- scripts/common.sh@343 -- # case "$op" in 00:08:59.278 16:44:44 -- scripts/common.sh@344 -- # : 1 00:08:59.278 16:44:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:59.278 16:44:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:59.278 16:44:44 -- scripts/common.sh@364 -- # decimal 1 00:08:59.278 16:44:44 -- scripts/common.sh@352 -- # local d=1 00:08:59.278 16:44:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:59.278 16:44:44 -- scripts/common.sh@354 -- # echo 1 00:08:59.278 16:44:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:59.278 16:44:44 -- scripts/common.sh@365 -- # decimal 2 00:08:59.278 16:44:44 -- scripts/common.sh@352 -- # local d=2 00:08:59.278 16:44:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:59.278 16:44:44 -- scripts/common.sh@354 -- # echo 2 00:08:59.278 16:44:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:59.278 16:44:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:59.278 16:44:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:59.278 16:44:44 -- scripts/common.sh@367 -- # return 0 00:08:59.278 16:44:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:59.278 16:44:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:59.278 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:59.278 --rc genhtml_branch_coverage=1 00:08:59.278 --rc genhtml_function_coverage=1 00:08:59.278 --rc genhtml_legend=1 00:08:59.278 --rc geninfo_all_blocks=1 00:08:59.278 --rc geninfo_unexecuted_blocks=1 00:08:59.278 00:08:59.278 ' 00:08:59.278 16:44:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:59.278 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:59.278 --rc genhtml_branch_coverage=1 00:08:59.278 --rc genhtml_function_coverage=1 00:08:59.278 --rc genhtml_legend=1 00:08:59.278 --rc geninfo_all_blocks=1 00:08:59.278 --rc geninfo_unexecuted_blocks=1 00:08:59.278 00:08:59.278 ' 00:08:59.278 16:44:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:59.278 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:59.278 --rc genhtml_branch_coverage=1 00:08:59.278 --rc genhtml_function_coverage=1 00:08:59.278 --rc genhtml_legend=1 00:08:59.278 --rc geninfo_all_blocks=1 00:08:59.278 --rc geninfo_unexecuted_blocks=1 00:08:59.278 00:08:59.278 ' 00:08:59.278 16:44:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:59.278 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:59.278 --rc genhtml_branch_coverage=1 00:08:59.278 --rc genhtml_function_coverage=1 00:08:59.278 --rc genhtml_legend=1 00:08:59.278 --rc geninfo_all_blocks=1 00:08:59.278 --rc geninfo_unexecuted_blocks=1 00:08:59.278 00:08:59.278 ' 00:08:59.278 16:44:44 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:59.278 16:44:44 -- nvmf/common.sh@7 -- # uname -s 00:08:59.278 16:44:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:59.278 16:44:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:59.278 16:44:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:59.278 16:44:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:59.278 16:44:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:59.278 16:44:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:59.278 16:44:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:59.278 16:44:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:59.278 16:44:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:59.278 16:44:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:59.278 16:44:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:59.278 16:44:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:59.278 16:44:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:59.278 16:44:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:59.278 16:44:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:59.278 16:44:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:59.278 16:44:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:59.278 16:44:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:59.278 16:44:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:59.278 16:44:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.278 16:44:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.278 16:44:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.278 16:44:44 -- paths/export.sh@5 -- # export PATH 00:08:59.278 16:44:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.278 16:44:44 -- nvmf/common.sh@46 -- # : 0 00:08:59.278 16:44:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:59.278 16:44:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:59.278 16:44:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:59.278 16:44:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:59.278 16:44:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:59.278 16:44:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:59.278 16:44:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:59.278 16:44:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:59.278 16:44:44 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:59.278 16:44:44 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:59.278 16:44:44 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:59.278 16:44:44 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:59.278 16:44:44 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:59.278 16:44:44 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:59.278 16:44:44 -- target/referrals.sh@37 -- # nvmftestinit 00:08:59.278 16:44:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:59.279 16:44:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:59.279 16:44:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:59.279 16:44:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:59.279 16:44:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:59.279 16:44:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:59.279 16:44:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:59.279 16:44:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:59.279 16:44:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:59.279 16:44:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:59.279 16:44:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:59.279 16:44:44 -- common/autotest_common.sh@10 -- # set +x 00:09:01.273 16:44:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:01.273 16:44:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:01.273 16:44:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:01.273 16:44:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:01.273 16:44:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:01.273 16:44:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:01.273 16:44:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:01.273 16:44:46 -- nvmf/common.sh@294 -- # net_devs=() 00:09:01.273 16:44:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:01.273 16:44:46 -- nvmf/common.sh@295 -- # e810=() 00:09:01.274 16:44:46 -- nvmf/common.sh@295 -- # local -ga e810 00:09:01.274 16:44:46 -- nvmf/common.sh@296 -- # x722=() 00:09:01.274 16:44:46 -- nvmf/common.sh@296 -- # local -ga x722 00:09:01.274 16:44:46 -- nvmf/common.sh@297 -- # mlx=() 00:09:01.274 16:44:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:01.274 16:44:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:01.274 16:44:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:01.274 16:44:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:01.274 16:44:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:01.274 16:44:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:01.274 16:44:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:01.274 16:44:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:01.274 16:44:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:01.274 16:44:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:01.274 16:44:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:01.274 16:44:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:01.274 16:44:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:01.274 16:44:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:01.274 16:44:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:01.274 16:44:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:01.274 16:44:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:01.274 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:01.274 16:44:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:01.274 16:44:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:01.274 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:01.274 16:44:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:01.274 16:44:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:01.274 16:44:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:01.274 16:44:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:01.274 16:44:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:01.274 16:44:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:01.274 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:01.274 16:44:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:01.274 16:44:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:01.274 16:44:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:01.274 16:44:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:01.274 16:44:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:01.274 16:44:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:01.274 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:01.274 16:44:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:01.274 16:44:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:01.274 16:44:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:01.274 16:44:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:01.274 16:44:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:01.274 16:44:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:01.274 16:44:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:01.274 16:44:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:01.274 16:44:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:01.274 16:44:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:01.274 16:44:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:01.274 16:44:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:01.274 16:44:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:01.274 16:44:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:01.274 16:44:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:01.274 16:44:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:01.274 16:44:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:01.274 16:44:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:01.274 16:44:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:01.274 16:44:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:01.274 16:44:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:01.274 16:44:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:01.274 16:44:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:01.274 16:44:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:01.274 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:01.274 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:09:01.274 00:09:01.274 --- 10.0.0.2 ping statistics --- 00:09:01.274 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:01.274 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:09:01.274 16:44:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:01.274 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:01.274 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.155 ms 00:09:01.274 00:09:01.274 --- 10.0.0.1 ping statistics --- 00:09:01.274 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:01.274 rtt min/avg/max/mdev = 0.155/0.155/0.155/0.000 ms 00:09:01.274 16:44:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:01.274 16:44:46 -- nvmf/common.sh@410 -- # return 0 00:09:01.274 16:44:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:01.274 16:44:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:01.274 16:44:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:01.274 16:44:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:01.274 16:44:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:01.274 16:44:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:01.274 16:44:46 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:09:01.274 16:44:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:01.274 16:44:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:01.274 16:44:46 -- common/autotest_common.sh@10 -- # set +x 00:09:01.274 16:44:46 -- nvmf/common.sh@469 -- # nvmfpid=1106689 00:09:01.274 16:44:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:01.274 16:44:46 -- nvmf/common.sh@470 -- # waitforlisten 1106689 00:09:01.274 16:44:46 -- common/autotest_common.sh@829 -- # '[' -z 1106689 ']' 00:09:01.274 16:44:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:01.274 16:44:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:01.274 16:44:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:01.274 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:01.274 16:44:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:01.274 16:44:46 -- common/autotest_common.sh@10 -- # set +x 00:09:01.274 [2024-11-16 16:44:46.958220] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:09:01.274 [2024-11-16 16:44:46.958302] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:01.274 EAL: No free 2048 kB hugepages reported on node 1 00:09:01.533 [2024-11-16 16:44:47.029046] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:01.533 [2024-11-16 16:44:47.125810] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:01.533 [2024-11-16 16:44:47.125982] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:01.533 [2024-11-16 16:44:47.126002] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:01.533 [2024-11-16 16:44:47.126016] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:01.533 [2024-11-16 16:44:47.129642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:01.533 [2024-11-16 16:44:47.129693] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:01.533 [2024-11-16 16:44:47.129790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:01.533 [2024-11-16 16:44:47.129786] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:02.467 16:44:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:02.467 16:44:47 -- common/autotest_common.sh@862 -- # return 0 00:09:02.467 16:44:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:02.467 16:44:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:02.467 16:44:47 -- common/autotest_common.sh@10 -- # set +x 00:09:02.467 16:44:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:02.467 16:44:47 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:02.467 16:44:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.467 16:44:47 -- common/autotest_common.sh@10 -- # set +x 00:09:02.467 [2024-11-16 16:44:47.985319] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:02.467 16:44:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.467 16:44:47 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:09:02.467 16:44:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.467 16:44:47 -- common/autotest_common.sh@10 -- # set +x 00:09:02.467 [2024-11-16 16:44:47.997565] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:09:02.467 16:44:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.467 16:44:48 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:09:02.467 16:44:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.467 16:44:48 -- common/autotest_common.sh@10 -- # set +x 00:09:02.467 16:44:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.467 16:44:48 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:09:02.467 16:44:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.467 16:44:48 -- common/autotest_common.sh@10 -- # set +x 00:09:02.467 16:44:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.467 16:44:48 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:09:02.467 16:44:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.467 16:44:48 -- common/autotest_common.sh@10 -- # set +x 00:09:02.467 16:44:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.467 16:44:48 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:02.467 16:44:48 -- target/referrals.sh@48 -- # jq length 00:09:02.467 16:44:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.467 16:44:48 -- common/autotest_common.sh@10 -- # set +x 00:09:02.467 16:44:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.467 16:44:48 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:09:02.467 16:44:48 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:09:02.467 16:44:48 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:02.467 16:44:48 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:02.467 16:44:48 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:02.467 16:44:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.467 16:44:48 -- common/autotest_common.sh@10 -- # set +x 00:09:02.467 16:44:48 -- target/referrals.sh@21 -- # sort 00:09:02.467 16:44:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.467 16:44:48 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:02.467 16:44:48 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:02.467 16:44:48 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:09:02.467 16:44:48 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:02.467 16:44:48 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:02.467 16:44:48 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:02.467 16:44:48 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:02.467 16:44:48 -- target/referrals.sh@26 -- # sort 00:09:02.725 16:44:48 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:02.725 16:44:48 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:02.725 16:44:48 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:09:02.725 16:44:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.725 16:44:48 -- common/autotest_common.sh@10 -- # set +x 00:09:02.725 16:44:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.725 16:44:48 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:09:02.725 16:44:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.725 16:44:48 -- common/autotest_common.sh@10 -- # set +x 00:09:02.725 16:44:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.725 16:44:48 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:09:02.725 16:44:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.725 16:44:48 -- common/autotest_common.sh@10 -- # set +x 00:09:02.725 16:44:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.725 16:44:48 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:02.725 16:44:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.725 16:44:48 -- target/referrals.sh@56 -- # jq length 00:09:02.725 16:44:48 -- common/autotest_common.sh@10 -- # set +x 00:09:02.725 16:44:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.725 16:44:48 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:09:02.725 16:44:48 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:09:02.725 16:44:48 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:02.725 16:44:48 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:02.725 16:44:48 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:02.725 16:44:48 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:02.725 16:44:48 -- target/referrals.sh@26 -- # sort 00:09:02.983 16:44:48 -- target/referrals.sh@26 -- # echo 00:09:02.983 16:44:48 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:09:02.983 16:44:48 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:09:02.983 16:44:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.983 16:44:48 -- common/autotest_common.sh@10 -- # set +x 00:09:02.983 16:44:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.983 16:44:48 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:02.983 16:44:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.983 16:44:48 -- common/autotest_common.sh@10 -- # set +x 00:09:02.983 16:44:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.983 16:44:48 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:09:02.983 16:44:48 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:02.983 16:44:48 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:02.983 16:44:48 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:02.983 16:44:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.983 16:44:48 -- common/autotest_common.sh@10 -- # set +x 00:09:02.983 16:44:48 -- target/referrals.sh@21 -- # sort 00:09:02.983 16:44:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.983 16:44:48 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:09:02.983 16:44:48 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:02.983 16:44:48 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:09:02.983 16:44:48 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:02.983 16:44:48 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:02.983 16:44:48 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:02.983 16:44:48 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:02.983 16:44:48 -- target/referrals.sh@26 -- # sort 00:09:03.240 16:44:48 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:09:03.240 16:44:48 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:03.240 16:44:48 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:09:03.240 16:44:48 -- target/referrals.sh@67 -- # jq -r .subnqn 00:09:03.240 16:44:48 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:03.241 16:44:48 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:03.241 16:44:48 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:03.241 16:44:48 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:09:03.241 16:44:48 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:09:03.241 16:44:48 -- target/referrals.sh@68 -- # jq -r .subnqn 00:09:03.241 16:44:48 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:03.241 16:44:48 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:03.241 16:44:48 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:03.498 16:44:49 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:03.498 16:44:49 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:03.498 16:44:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.498 16:44:49 -- common/autotest_common.sh@10 -- # set +x 00:09:03.498 16:44:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.498 16:44:49 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:09:03.498 16:44:49 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:03.498 16:44:49 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:03.498 16:44:49 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:03.498 16:44:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.498 16:44:49 -- common/autotest_common.sh@10 -- # set +x 00:09:03.498 16:44:49 -- target/referrals.sh@21 -- # sort 00:09:03.498 16:44:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.498 16:44:49 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:09:03.498 16:44:49 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:03.498 16:44:49 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:09:03.498 16:44:49 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:03.498 16:44:49 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:03.499 16:44:49 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:03.499 16:44:49 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:03.499 16:44:49 -- target/referrals.sh@26 -- # sort 00:09:03.756 16:44:49 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:09:03.756 16:44:49 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:03.756 16:44:49 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:09:03.756 16:44:49 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:03.756 16:44:49 -- target/referrals.sh@75 -- # jq -r .subnqn 00:09:03.756 16:44:49 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:03.756 16:44:49 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:04.014 16:44:49 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:09:04.014 16:44:49 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:09:04.014 16:44:49 -- target/referrals.sh@76 -- # jq -r .subnqn 00:09:04.014 16:44:49 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:04.014 16:44:49 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:04.014 16:44:49 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:04.015 16:44:49 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:04.015 16:44:49 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:09:04.015 16:44:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:04.015 16:44:49 -- common/autotest_common.sh@10 -- # set +x 00:09:04.015 16:44:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:04.015 16:44:49 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:04.015 16:44:49 -- target/referrals.sh@82 -- # jq length 00:09:04.015 16:44:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:04.015 16:44:49 -- common/autotest_common.sh@10 -- # set +x 00:09:04.015 16:44:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:04.015 16:44:49 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:09:04.015 16:44:49 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:09:04.015 16:44:49 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:04.015 16:44:49 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:04.015 16:44:49 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:04.015 16:44:49 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:04.015 16:44:49 -- target/referrals.sh@26 -- # sort 00:09:04.272 16:44:49 -- target/referrals.sh@26 -- # echo 00:09:04.272 16:44:49 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:09:04.272 16:44:49 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:09:04.272 16:44:49 -- target/referrals.sh@86 -- # nvmftestfini 00:09:04.272 16:44:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:04.272 16:44:49 -- nvmf/common.sh@116 -- # sync 00:09:04.273 16:44:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:04.273 16:44:49 -- nvmf/common.sh@119 -- # set +e 00:09:04.273 16:44:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:04.273 16:44:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:04.273 rmmod nvme_tcp 00:09:04.273 rmmod nvme_fabrics 00:09:04.273 rmmod nvme_keyring 00:09:04.273 16:44:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:04.273 16:44:49 -- nvmf/common.sh@123 -- # set -e 00:09:04.273 16:44:49 -- nvmf/common.sh@124 -- # return 0 00:09:04.273 16:44:49 -- nvmf/common.sh@477 -- # '[' -n 1106689 ']' 00:09:04.273 16:44:49 -- nvmf/common.sh@478 -- # killprocess 1106689 00:09:04.273 16:44:49 -- common/autotest_common.sh@936 -- # '[' -z 1106689 ']' 00:09:04.273 16:44:49 -- common/autotest_common.sh@940 -- # kill -0 1106689 00:09:04.273 16:44:49 -- common/autotest_common.sh@941 -- # uname 00:09:04.273 16:44:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:04.273 16:44:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1106689 00:09:04.273 16:44:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:04.273 16:44:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:04.273 16:44:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1106689' 00:09:04.273 killing process with pid 1106689 00:09:04.273 16:44:49 -- common/autotest_common.sh@955 -- # kill 1106689 00:09:04.273 16:44:49 -- common/autotest_common.sh@960 -- # wait 1106689 00:09:04.531 16:44:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:04.531 16:44:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:04.531 16:44:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:04.531 16:44:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:04.531 16:44:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:04.531 16:44:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:04.531 16:44:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:04.531 16:44:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:07.067 16:44:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:07.067 00:09:07.067 real 0m7.806s 00:09:07.067 user 0m13.983s 00:09:07.067 sys 0m2.290s 00:09:07.067 16:44:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:07.067 16:44:52 -- common/autotest_common.sh@10 -- # set +x 00:09:07.067 ************************************ 00:09:07.067 END TEST nvmf_referrals 00:09:07.067 ************************************ 00:09:07.067 16:44:52 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:07.067 16:44:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:07.067 16:44:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:07.067 16:44:52 -- common/autotest_common.sh@10 -- # set +x 00:09:07.067 ************************************ 00:09:07.067 START TEST nvmf_connect_disconnect 00:09:07.067 ************************************ 00:09:07.067 16:44:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:07.067 * Looking for test storage... 00:09:07.067 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:07.067 16:44:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:07.067 16:44:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:07.067 16:44:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:07.067 16:44:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:07.067 16:44:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:07.067 16:44:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:07.067 16:44:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:07.067 16:44:52 -- scripts/common.sh@335 -- # IFS=.-: 00:09:07.067 16:44:52 -- scripts/common.sh@335 -- # read -ra ver1 00:09:07.067 16:44:52 -- scripts/common.sh@336 -- # IFS=.-: 00:09:07.067 16:44:52 -- scripts/common.sh@336 -- # read -ra ver2 00:09:07.067 16:44:52 -- scripts/common.sh@337 -- # local 'op=<' 00:09:07.067 16:44:52 -- scripts/common.sh@339 -- # ver1_l=2 00:09:07.067 16:44:52 -- scripts/common.sh@340 -- # ver2_l=1 00:09:07.067 16:44:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:07.067 16:44:52 -- scripts/common.sh@343 -- # case "$op" in 00:09:07.067 16:44:52 -- scripts/common.sh@344 -- # : 1 00:09:07.067 16:44:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:07.067 16:44:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:07.067 16:44:52 -- scripts/common.sh@364 -- # decimal 1 00:09:07.067 16:44:52 -- scripts/common.sh@352 -- # local d=1 00:09:07.067 16:44:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:07.067 16:44:52 -- scripts/common.sh@354 -- # echo 1 00:09:07.067 16:44:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:07.067 16:44:52 -- scripts/common.sh@365 -- # decimal 2 00:09:07.068 16:44:52 -- scripts/common.sh@352 -- # local d=2 00:09:07.068 16:44:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:07.068 16:44:52 -- scripts/common.sh@354 -- # echo 2 00:09:07.068 16:44:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:07.068 16:44:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:07.068 16:44:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:07.068 16:44:52 -- scripts/common.sh@367 -- # return 0 00:09:07.068 16:44:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:07.068 16:44:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:07.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:07.068 --rc genhtml_branch_coverage=1 00:09:07.068 --rc genhtml_function_coverage=1 00:09:07.068 --rc genhtml_legend=1 00:09:07.068 --rc geninfo_all_blocks=1 00:09:07.068 --rc geninfo_unexecuted_blocks=1 00:09:07.068 00:09:07.068 ' 00:09:07.068 16:44:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:07.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:07.068 --rc genhtml_branch_coverage=1 00:09:07.068 --rc genhtml_function_coverage=1 00:09:07.068 --rc genhtml_legend=1 00:09:07.068 --rc geninfo_all_blocks=1 00:09:07.068 --rc geninfo_unexecuted_blocks=1 00:09:07.068 00:09:07.068 ' 00:09:07.068 16:44:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:07.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:07.068 --rc genhtml_branch_coverage=1 00:09:07.068 --rc genhtml_function_coverage=1 00:09:07.068 --rc genhtml_legend=1 00:09:07.068 --rc geninfo_all_blocks=1 00:09:07.068 --rc geninfo_unexecuted_blocks=1 00:09:07.068 00:09:07.068 ' 00:09:07.068 16:44:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:07.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:07.068 --rc genhtml_branch_coverage=1 00:09:07.068 --rc genhtml_function_coverage=1 00:09:07.068 --rc genhtml_legend=1 00:09:07.068 --rc geninfo_all_blocks=1 00:09:07.068 --rc geninfo_unexecuted_blocks=1 00:09:07.068 00:09:07.068 ' 00:09:07.068 16:44:52 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:07.068 16:44:52 -- nvmf/common.sh@7 -- # uname -s 00:09:07.068 16:44:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:07.068 16:44:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:07.068 16:44:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:07.068 16:44:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:07.068 16:44:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:07.068 16:44:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:07.068 16:44:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:07.068 16:44:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:07.068 16:44:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:07.068 16:44:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:07.068 16:44:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:07.068 16:44:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:07.068 16:44:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:07.068 16:44:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:07.068 16:44:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:07.068 16:44:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:07.068 16:44:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:07.068 16:44:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:07.068 16:44:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:07.068 16:44:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:07.068 16:44:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:07.068 16:44:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:07.068 16:44:52 -- paths/export.sh@5 -- # export PATH 00:09:07.068 16:44:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:07.068 16:44:52 -- nvmf/common.sh@46 -- # : 0 00:09:07.068 16:44:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:07.068 16:44:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:07.068 16:44:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:07.068 16:44:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:07.068 16:44:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:07.068 16:44:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:07.068 16:44:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:07.068 16:44:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:07.068 16:44:52 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:07.068 16:44:52 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:07.068 16:44:52 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:09:07.068 16:44:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:07.068 16:44:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:07.068 16:44:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:07.068 16:44:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:07.068 16:44:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:07.068 16:44:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:07.068 16:44:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:07.068 16:44:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:07.068 16:44:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:07.068 16:44:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:07.068 16:44:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:07.068 16:44:52 -- common/autotest_common.sh@10 -- # set +x 00:09:08.971 16:44:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:08.971 16:44:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:08.971 16:44:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:08.971 16:44:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:08.971 16:44:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:08.971 16:44:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:08.971 16:44:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:08.971 16:44:54 -- nvmf/common.sh@294 -- # net_devs=() 00:09:08.971 16:44:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:08.971 16:44:54 -- nvmf/common.sh@295 -- # e810=() 00:09:08.971 16:44:54 -- nvmf/common.sh@295 -- # local -ga e810 00:09:08.971 16:44:54 -- nvmf/common.sh@296 -- # x722=() 00:09:08.971 16:44:54 -- nvmf/common.sh@296 -- # local -ga x722 00:09:08.971 16:44:54 -- nvmf/common.sh@297 -- # mlx=() 00:09:08.971 16:44:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:08.971 16:44:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:08.971 16:44:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:08.971 16:44:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:08.971 16:44:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:08.971 16:44:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:08.971 16:44:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:08.971 16:44:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:08.971 16:44:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:08.971 16:44:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:08.971 16:44:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:08.971 16:44:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:08.971 16:44:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:08.971 16:44:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:08.971 16:44:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:08.971 16:44:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:08.971 16:44:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:08.971 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:08.971 16:44:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:08.971 16:44:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:08.971 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:08.971 16:44:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:08.971 16:44:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:08.971 16:44:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:08.971 16:44:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:08.971 16:44:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:08.971 16:44:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:08.971 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:08.971 16:44:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:08.971 16:44:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:08.971 16:44:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:08.971 16:44:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:08.971 16:44:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:08.971 16:44:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:08.971 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:08.971 16:44:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:08.971 16:44:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:08.971 16:44:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:08.971 16:44:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:08.971 16:44:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:08.971 16:44:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:08.971 16:44:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:08.971 16:44:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:08.971 16:44:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:08.972 16:44:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:08.972 16:44:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:08.972 16:44:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:08.972 16:44:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:08.972 16:44:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:08.972 16:44:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:08.972 16:44:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:08.972 16:44:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:08.972 16:44:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:08.972 16:44:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:08.972 16:44:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:08.972 16:44:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:08.972 16:44:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:08.972 16:44:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:08.972 16:44:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:08.972 16:44:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:08.972 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:08.972 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:09:08.972 00:09:08.972 --- 10.0.0.2 ping statistics --- 00:09:08.972 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:08.972 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:09:08.972 16:44:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:08.972 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:08.972 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.146 ms 00:09:08.972 00:09:08.972 --- 10.0.0.1 ping statistics --- 00:09:08.972 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:08.972 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:09:08.972 16:44:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:08.972 16:44:54 -- nvmf/common.sh@410 -- # return 0 00:09:08.972 16:44:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:08.972 16:44:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:08.972 16:44:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:08.972 16:44:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:08.972 16:44:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:08.972 16:44:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:08.972 16:44:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:08.972 16:44:54 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:08.972 16:44:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:08.972 16:44:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:08.972 16:44:54 -- common/autotest_common.sh@10 -- # set +x 00:09:08.972 16:44:54 -- nvmf/common.sh@469 -- # nvmfpid=1109145 00:09:08.972 16:44:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:08.972 16:44:54 -- nvmf/common.sh@470 -- # waitforlisten 1109145 00:09:08.972 16:44:54 -- common/autotest_common.sh@829 -- # '[' -z 1109145 ']' 00:09:08.972 16:44:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:08.972 16:44:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:08.972 16:44:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:08.972 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:08.972 16:44:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:08.972 16:44:54 -- common/autotest_common.sh@10 -- # set +x 00:09:09.231 [2024-11-16 16:44:54.738994] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:09:09.231 [2024-11-16 16:44:54.739074] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:09.231 EAL: No free 2048 kB hugepages reported on node 1 00:09:09.231 [2024-11-16 16:44:54.804727] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:09.231 [2024-11-16 16:44:54.891334] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:09.231 [2024-11-16 16:44:54.891487] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:09.231 [2024-11-16 16:44:54.891503] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:09.231 [2024-11-16 16:44:54.891516] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:09.231 [2024-11-16 16:44:54.891568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:09.231 [2024-11-16 16:44:54.891636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:09.231 [2024-11-16 16:44:54.891696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:09.231 [2024-11-16 16:44:54.891699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:10.164 16:44:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:10.164 16:44:55 -- common/autotest_common.sh@862 -- # return 0 00:09:10.164 16:44:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:10.164 16:44:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:10.164 16:44:55 -- common/autotest_common.sh@10 -- # set +x 00:09:10.164 16:44:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:10.164 16:44:55 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:09:10.164 16:44:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:10.164 16:44:55 -- common/autotest_common.sh@10 -- # set +x 00:09:10.164 [2024-11-16 16:44:55.784512] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:10.164 16:44:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:10.164 16:44:55 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:10.164 16:44:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:10.164 16:44:55 -- common/autotest_common.sh@10 -- # set +x 00:09:10.164 16:44:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:10.164 16:44:55 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:10.164 16:44:55 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:10.164 16:44:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:10.164 16:44:55 -- common/autotest_common.sh@10 -- # set +x 00:09:10.164 16:44:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:10.164 16:44:55 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:10.164 16:44:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:10.164 16:44:55 -- common/autotest_common.sh@10 -- # set +x 00:09:10.164 16:44:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:10.164 16:44:55 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:10.164 16:44:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:10.164 16:44:55 -- common/autotest_common.sh@10 -- # set +x 00:09:10.164 [2024-11-16 16:44:55.842280] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:10.164 16:44:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:10.164 16:44:55 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:10.164 16:44:55 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:10.164 16:44:55 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:10.164 16:44:55 -- target/connect_disconnect.sh@34 -- # set +x 00:09:12.690 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.225 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.750 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.647 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.172 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.699 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.596 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.121 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.644 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.541 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.122 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.647 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.545 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.078 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.618 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.146 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.043 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.570 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.468 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.996 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.519 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.045 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.952 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.493 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.028 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.935 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.536 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.444 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.985 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.517 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.423 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.959 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.501 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.408 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.943 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.482 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.389 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.923 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.460 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.362 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.900 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.806 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.375 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.913 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.824 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.363 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.268 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.798 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.342 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.249 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.789 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.330 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.236 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.775 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.314 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.221 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.757 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.289 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.853 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.760 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.296 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.844 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.757 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.296 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.831 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.738 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.347 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.255 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.795 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:53.333 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.241 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:57.778 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:00.316 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.252 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.784 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.689 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.227 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.761 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.668 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.199 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.106 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:20.646 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.183 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.089 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.622 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.156 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:32.062 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.598 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:37.137 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:39.101 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:41.638 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:43.566 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:46.108 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.649 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:51.186 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:53.097 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:55.649 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:57.558 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:00.097 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:02.633 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:02.633 16:48:47 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:13:02.633 16:48:47 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:13:02.633 16:48:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:02.633 16:48:47 -- nvmf/common.sh@116 -- # sync 00:13:02.633 16:48:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:02.633 16:48:47 -- nvmf/common.sh@119 -- # set +e 00:13:02.633 16:48:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:02.633 16:48:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:02.633 rmmod nvme_tcp 00:13:02.633 rmmod nvme_fabrics 00:13:02.633 rmmod nvme_keyring 00:13:02.633 16:48:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:02.633 16:48:47 -- nvmf/common.sh@123 -- # set -e 00:13:02.633 16:48:47 -- nvmf/common.sh@124 -- # return 0 00:13:02.633 16:48:47 -- nvmf/common.sh@477 -- # '[' -n 1109145 ']' 00:13:02.633 16:48:47 -- nvmf/common.sh@478 -- # killprocess 1109145 00:13:02.633 16:48:47 -- common/autotest_common.sh@936 -- # '[' -z 1109145 ']' 00:13:02.633 16:48:47 -- common/autotest_common.sh@940 -- # kill -0 1109145 00:13:02.633 16:48:47 -- common/autotest_common.sh@941 -- # uname 00:13:02.633 16:48:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:02.633 16:48:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1109145 00:13:02.633 16:48:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:02.633 16:48:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:02.633 16:48:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1109145' 00:13:02.633 killing process with pid 1109145 00:13:02.633 16:48:47 -- common/autotest_common.sh@955 -- # kill 1109145 00:13:02.633 16:48:47 -- common/autotest_common.sh@960 -- # wait 1109145 00:13:02.633 16:48:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:02.633 16:48:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:02.633 16:48:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:02.633 16:48:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:02.633 16:48:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:02.633 16:48:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:02.633 16:48:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:02.633 16:48:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:04.561 16:48:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:04.561 00:13:04.561 real 3m58.010s 00:13:04.561 user 15m7.290s 00:13:04.561 sys 0m35.153s 00:13:04.561 16:48:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:04.561 16:48:50 -- common/autotest_common.sh@10 -- # set +x 00:13:04.561 ************************************ 00:13:04.561 END TEST nvmf_connect_disconnect 00:13:04.561 ************************************ 00:13:04.820 16:48:50 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:04.820 16:48:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:04.820 16:48:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:04.820 16:48:50 -- common/autotest_common.sh@10 -- # set +x 00:13:04.820 ************************************ 00:13:04.820 START TEST nvmf_multitarget 00:13:04.820 ************************************ 00:13:04.820 16:48:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:04.820 * Looking for test storage... 00:13:04.820 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:04.820 16:48:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:04.820 16:48:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:04.820 16:48:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:04.820 16:48:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:04.820 16:48:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:04.820 16:48:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:04.820 16:48:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:04.820 16:48:50 -- scripts/common.sh@335 -- # IFS=.-: 00:13:04.820 16:48:50 -- scripts/common.sh@335 -- # read -ra ver1 00:13:04.820 16:48:50 -- scripts/common.sh@336 -- # IFS=.-: 00:13:04.820 16:48:50 -- scripts/common.sh@336 -- # read -ra ver2 00:13:04.820 16:48:50 -- scripts/common.sh@337 -- # local 'op=<' 00:13:04.820 16:48:50 -- scripts/common.sh@339 -- # ver1_l=2 00:13:04.820 16:48:50 -- scripts/common.sh@340 -- # ver2_l=1 00:13:04.820 16:48:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:04.820 16:48:50 -- scripts/common.sh@343 -- # case "$op" in 00:13:04.820 16:48:50 -- scripts/common.sh@344 -- # : 1 00:13:04.820 16:48:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:04.820 16:48:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:04.820 16:48:50 -- scripts/common.sh@364 -- # decimal 1 00:13:04.820 16:48:50 -- scripts/common.sh@352 -- # local d=1 00:13:04.820 16:48:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:04.820 16:48:50 -- scripts/common.sh@354 -- # echo 1 00:13:04.820 16:48:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:04.820 16:48:50 -- scripts/common.sh@365 -- # decimal 2 00:13:04.820 16:48:50 -- scripts/common.sh@352 -- # local d=2 00:13:04.820 16:48:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:04.820 16:48:50 -- scripts/common.sh@354 -- # echo 2 00:13:04.820 16:48:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:04.820 16:48:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:04.820 16:48:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:04.820 16:48:50 -- scripts/common.sh@367 -- # return 0 00:13:04.820 16:48:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:04.820 16:48:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:04.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:04.820 --rc genhtml_branch_coverage=1 00:13:04.820 --rc genhtml_function_coverage=1 00:13:04.820 --rc genhtml_legend=1 00:13:04.820 --rc geninfo_all_blocks=1 00:13:04.820 --rc geninfo_unexecuted_blocks=1 00:13:04.820 00:13:04.820 ' 00:13:04.820 16:48:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:04.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:04.820 --rc genhtml_branch_coverage=1 00:13:04.820 --rc genhtml_function_coverage=1 00:13:04.820 --rc genhtml_legend=1 00:13:04.820 --rc geninfo_all_blocks=1 00:13:04.820 --rc geninfo_unexecuted_blocks=1 00:13:04.820 00:13:04.820 ' 00:13:04.820 16:48:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:04.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:04.820 --rc genhtml_branch_coverage=1 00:13:04.820 --rc genhtml_function_coverage=1 00:13:04.820 --rc genhtml_legend=1 00:13:04.820 --rc geninfo_all_blocks=1 00:13:04.820 --rc geninfo_unexecuted_blocks=1 00:13:04.820 00:13:04.820 ' 00:13:04.820 16:48:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:04.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:04.820 --rc genhtml_branch_coverage=1 00:13:04.820 --rc genhtml_function_coverage=1 00:13:04.820 --rc genhtml_legend=1 00:13:04.820 --rc geninfo_all_blocks=1 00:13:04.820 --rc geninfo_unexecuted_blocks=1 00:13:04.820 00:13:04.820 ' 00:13:04.820 16:48:50 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:04.820 16:48:50 -- nvmf/common.sh@7 -- # uname -s 00:13:04.820 16:48:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:04.820 16:48:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:04.820 16:48:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:04.820 16:48:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:04.820 16:48:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:04.820 16:48:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:04.820 16:48:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:04.820 16:48:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:04.820 16:48:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:04.820 16:48:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:04.820 16:48:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:04.820 16:48:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:04.820 16:48:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:04.820 16:48:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:04.820 16:48:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:04.820 16:48:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:04.820 16:48:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:04.820 16:48:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:04.820 16:48:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:04.820 16:48:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:04.820 16:48:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:04.820 16:48:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:04.820 16:48:50 -- paths/export.sh@5 -- # export PATH 00:13:04.820 16:48:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:04.820 16:48:50 -- nvmf/common.sh@46 -- # : 0 00:13:04.820 16:48:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:04.820 16:48:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:04.820 16:48:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:04.820 16:48:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:04.820 16:48:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:04.820 16:48:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:04.820 16:48:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:04.820 16:48:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:04.820 16:48:50 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:04.820 16:48:50 -- target/multitarget.sh@15 -- # nvmftestinit 00:13:04.820 16:48:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:04.820 16:48:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:04.821 16:48:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:04.821 16:48:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:04.821 16:48:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:04.821 16:48:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:04.821 16:48:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:04.821 16:48:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:04.821 16:48:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:04.821 16:48:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:04.821 16:48:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:04.821 16:48:50 -- common/autotest_common.sh@10 -- # set +x 00:13:07.356 16:48:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:07.356 16:48:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:07.356 16:48:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:07.356 16:48:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:07.356 16:48:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:07.356 16:48:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:07.356 16:48:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:07.356 16:48:52 -- nvmf/common.sh@294 -- # net_devs=() 00:13:07.357 16:48:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:07.357 16:48:52 -- nvmf/common.sh@295 -- # e810=() 00:13:07.357 16:48:52 -- nvmf/common.sh@295 -- # local -ga e810 00:13:07.357 16:48:52 -- nvmf/common.sh@296 -- # x722=() 00:13:07.357 16:48:52 -- nvmf/common.sh@296 -- # local -ga x722 00:13:07.357 16:48:52 -- nvmf/common.sh@297 -- # mlx=() 00:13:07.357 16:48:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:07.357 16:48:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:07.357 16:48:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:07.357 16:48:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:07.357 16:48:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:07.357 16:48:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:07.357 16:48:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:07.357 16:48:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:07.357 16:48:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:07.357 16:48:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:07.357 16:48:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:07.357 16:48:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:07.357 16:48:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:07.357 16:48:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:07.357 16:48:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:07.357 16:48:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:07.357 16:48:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:07.357 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:07.357 16:48:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:07.357 16:48:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:07.357 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:07.357 16:48:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:07.357 16:48:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:07.357 16:48:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:07.357 16:48:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:07.357 16:48:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:07.357 16:48:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:07.357 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:07.357 16:48:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:07.357 16:48:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:07.357 16:48:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:07.357 16:48:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:07.357 16:48:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:07.357 16:48:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:07.357 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:07.357 16:48:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:07.357 16:48:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:07.357 16:48:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:07.357 16:48:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:07.357 16:48:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:07.357 16:48:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:07.357 16:48:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:07.357 16:48:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:07.357 16:48:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:07.357 16:48:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:07.357 16:48:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:07.357 16:48:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:07.357 16:48:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:07.357 16:48:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:07.357 16:48:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:07.357 16:48:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:07.357 16:48:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:07.357 16:48:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:07.357 16:48:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:07.357 16:48:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:07.357 16:48:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:07.357 16:48:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:07.357 16:48:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:07.357 16:48:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:07.357 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:07.357 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:13:07.357 00:13:07.357 --- 10.0.0.2 ping statistics --- 00:13:07.357 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:07.357 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:13:07.357 16:48:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:07.357 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:07.357 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:13:07.357 00:13:07.357 --- 10.0.0.1 ping statistics --- 00:13:07.357 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:07.357 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:13:07.357 16:48:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:07.357 16:48:52 -- nvmf/common.sh@410 -- # return 0 00:13:07.357 16:48:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:07.357 16:48:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:07.357 16:48:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:07.357 16:48:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:07.357 16:48:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:07.357 16:48:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:07.357 16:48:52 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:13:07.357 16:48:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:07.357 16:48:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:07.357 16:48:52 -- common/autotest_common.sh@10 -- # set +x 00:13:07.357 16:48:52 -- nvmf/common.sh@469 -- # nvmfpid=1141931 00:13:07.357 16:48:52 -- nvmf/common.sh@470 -- # waitforlisten 1141931 00:13:07.357 16:48:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:07.357 16:48:52 -- common/autotest_common.sh@829 -- # '[' -z 1141931 ']' 00:13:07.357 16:48:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:07.357 16:48:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:07.357 16:48:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:07.357 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:07.357 16:48:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:07.357 16:48:52 -- common/autotest_common.sh@10 -- # set +x 00:13:07.357 [2024-11-16 16:48:52.846863] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:07.357 [2024-11-16 16:48:52.846938] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:07.357 EAL: No free 2048 kB hugepages reported on node 1 00:13:07.357 [2024-11-16 16:48:52.915714] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:07.357 [2024-11-16 16:48:53.007834] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:07.357 [2024-11-16 16:48:53.008020] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:07.357 [2024-11-16 16:48:53.008043] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:07.357 [2024-11-16 16:48:53.008058] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:07.357 [2024-11-16 16:48:53.008141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:07.357 [2024-11-16 16:48:53.008199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:07.357 [2024-11-16 16:48:53.008251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:07.357 [2024-11-16 16:48:53.008253] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:08.294 16:48:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:08.294 16:48:53 -- common/autotest_common.sh@862 -- # return 0 00:13:08.294 16:48:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:08.294 16:48:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:08.294 16:48:53 -- common/autotest_common.sh@10 -- # set +x 00:13:08.294 16:48:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:08.294 16:48:53 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:08.294 16:48:53 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:08.294 16:48:53 -- target/multitarget.sh@21 -- # jq length 00:13:08.294 16:48:53 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:13:08.294 16:48:53 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:13:08.294 "nvmf_tgt_1" 00:13:08.553 16:48:54 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:13:08.553 "nvmf_tgt_2" 00:13:08.553 16:48:54 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:08.553 16:48:54 -- target/multitarget.sh@28 -- # jq length 00:13:08.553 16:48:54 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:13:08.553 16:48:54 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:13:08.811 true 00:13:08.811 16:48:54 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:13:08.811 true 00:13:08.811 16:48:54 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:08.811 16:48:54 -- target/multitarget.sh@35 -- # jq length 00:13:09.069 16:48:54 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:13:09.069 16:48:54 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:13:09.069 16:48:54 -- target/multitarget.sh@41 -- # nvmftestfini 00:13:09.069 16:48:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:09.069 16:48:54 -- nvmf/common.sh@116 -- # sync 00:13:09.069 16:48:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:09.069 16:48:54 -- nvmf/common.sh@119 -- # set +e 00:13:09.069 16:48:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:09.069 16:48:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:09.069 rmmod nvme_tcp 00:13:09.069 rmmod nvme_fabrics 00:13:09.070 rmmod nvme_keyring 00:13:09.070 16:48:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:09.070 16:48:54 -- nvmf/common.sh@123 -- # set -e 00:13:09.070 16:48:54 -- nvmf/common.sh@124 -- # return 0 00:13:09.070 16:48:54 -- nvmf/common.sh@477 -- # '[' -n 1141931 ']' 00:13:09.070 16:48:54 -- nvmf/common.sh@478 -- # killprocess 1141931 00:13:09.070 16:48:54 -- common/autotest_common.sh@936 -- # '[' -z 1141931 ']' 00:13:09.070 16:48:54 -- common/autotest_common.sh@940 -- # kill -0 1141931 00:13:09.070 16:48:54 -- common/autotest_common.sh@941 -- # uname 00:13:09.070 16:48:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:09.070 16:48:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1141931 00:13:09.070 16:48:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:09.070 16:48:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:09.070 16:48:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1141931' 00:13:09.070 killing process with pid 1141931 00:13:09.070 16:48:54 -- common/autotest_common.sh@955 -- # kill 1141931 00:13:09.070 16:48:54 -- common/autotest_common.sh@960 -- # wait 1141931 00:13:09.328 16:48:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:09.328 16:48:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:09.328 16:48:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:09.328 16:48:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:09.328 16:48:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:09.328 16:48:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:09.328 16:48:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:09.328 16:48:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:11.886 16:48:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:11.887 00:13:11.887 real 0m6.694s 00:13:11.887 user 0m9.585s 00:13:11.887 sys 0m2.036s 00:13:11.887 16:48:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:11.887 16:48:57 -- common/autotest_common.sh@10 -- # set +x 00:13:11.887 ************************************ 00:13:11.887 END TEST nvmf_multitarget 00:13:11.887 ************************************ 00:13:11.887 16:48:57 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:11.887 16:48:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:11.887 16:48:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:11.887 16:48:57 -- common/autotest_common.sh@10 -- # set +x 00:13:11.887 ************************************ 00:13:11.887 START TEST nvmf_rpc 00:13:11.887 ************************************ 00:13:11.887 16:48:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:11.887 * Looking for test storage... 00:13:11.887 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:11.887 16:48:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:11.887 16:48:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:11.887 16:48:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:11.887 16:48:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:11.887 16:48:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:11.887 16:48:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:11.887 16:48:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:11.887 16:48:57 -- scripts/common.sh@335 -- # IFS=.-: 00:13:11.887 16:48:57 -- scripts/common.sh@335 -- # read -ra ver1 00:13:11.887 16:48:57 -- scripts/common.sh@336 -- # IFS=.-: 00:13:11.887 16:48:57 -- scripts/common.sh@336 -- # read -ra ver2 00:13:11.887 16:48:57 -- scripts/common.sh@337 -- # local 'op=<' 00:13:11.887 16:48:57 -- scripts/common.sh@339 -- # ver1_l=2 00:13:11.887 16:48:57 -- scripts/common.sh@340 -- # ver2_l=1 00:13:11.887 16:48:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:11.887 16:48:57 -- scripts/common.sh@343 -- # case "$op" in 00:13:11.887 16:48:57 -- scripts/common.sh@344 -- # : 1 00:13:11.887 16:48:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:11.887 16:48:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:11.887 16:48:57 -- scripts/common.sh@364 -- # decimal 1 00:13:11.887 16:48:57 -- scripts/common.sh@352 -- # local d=1 00:13:11.887 16:48:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:11.887 16:48:57 -- scripts/common.sh@354 -- # echo 1 00:13:11.887 16:48:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:11.887 16:48:57 -- scripts/common.sh@365 -- # decimal 2 00:13:11.887 16:48:57 -- scripts/common.sh@352 -- # local d=2 00:13:11.887 16:48:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:11.887 16:48:57 -- scripts/common.sh@354 -- # echo 2 00:13:11.887 16:48:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:11.887 16:48:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:11.887 16:48:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:11.887 16:48:57 -- scripts/common.sh@367 -- # return 0 00:13:11.887 16:48:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:11.887 16:48:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:11.887 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.887 --rc genhtml_branch_coverage=1 00:13:11.887 --rc genhtml_function_coverage=1 00:13:11.887 --rc genhtml_legend=1 00:13:11.887 --rc geninfo_all_blocks=1 00:13:11.887 --rc geninfo_unexecuted_blocks=1 00:13:11.887 00:13:11.887 ' 00:13:11.887 16:48:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:11.887 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.887 --rc genhtml_branch_coverage=1 00:13:11.887 --rc genhtml_function_coverage=1 00:13:11.887 --rc genhtml_legend=1 00:13:11.887 --rc geninfo_all_blocks=1 00:13:11.887 --rc geninfo_unexecuted_blocks=1 00:13:11.887 00:13:11.887 ' 00:13:11.887 16:48:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:11.887 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.887 --rc genhtml_branch_coverage=1 00:13:11.887 --rc genhtml_function_coverage=1 00:13:11.887 --rc genhtml_legend=1 00:13:11.887 --rc geninfo_all_blocks=1 00:13:11.887 --rc geninfo_unexecuted_blocks=1 00:13:11.887 00:13:11.887 ' 00:13:11.887 16:48:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:11.887 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.887 --rc genhtml_branch_coverage=1 00:13:11.887 --rc genhtml_function_coverage=1 00:13:11.887 --rc genhtml_legend=1 00:13:11.887 --rc geninfo_all_blocks=1 00:13:11.887 --rc geninfo_unexecuted_blocks=1 00:13:11.887 00:13:11.887 ' 00:13:11.887 16:48:57 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:11.887 16:48:57 -- nvmf/common.sh@7 -- # uname -s 00:13:11.887 16:48:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:11.887 16:48:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:11.887 16:48:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:11.887 16:48:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:11.887 16:48:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:11.887 16:48:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:11.887 16:48:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:11.887 16:48:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:11.887 16:48:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:11.887 16:48:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:11.887 16:48:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:11.887 16:48:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:11.887 16:48:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:11.887 16:48:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:11.887 16:48:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:11.887 16:48:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:11.887 16:48:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:11.887 16:48:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:11.887 16:48:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:11.887 16:48:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.887 16:48:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.887 16:48:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.887 16:48:57 -- paths/export.sh@5 -- # export PATH 00:13:11.887 16:48:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.887 16:48:57 -- nvmf/common.sh@46 -- # : 0 00:13:11.887 16:48:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:11.887 16:48:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:11.887 16:48:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:11.887 16:48:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:11.887 16:48:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:11.887 16:48:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:11.887 16:48:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:11.887 16:48:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:11.887 16:48:57 -- target/rpc.sh@11 -- # loops=5 00:13:11.887 16:48:57 -- target/rpc.sh@23 -- # nvmftestinit 00:13:11.887 16:48:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:11.887 16:48:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:11.887 16:48:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:11.887 16:48:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:11.887 16:48:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:11.887 16:48:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:11.887 16:48:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:11.887 16:48:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:11.887 16:48:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:11.887 16:48:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:11.887 16:48:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:11.887 16:48:57 -- common/autotest_common.sh@10 -- # set +x 00:13:13.793 16:48:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:13.793 16:48:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:13.793 16:48:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:13.793 16:48:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:13.793 16:48:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:13.793 16:48:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:13.793 16:48:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:13.793 16:48:59 -- nvmf/common.sh@294 -- # net_devs=() 00:13:13.793 16:48:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:13.793 16:48:59 -- nvmf/common.sh@295 -- # e810=() 00:13:13.793 16:48:59 -- nvmf/common.sh@295 -- # local -ga e810 00:13:13.793 16:48:59 -- nvmf/common.sh@296 -- # x722=() 00:13:13.793 16:48:59 -- nvmf/common.sh@296 -- # local -ga x722 00:13:13.793 16:48:59 -- nvmf/common.sh@297 -- # mlx=() 00:13:13.793 16:48:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:13.793 16:48:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:13.793 16:48:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:13.793 16:48:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:13.793 16:48:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:13.793 16:48:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:13.793 16:48:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:13.793 16:48:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:13.793 16:48:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:13.793 16:48:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:13.793 16:48:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:13.793 16:48:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:13.793 16:48:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:13.793 16:48:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:13.793 16:48:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:13.793 16:48:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:13.793 16:48:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:13.793 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:13.793 16:48:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:13.793 16:48:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:13.793 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:13.793 16:48:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:13.793 16:48:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:13.793 16:48:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:13.793 16:48:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:13.793 16:48:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:13.793 16:48:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:13.793 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:13.793 16:48:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:13.793 16:48:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:13.793 16:48:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:13.793 16:48:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:13.793 16:48:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:13.793 16:48:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:13.793 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:13.793 16:48:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:13.793 16:48:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:13.793 16:48:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:13.793 16:48:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:13.793 16:48:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:13.793 16:48:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:13.793 16:48:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:13.793 16:48:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:13.793 16:48:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:13.793 16:48:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:13.793 16:48:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:13.793 16:48:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:13.793 16:48:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:13.793 16:48:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:13.793 16:48:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:13.793 16:48:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:13.793 16:48:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:13.793 16:48:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:13.793 16:48:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:13.793 16:48:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:13.793 16:48:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:13.793 16:48:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:13.793 16:48:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:13.793 16:48:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:13.793 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:13.793 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.168 ms 00:13:13.793 00:13:13.793 --- 10.0.0.2 ping statistics --- 00:13:13.793 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:13.793 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:13:13.793 16:48:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:13.793 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:13.793 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:13:13.793 00:13:13.793 --- 10.0.0.1 ping statistics --- 00:13:13.793 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:13.793 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:13:13.793 16:48:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:13.793 16:48:59 -- nvmf/common.sh@410 -- # return 0 00:13:13.793 16:48:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:13.793 16:48:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:13.793 16:48:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:13.793 16:48:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:13.793 16:48:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:13.793 16:48:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:13.794 16:48:59 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:13.794 16:48:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:13.794 16:48:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:13.794 16:48:59 -- common/autotest_common.sh@10 -- # set +x 00:13:13.794 16:48:59 -- nvmf/common.sh@469 -- # nvmfpid=1144184 00:13:13.794 16:48:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:13.794 16:48:59 -- nvmf/common.sh@470 -- # waitforlisten 1144184 00:13:13.794 16:48:59 -- common/autotest_common.sh@829 -- # '[' -z 1144184 ']' 00:13:13.794 16:48:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:13.794 16:48:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:13.794 16:48:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:13.794 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:13.794 16:48:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:13.794 16:48:59 -- common/autotest_common.sh@10 -- # set +x 00:13:13.794 [2024-11-16 16:48:59.432175] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:13.794 [2024-11-16 16:48:59.432261] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:13.794 EAL: No free 2048 kB hugepages reported on node 1 00:13:13.794 [2024-11-16 16:48:59.501277] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:14.079 [2024-11-16 16:48:59.594940] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:14.079 [2024-11-16 16:48:59.595130] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:14.079 [2024-11-16 16:48:59.595150] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:14.079 [2024-11-16 16:48:59.595167] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:14.079 [2024-11-16 16:48:59.595254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:14.079 [2024-11-16 16:48:59.595310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:14.079 [2024-11-16 16:48:59.595363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:14.079 [2024-11-16 16:48:59.595366] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:14.653 16:49:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:14.653 16:49:00 -- common/autotest_common.sh@862 -- # return 0 00:13:14.914 16:49:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:14.914 16:49:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:14.914 16:49:00 -- common/autotest_common.sh@10 -- # set +x 00:13:14.914 16:49:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:14.914 16:49:00 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:14.914 16:49:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.914 16:49:00 -- common/autotest_common.sh@10 -- # set +x 00:13:14.914 16:49:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.914 16:49:00 -- target/rpc.sh@26 -- # stats='{ 00:13:14.914 "tick_rate": 2700000000, 00:13:14.914 "poll_groups": [ 00:13:14.914 { 00:13:14.914 "name": "nvmf_tgt_poll_group_0", 00:13:14.914 "admin_qpairs": 0, 00:13:14.914 "io_qpairs": 0, 00:13:14.914 "current_admin_qpairs": 0, 00:13:14.914 "current_io_qpairs": 0, 00:13:14.914 "pending_bdev_io": 0, 00:13:14.914 "completed_nvme_io": 0, 00:13:14.914 "transports": [] 00:13:14.914 }, 00:13:14.914 { 00:13:14.914 "name": "nvmf_tgt_poll_group_1", 00:13:14.914 "admin_qpairs": 0, 00:13:14.914 "io_qpairs": 0, 00:13:14.914 "current_admin_qpairs": 0, 00:13:14.914 "current_io_qpairs": 0, 00:13:14.914 "pending_bdev_io": 0, 00:13:14.914 "completed_nvme_io": 0, 00:13:14.914 "transports": [] 00:13:14.914 }, 00:13:14.914 { 00:13:14.914 "name": "nvmf_tgt_poll_group_2", 00:13:14.914 "admin_qpairs": 0, 00:13:14.914 "io_qpairs": 0, 00:13:14.914 "current_admin_qpairs": 0, 00:13:14.914 "current_io_qpairs": 0, 00:13:14.914 "pending_bdev_io": 0, 00:13:14.914 "completed_nvme_io": 0, 00:13:14.914 "transports": [] 00:13:14.914 }, 00:13:14.914 { 00:13:14.914 "name": "nvmf_tgt_poll_group_3", 00:13:14.914 "admin_qpairs": 0, 00:13:14.914 "io_qpairs": 0, 00:13:14.914 "current_admin_qpairs": 0, 00:13:14.914 "current_io_qpairs": 0, 00:13:14.914 "pending_bdev_io": 0, 00:13:14.914 "completed_nvme_io": 0, 00:13:14.914 "transports": [] 00:13:14.914 } 00:13:14.914 ] 00:13:14.914 }' 00:13:14.914 16:49:00 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:14.914 16:49:00 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:14.914 16:49:00 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:14.914 16:49:00 -- target/rpc.sh@15 -- # wc -l 00:13:14.914 16:49:00 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:14.914 16:49:00 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:14.914 16:49:00 -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:14.914 16:49:00 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:14.914 16:49:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.914 16:49:00 -- common/autotest_common.sh@10 -- # set +x 00:13:14.914 [2024-11-16 16:49:00.517606] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:14.914 16:49:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.914 16:49:00 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:14.914 16:49:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.914 16:49:00 -- common/autotest_common.sh@10 -- # set +x 00:13:14.914 16:49:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.914 16:49:00 -- target/rpc.sh@33 -- # stats='{ 00:13:14.914 "tick_rate": 2700000000, 00:13:14.914 "poll_groups": [ 00:13:14.914 { 00:13:14.914 "name": "nvmf_tgt_poll_group_0", 00:13:14.914 "admin_qpairs": 0, 00:13:14.914 "io_qpairs": 0, 00:13:14.914 "current_admin_qpairs": 0, 00:13:14.914 "current_io_qpairs": 0, 00:13:14.914 "pending_bdev_io": 0, 00:13:14.914 "completed_nvme_io": 0, 00:13:14.914 "transports": [ 00:13:14.914 { 00:13:14.914 "trtype": "TCP" 00:13:14.914 } 00:13:14.914 ] 00:13:14.914 }, 00:13:14.914 { 00:13:14.914 "name": "nvmf_tgt_poll_group_1", 00:13:14.914 "admin_qpairs": 0, 00:13:14.914 "io_qpairs": 0, 00:13:14.914 "current_admin_qpairs": 0, 00:13:14.914 "current_io_qpairs": 0, 00:13:14.914 "pending_bdev_io": 0, 00:13:14.914 "completed_nvme_io": 0, 00:13:14.914 "transports": [ 00:13:14.914 { 00:13:14.914 "trtype": "TCP" 00:13:14.914 } 00:13:14.914 ] 00:13:14.914 }, 00:13:14.914 { 00:13:14.914 "name": "nvmf_tgt_poll_group_2", 00:13:14.914 "admin_qpairs": 0, 00:13:14.914 "io_qpairs": 0, 00:13:14.914 "current_admin_qpairs": 0, 00:13:14.914 "current_io_qpairs": 0, 00:13:14.914 "pending_bdev_io": 0, 00:13:14.914 "completed_nvme_io": 0, 00:13:14.914 "transports": [ 00:13:14.914 { 00:13:14.914 "trtype": "TCP" 00:13:14.914 } 00:13:14.914 ] 00:13:14.914 }, 00:13:14.914 { 00:13:14.914 "name": "nvmf_tgt_poll_group_3", 00:13:14.914 "admin_qpairs": 0, 00:13:14.914 "io_qpairs": 0, 00:13:14.914 "current_admin_qpairs": 0, 00:13:14.914 "current_io_qpairs": 0, 00:13:14.914 "pending_bdev_io": 0, 00:13:14.914 "completed_nvme_io": 0, 00:13:14.914 "transports": [ 00:13:14.914 { 00:13:14.914 "trtype": "TCP" 00:13:14.914 } 00:13:14.914 ] 00:13:14.914 } 00:13:14.914 ] 00:13:14.914 }' 00:13:14.914 16:49:00 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:14.914 16:49:00 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:14.914 16:49:00 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:14.914 16:49:00 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:14.914 16:49:00 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:14.914 16:49:00 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:14.914 16:49:00 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:14.914 16:49:00 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:14.914 16:49:00 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:14.914 16:49:00 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:14.914 16:49:00 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:14.914 16:49:00 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:14.914 16:49:00 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:14.914 16:49:00 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:14.914 16:49:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.914 16:49:00 -- common/autotest_common.sh@10 -- # set +x 00:13:14.914 Malloc1 00:13:14.914 16:49:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.914 16:49:00 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:14.914 16:49:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.914 16:49:00 -- common/autotest_common.sh@10 -- # set +x 00:13:14.914 16:49:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.914 16:49:00 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:14.914 16:49:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.914 16:49:00 -- common/autotest_common.sh@10 -- # set +x 00:13:14.914 16:49:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.914 16:49:00 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:14.914 16:49:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.914 16:49:00 -- common/autotest_common.sh@10 -- # set +x 00:13:15.175 16:49:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.175 16:49:00 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:15.175 16:49:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.175 16:49:00 -- common/autotest_common.sh@10 -- # set +x 00:13:15.175 [2024-11-16 16:49:00.671477] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:15.175 16:49:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.175 16:49:00 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:15.175 16:49:00 -- common/autotest_common.sh@650 -- # local es=0 00:13:15.175 16:49:00 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:15.175 16:49:00 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:15.175 16:49:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:15.175 16:49:00 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:15.175 16:49:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:15.175 16:49:00 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:15.175 16:49:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:15.175 16:49:00 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:15.175 16:49:00 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:15.175 16:49:00 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:15.175 [2024-11-16 16:49:00.693964] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:15.175 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:15.175 could not add new controller: failed to write to nvme-fabrics device 00:13:15.175 16:49:00 -- common/autotest_common.sh@653 -- # es=1 00:13:15.175 16:49:00 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:15.175 16:49:00 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:15.175 16:49:00 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:15.175 16:49:00 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:15.175 16:49:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.175 16:49:00 -- common/autotest_common.sh@10 -- # set +x 00:13:15.175 16:49:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.175 16:49:00 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:15.744 16:49:01 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:15.744 16:49:01 -- common/autotest_common.sh@1187 -- # local i=0 00:13:15.744 16:49:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:15.744 16:49:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:15.744 16:49:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:18.282 16:49:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:18.282 16:49:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:18.282 16:49:03 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:18.282 16:49:03 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:18.282 16:49:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:18.282 16:49:03 -- common/autotest_common.sh@1197 -- # return 0 00:13:18.282 16:49:03 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:18.282 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:18.282 16:49:03 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:18.282 16:49:03 -- common/autotest_common.sh@1208 -- # local i=0 00:13:18.282 16:49:03 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:18.282 16:49:03 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:18.282 16:49:03 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:18.282 16:49:03 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:18.282 16:49:03 -- common/autotest_common.sh@1220 -- # return 0 00:13:18.282 16:49:03 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:18.282 16:49:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.282 16:49:03 -- common/autotest_common.sh@10 -- # set +x 00:13:18.282 16:49:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.282 16:49:03 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:18.282 16:49:03 -- common/autotest_common.sh@650 -- # local es=0 00:13:18.282 16:49:03 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:18.282 16:49:03 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:18.282 16:49:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:18.282 16:49:03 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:18.282 16:49:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:18.282 16:49:03 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:18.282 16:49:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:18.282 16:49:03 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:18.282 16:49:03 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:18.282 16:49:03 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:18.282 [2024-11-16 16:49:03.553402] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:18.282 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:18.282 could not add new controller: failed to write to nvme-fabrics device 00:13:18.282 16:49:03 -- common/autotest_common.sh@653 -- # es=1 00:13:18.282 16:49:03 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:18.282 16:49:03 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:18.282 16:49:03 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:18.282 16:49:03 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:18.282 16:49:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.282 16:49:03 -- common/autotest_common.sh@10 -- # set +x 00:13:18.282 16:49:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.282 16:49:03 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:18.540 16:49:04 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:18.540 16:49:04 -- common/autotest_common.sh@1187 -- # local i=0 00:13:18.540 16:49:04 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:18.540 16:49:04 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:18.540 16:49:04 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:21.077 16:49:06 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:21.077 16:49:06 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:21.077 16:49:06 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:21.077 16:49:06 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:21.077 16:49:06 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:21.077 16:49:06 -- common/autotest_common.sh@1197 -- # return 0 00:13:21.077 16:49:06 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:21.077 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:21.077 16:49:06 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:21.077 16:49:06 -- common/autotest_common.sh@1208 -- # local i=0 00:13:21.077 16:49:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:21.077 16:49:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:21.077 16:49:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:21.077 16:49:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:21.077 16:49:06 -- common/autotest_common.sh@1220 -- # return 0 00:13:21.077 16:49:06 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:21.077 16:49:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.077 16:49:06 -- common/autotest_common.sh@10 -- # set +x 00:13:21.077 16:49:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.077 16:49:06 -- target/rpc.sh@81 -- # seq 1 5 00:13:21.077 16:49:06 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:21.077 16:49:06 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:21.077 16:49:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.077 16:49:06 -- common/autotest_common.sh@10 -- # set +x 00:13:21.077 16:49:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.077 16:49:06 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:21.077 16:49:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.077 16:49:06 -- common/autotest_common.sh@10 -- # set +x 00:13:21.077 [2024-11-16 16:49:06.395430] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:21.077 16:49:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.077 16:49:06 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:21.077 16:49:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.077 16:49:06 -- common/autotest_common.sh@10 -- # set +x 00:13:21.077 16:49:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.077 16:49:06 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:21.077 16:49:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.077 16:49:06 -- common/autotest_common.sh@10 -- # set +x 00:13:21.077 16:49:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.077 16:49:06 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:21.643 16:49:07 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:21.643 16:49:07 -- common/autotest_common.sh@1187 -- # local i=0 00:13:21.643 16:49:07 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:21.643 16:49:07 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:21.643 16:49:07 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:23.550 16:49:09 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:23.550 16:49:09 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:23.550 16:49:09 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:23.550 16:49:09 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:23.550 16:49:09 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:23.550 16:49:09 -- common/autotest_common.sh@1197 -- # return 0 00:13:23.550 16:49:09 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:23.550 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:23.550 16:49:09 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:23.550 16:49:09 -- common/autotest_common.sh@1208 -- # local i=0 00:13:23.550 16:49:09 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:23.550 16:49:09 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:23.550 16:49:09 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:23.550 16:49:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:23.550 16:49:09 -- common/autotest_common.sh@1220 -- # return 0 00:13:23.550 16:49:09 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:23.550 16:49:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.550 16:49:09 -- common/autotest_common.sh@10 -- # set +x 00:13:23.550 16:49:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.550 16:49:09 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:23.550 16:49:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.550 16:49:09 -- common/autotest_common.sh@10 -- # set +x 00:13:23.550 16:49:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.550 16:49:09 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:23.550 16:49:09 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:23.550 16:49:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.550 16:49:09 -- common/autotest_common.sh@10 -- # set +x 00:13:23.550 16:49:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.550 16:49:09 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:23.550 16:49:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.550 16:49:09 -- common/autotest_common.sh@10 -- # set +x 00:13:23.550 [2024-11-16 16:49:09.241119] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:23.550 16:49:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.550 16:49:09 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:23.550 16:49:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.550 16:49:09 -- common/autotest_common.sh@10 -- # set +x 00:13:23.550 16:49:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.550 16:49:09 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:23.550 16:49:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.550 16:49:09 -- common/autotest_common.sh@10 -- # set +x 00:13:23.550 16:49:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.550 16:49:09 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:24.117 16:49:09 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:24.117 16:49:09 -- common/autotest_common.sh@1187 -- # local i=0 00:13:24.117 16:49:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:24.117 16:49:09 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:24.117 16:49:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:26.652 16:49:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:26.652 16:49:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:26.652 16:49:11 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:26.652 16:49:11 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:26.652 16:49:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:26.652 16:49:11 -- common/autotest_common.sh@1197 -- # return 0 00:13:26.652 16:49:11 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:26.652 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:26.652 16:49:11 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:26.652 16:49:11 -- common/autotest_common.sh@1208 -- # local i=0 00:13:26.652 16:49:11 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:26.652 16:49:11 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:26.652 16:49:11 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:26.652 16:49:11 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:26.652 16:49:11 -- common/autotest_common.sh@1220 -- # return 0 00:13:26.652 16:49:11 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:26.652 16:49:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.652 16:49:11 -- common/autotest_common.sh@10 -- # set +x 00:13:26.652 16:49:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.652 16:49:11 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:26.652 16:49:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.652 16:49:11 -- common/autotest_common.sh@10 -- # set +x 00:13:26.652 16:49:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.652 16:49:11 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:26.652 16:49:11 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:26.652 16:49:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.652 16:49:11 -- common/autotest_common.sh@10 -- # set +x 00:13:26.652 16:49:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.652 16:49:11 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:26.652 16:49:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.652 16:49:11 -- common/autotest_common.sh@10 -- # set +x 00:13:26.652 [2024-11-16 16:49:11.981942] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:26.652 16:49:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.652 16:49:11 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:26.652 16:49:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.652 16:49:11 -- common/autotest_common.sh@10 -- # set +x 00:13:26.652 16:49:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.652 16:49:11 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:26.652 16:49:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.652 16:49:11 -- common/autotest_common.sh@10 -- # set +x 00:13:26.652 16:49:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.652 16:49:12 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:27.221 16:49:12 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:27.221 16:49:12 -- common/autotest_common.sh@1187 -- # local i=0 00:13:27.221 16:49:12 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:27.221 16:49:12 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:27.222 16:49:12 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:29.132 16:49:14 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:29.132 16:49:14 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:29.132 16:49:14 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:29.132 16:49:14 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:29.132 16:49:14 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:29.132 16:49:14 -- common/autotest_common.sh@1197 -- # return 0 00:13:29.132 16:49:14 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:29.132 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:29.132 16:49:14 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:29.132 16:49:14 -- common/autotest_common.sh@1208 -- # local i=0 00:13:29.132 16:49:14 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:29.132 16:49:14 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:29.132 16:49:14 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:29.132 16:49:14 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:29.132 16:49:14 -- common/autotest_common.sh@1220 -- # return 0 00:13:29.132 16:49:14 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:29.132 16:49:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.132 16:49:14 -- common/autotest_common.sh@10 -- # set +x 00:13:29.132 16:49:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.132 16:49:14 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:29.132 16:49:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.132 16:49:14 -- common/autotest_common.sh@10 -- # set +x 00:13:29.132 16:49:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.132 16:49:14 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:29.132 16:49:14 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:29.132 16:49:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.132 16:49:14 -- common/autotest_common.sh@10 -- # set +x 00:13:29.132 16:49:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.132 16:49:14 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:29.132 16:49:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.132 16:49:14 -- common/autotest_common.sh@10 -- # set +x 00:13:29.132 [2024-11-16 16:49:14.814357] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:29.132 16:49:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.132 16:49:14 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:29.132 16:49:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.132 16:49:14 -- common/autotest_common.sh@10 -- # set +x 00:13:29.132 16:49:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.132 16:49:14 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:29.132 16:49:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.132 16:49:14 -- common/autotest_common.sh@10 -- # set +x 00:13:29.132 16:49:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.132 16:49:14 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:30.071 16:49:15 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:30.071 16:49:15 -- common/autotest_common.sh@1187 -- # local i=0 00:13:30.071 16:49:15 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:30.071 16:49:15 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:30.071 16:49:15 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:31.981 16:49:17 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:31.981 16:49:17 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:31.981 16:49:17 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:31.981 16:49:17 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:31.981 16:49:17 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:31.981 16:49:17 -- common/autotest_common.sh@1197 -- # return 0 00:13:31.981 16:49:17 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:31.981 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:31.981 16:49:17 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:31.981 16:49:17 -- common/autotest_common.sh@1208 -- # local i=0 00:13:31.981 16:49:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:31.981 16:49:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:31.981 16:49:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:31.981 16:49:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:31.981 16:49:17 -- common/autotest_common.sh@1220 -- # return 0 00:13:31.981 16:49:17 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:31.981 16:49:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.981 16:49:17 -- common/autotest_common.sh@10 -- # set +x 00:13:31.981 16:49:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.981 16:49:17 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:31.981 16:49:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.981 16:49:17 -- common/autotest_common.sh@10 -- # set +x 00:13:31.981 16:49:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.981 16:49:17 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:31.981 16:49:17 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:31.981 16:49:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.981 16:49:17 -- common/autotest_common.sh@10 -- # set +x 00:13:31.981 16:49:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.981 16:49:17 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:31.981 16:49:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.981 16:49:17 -- common/autotest_common.sh@10 -- # set +x 00:13:31.981 [2024-11-16 16:49:17.687838] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:31.981 16:49:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.981 16:49:17 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:31.981 16:49:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.981 16:49:17 -- common/autotest_common.sh@10 -- # set +x 00:13:31.981 16:49:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.981 16:49:17 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:31.981 16:49:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.981 16:49:17 -- common/autotest_common.sh@10 -- # set +x 00:13:31.981 16:49:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.981 16:49:17 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:32.919 16:49:18 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:32.919 16:49:18 -- common/autotest_common.sh@1187 -- # local i=0 00:13:32.919 16:49:18 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:32.919 16:49:18 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:32.919 16:49:18 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:34.824 16:49:20 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:34.824 16:49:20 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:34.824 16:49:20 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:34.824 16:49:20 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:34.824 16:49:20 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:34.824 16:49:20 -- common/autotest_common.sh@1197 -- # return 0 00:13:34.824 16:49:20 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:34.824 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:34.824 16:49:20 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:34.824 16:49:20 -- common/autotest_common.sh@1208 -- # local i=0 00:13:34.824 16:49:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:34.824 16:49:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:34.824 16:49:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:34.824 16:49:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:34.824 16:49:20 -- common/autotest_common.sh@1220 -- # return 0 00:13:34.824 16:49:20 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:34.824 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.824 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.824 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.824 16:49:20 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:34.824 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.824 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.824 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.824 16:49:20 -- target/rpc.sh@99 -- # seq 1 5 00:13:34.824 16:49:20 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:34.824 16:49:20 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:34.824 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.824 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.824 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.825 16:49:20 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:34.825 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.825 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.825 [2024-11-16 16:49:20.482366] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.825 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.825 16:49:20 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:34.825 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.825 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.825 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.825 16:49:20 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:34.825 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.825 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.825 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.825 16:49:20 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:34.825 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.825 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.825 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.825 16:49:20 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:34.825 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.825 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.825 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.825 16:49:20 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:34.825 16:49:20 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:34.825 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.825 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.825 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.825 16:49:20 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:34.825 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.825 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.825 [2024-11-16 16:49:20.530425] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.825 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.825 16:49:20 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:34.825 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.825 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.825 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.825 16:49:20 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:34.825 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.825 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.825 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.825 16:49:20 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:34.825 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.825 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.825 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.825 16:49:20 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:34.825 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.825 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:34.825 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.825 16:49:20 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:34.825 16:49:20 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:34.825 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.825 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.084 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.084 16:49:20 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:35.084 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.084 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.084 [2024-11-16 16:49:20.578575] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:35.084 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.084 16:49:20 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:35.084 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.084 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.084 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.084 16:49:20 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:35.084 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.084 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.084 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.084 16:49:20 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:35.084 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.084 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.084 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.084 16:49:20 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:35.084 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.084 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.084 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.084 16:49:20 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:35.084 16:49:20 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:35.084 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.084 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.084 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.084 16:49:20 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:35.084 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.084 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.084 [2024-11-16 16:49:20.626787] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:35.084 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.084 16:49:20 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:35.084 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.084 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.084 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.084 16:49:20 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:35.084 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.084 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.084 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.084 16:49:20 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:35.084 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.084 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.084 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.084 16:49:20 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:35.084 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.084 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.084 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.084 16:49:20 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:35.084 16:49:20 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:35.084 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.084 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.084 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.084 16:49:20 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:35.084 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.084 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.084 [2024-11-16 16:49:20.674953] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:35.085 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.085 16:49:20 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:35.085 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.085 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.085 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.085 16:49:20 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:35.085 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.085 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.085 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.085 16:49:20 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:35.085 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.085 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.085 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.085 16:49:20 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:35.085 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.085 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.085 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.085 16:49:20 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:35.085 16:49:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.085 16:49:20 -- common/autotest_common.sh@10 -- # set +x 00:13:35.085 16:49:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.085 16:49:20 -- target/rpc.sh@110 -- # stats='{ 00:13:35.085 "tick_rate": 2700000000, 00:13:35.085 "poll_groups": [ 00:13:35.085 { 00:13:35.085 "name": "nvmf_tgt_poll_group_0", 00:13:35.085 "admin_qpairs": 2, 00:13:35.085 "io_qpairs": 84, 00:13:35.085 "current_admin_qpairs": 0, 00:13:35.085 "current_io_qpairs": 0, 00:13:35.085 "pending_bdev_io": 0, 00:13:35.085 "completed_nvme_io": 184, 00:13:35.085 "transports": [ 00:13:35.085 { 00:13:35.085 "trtype": "TCP" 00:13:35.085 } 00:13:35.085 ] 00:13:35.085 }, 00:13:35.085 { 00:13:35.085 "name": "nvmf_tgt_poll_group_1", 00:13:35.085 "admin_qpairs": 2, 00:13:35.085 "io_qpairs": 84, 00:13:35.085 "current_admin_qpairs": 0, 00:13:35.085 "current_io_qpairs": 0, 00:13:35.085 "pending_bdev_io": 0, 00:13:35.085 "completed_nvme_io": 85, 00:13:35.085 "transports": [ 00:13:35.085 { 00:13:35.085 "trtype": "TCP" 00:13:35.085 } 00:13:35.085 ] 00:13:35.085 }, 00:13:35.085 { 00:13:35.085 "name": "nvmf_tgt_poll_group_2", 00:13:35.085 "admin_qpairs": 1, 00:13:35.085 "io_qpairs": 84, 00:13:35.085 "current_admin_qpairs": 0, 00:13:35.085 "current_io_qpairs": 0, 00:13:35.085 "pending_bdev_io": 0, 00:13:35.085 "completed_nvme_io": 234, 00:13:35.085 "transports": [ 00:13:35.085 { 00:13:35.085 "trtype": "TCP" 00:13:35.085 } 00:13:35.085 ] 00:13:35.085 }, 00:13:35.085 { 00:13:35.085 "name": "nvmf_tgt_poll_group_3", 00:13:35.085 "admin_qpairs": 2, 00:13:35.085 "io_qpairs": 84, 00:13:35.085 "current_admin_qpairs": 0, 00:13:35.085 "current_io_qpairs": 0, 00:13:35.085 "pending_bdev_io": 0, 00:13:35.085 "completed_nvme_io": 183, 00:13:35.085 "transports": [ 00:13:35.085 { 00:13:35.085 "trtype": "TCP" 00:13:35.085 } 00:13:35.085 ] 00:13:35.085 } 00:13:35.085 ] 00:13:35.085 }' 00:13:35.085 16:49:20 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:35.085 16:49:20 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:35.085 16:49:20 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:35.085 16:49:20 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:35.085 16:49:20 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:35.085 16:49:20 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:35.085 16:49:20 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:35.085 16:49:20 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:35.085 16:49:20 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:35.085 16:49:20 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:35.085 16:49:20 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:35.085 16:49:20 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:35.085 16:49:20 -- target/rpc.sh@123 -- # nvmftestfini 00:13:35.085 16:49:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:35.085 16:49:20 -- nvmf/common.sh@116 -- # sync 00:13:35.085 16:49:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:35.085 16:49:20 -- nvmf/common.sh@119 -- # set +e 00:13:35.085 16:49:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:35.085 16:49:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:35.085 rmmod nvme_tcp 00:13:35.085 rmmod nvme_fabrics 00:13:35.085 rmmod nvme_keyring 00:13:35.344 16:49:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:35.344 16:49:20 -- nvmf/common.sh@123 -- # set -e 00:13:35.344 16:49:20 -- nvmf/common.sh@124 -- # return 0 00:13:35.344 16:49:20 -- nvmf/common.sh@477 -- # '[' -n 1144184 ']' 00:13:35.344 16:49:20 -- nvmf/common.sh@478 -- # killprocess 1144184 00:13:35.344 16:49:20 -- common/autotest_common.sh@936 -- # '[' -z 1144184 ']' 00:13:35.344 16:49:20 -- common/autotest_common.sh@940 -- # kill -0 1144184 00:13:35.344 16:49:20 -- common/autotest_common.sh@941 -- # uname 00:13:35.344 16:49:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:35.344 16:49:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1144184 00:13:35.344 16:49:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:35.344 16:49:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:35.344 16:49:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1144184' 00:13:35.344 killing process with pid 1144184 00:13:35.344 16:49:20 -- common/autotest_common.sh@955 -- # kill 1144184 00:13:35.344 16:49:20 -- common/autotest_common.sh@960 -- # wait 1144184 00:13:35.604 16:49:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:35.604 16:49:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:35.604 16:49:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:35.604 16:49:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:35.604 16:49:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:35.604 16:49:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:35.604 16:49:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:35.604 16:49:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:37.510 16:49:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:37.510 00:13:37.510 real 0m26.138s 00:13:37.510 user 1m25.664s 00:13:37.510 sys 0m4.168s 00:13:37.510 16:49:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:37.510 16:49:23 -- common/autotest_common.sh@10 -- # set +x 00:13:37.510 ************************************ 00:13:37.510 END TEST nvmf_rpc 00:13:37.510 ************************************ 00:13:37.510 16:49:23 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:37.510 16:49:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:37.510 16:49:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:37.510 16:49:23 -- common/autotest_common.sh@10 -- # set +x 00:13:37.510 ************************************ 00:13:37.510 START TEST nvmf_invalid 00:13:37.510 ************************************ 00:13:37.510 16:49:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:37.510 * Looking for test storage... 00:13:37.510 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:37.510 16:49:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:37.510 16:49:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:37.769 16:49:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:37.769 16:49:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:37.769 16:49:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:37.769 16:49:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:37.769 16:49:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:37.769 16:49:23 -- scripts/common.sh@335 -- # IFS=.-: 00:13:37.769 16:49:23 -- scripts/common.sh@335 -- # read -ra ver1 00:13:37.769 16:49:23 -- scripts/common.sh@336 -- # IFS=.-: 00:13:37.769 16:49:23 -- scripts/common.sh@336 -- # read -ra ver2 00:13:37.769 16:49:23 -- scripts/common.sh@337 -- # local 'op=<' 00:13:37.769 16:49:23 -- scripts/common.sh@339 -- # ver1_l=2 00:13:37.769 16:49:23 -- scripts/common.sh@340 -- # ver2_l=1 00:13:37.769 16:49:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:37.769 16:49:23 -- scripts/common.sh@343 -- # case "$op" in 00:13:37.769 16:49:23 -- scripts/common.sh@344 -- # : 1 00:13:37.769 16:49:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:37.769 16:49:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:37.769 16:49:23 -- scripts/common.sh@364 -- # decimal 1 00:13:37.769 16:49:23 -- scripts/common.sh@352 -- # local d=1 00:13:37.769 16:49:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:37.769 16:49:23 -- scripts/common.sh@354 -- # echo 1 00:13:37.769 16:49:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:37.769 16:49:23 -- scripts/common.sh@365 -- # decimal 2 00:13:37.769 16:49:23 -- scripts/common.sh@352 -- # local d=2 00:13:37.769 16:49:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:37.769 16:49:23 -- scripts/common.sh@354 -- # echo 2 00:13:37.769 16:49:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:37.769 16:49:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:37.769 16:49:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:37.769 16:49:23 -- scripts/common.sh@367 -- # return 0 00:13:37.769 16:49:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:37.769 16:49:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:37.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.769 --rc genhtml_branch_coverage=1 00:13:37.769 --rc genhtml_function_coverage=1 00:13:37.769 --rc genhtml_legend=1 00:13:37.769 --rc geninfo_all_blocks=1 00:13:37.769 --rc geninfo_unexecuted_blocks=1 00:13:37.769 00:13:37.769 ' 00:13:37.769 16:49:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:37.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.769 --rc genhtml_branch_coverage=1 00:13:37.769 --rc genhtml_function_coverage=1 00:13:37.769 --rc genhtml_legend=1 00:13:37.769 --rc geninfo_all_blocks=1 00:13:37.769 --rc geninfo_unexecuted_blocks=1 00:13:37.769 00:13:37.769 ' 00:13:37.769 16:49:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:37.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.769 --rc genhtml_branch_coverage=1 00:13:37.769 --rc genhtml_function_coverage=1 00:13:37.769 --rc genhtml_legend=1 00:13:37.769 --rc geninfo_all_blocks=1 00:13:37.769 --rc geninfo_unexecuted_blocks=1 00:13:37.769 00:13:37.769 ' 00:13:37.769 16:49:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:37.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.769 --rc genhtml_branch_coverage=1 00:13:37.769 --rc genhtml_function_coverage=1 00:13:37.769 --rc genhtml_legend=1 00:13:37.769 --rc geninfo_all_blocks=1 00:13:37.769 --rc geninfo_unexecuted_blocks=1 00:13:37.769 00:13:37.769 ' 00:13:37.769 16:49:23 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:37.769 16:49:23 -- nvmf/common.sh@7 -- # uname -s 00:13:37.769 16:49:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:37.769 16:49:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:37.769 16:49:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:37.769 16:49:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:37.769 16:49:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:37.769 16:49:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:37.769 16:49:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:37.769 16:49:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:37.770 16:49:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:37.770 16:49:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:37.770 16:49:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:37.770 16:49:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:37.770 16:49:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:37.770 16:49:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:37.770 16:49:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:37.770 16:49:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:37.770 16:49:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:37.770 16:49:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:37.770 16:49:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:37.770 16:49:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.770 16:49:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.770 16:49:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.770 16:49:23 -- paths/export.sh@5 -- # export PATH 00:13:37.770 16:49:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.770 16:49:23 -- nvmf/common.sh@46 -- # : 0 00:13:37.770 16:49:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:37.770 16:49:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:37.770 16:49:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:37.770 16:49:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:37.770 16:49:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:37.770 16:49:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:37.770 16:49:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:37.770 16:49:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:37.770 16:49:23 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:37.770 16:49:23 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:37.770 16:49:23 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:37.770 16:49:23 -- target/invalid.sh@14 -- # target=foobar 00:13:37.770 16:49:23 -- target/invalid.sh@16 -- # RANDOM=0 00:13:37.770 16:49:23 -- target/invalid.sh@34 -- # nvmftestinit 00:13:37.770 16:49:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:37.770 16:49:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:37.770 16:49:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:37.770 16:49:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:37.770 16:49:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:37.770 16:49:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:37.770 16:49:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:37.770 16:49:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:37.770 16:49:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:37.770 16:49:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:37.770 16:49:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:37.770 16:49:23 -- common/autotest_common.sh@10 -- # set +x 00:13:39.675 16:49:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:39.675 16:49:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:39.675 16:49:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:39.675 16:49:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:39.675 16:49:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:39.675 16:49:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:39.675 16:49:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:39.675 16:49:25 -- nvmf/common.sh@294 -- # net_devs=() 00:13:39.675 16:49:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:39.675 16:49:25 -- nvmf/common.sh@295 -- # e810=() 00:13:39.675 16:49:25 -- nvmf/common.sh@295 -- # local -ga e810 00:13:39.675 16:49:25 -- nvmf/common.sh@296 -- # x722=() 00:13:39.675 16:49:25 -- nvmf/common.sh@296 -- # local -ga x722 00:13:39.675 16:49:25 -- nvmf/common.sh@297 -- # mlx=() 00:13:39.675 16:49:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:39.675 16:49:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:39.675 16:49:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:39.675 16:49:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:39.675 16:49:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:39.675 16:49:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:39.675 16:49:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:39.675 16:49:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:39.675 16:49:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:39.675 16:49:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:39.675 16:49:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:39.675 16:49:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:39.675 16:49:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:39.675 16:49:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:39.675 16:49:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:39.675 16:49:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:39.675 16:49:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:39.675 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:39.675 16:49:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:39.675 16:49:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:39.675 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:39.675 16:49:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:39.675 16:49:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:39.675 16:49:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:39.675 16:49:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:39.675 16:49:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:39.675 16:49:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:39.675 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:39.675 16:49:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:39.675 16:49:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:39.675 16:49:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:39.675 16:49:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:39.675 16:49:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:39.675 16:49:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:39.675 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:39.675 16:49:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:39.675 16:49:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:39.675 16:49:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:39.675 16:49:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:39.675 16:49:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:39.675 16:49:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:39.675 16:49:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:39.675 16:49:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:39.675 16:49:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:39.675 16:49:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:39.675 16:49:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:39.675 16:49:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:39.675 16:49:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:39.675 16:49:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:39.675 16:49:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:39.675 16:49:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:39.675 16:49:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:39.675 16:49:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:39.675 16:49:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:39.675 16:49:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:39.675 16:49:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:39.675 16:49:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:39.934 16:49:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:39.934 16:49:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:39.934 16:49:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:39.934 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:39.934 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.199 ms 00:13:39.934 00:13:39.934 --- 10.0.0.2 ping statistics --- 00:13:39.934 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:39.934 rtt min/avg/max/mdev = 0.199/0.199/0.199/0.000 ms 00:13:39.934 16:49:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:39.934 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:39.934 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.146 ms 00:13:39.934 00:13:39.934 --- 10.0.0.1 ping statistics --- 00:13:39.934 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:39.934 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:13:39.934 16:49:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:39.934 16:49:25 -- nvmf/common.sh@410 -- # return 0 00:13:39.934 16:49:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:39.934 16:49:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:39.934 16:49:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:39.934 16:49:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:39.934 16:49:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:39.934 16:49:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:39.934 16:49:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:39.934 16:49:25 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:39.934 16:49:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:39.934 16:49:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:39.934 16:49:25 -- common/autotest_common.sh@10 -- # set +x 00:13:39.934 16:49:25 -- nvmf/common.sh@469 -- # nvmfpid=1148896 00:13:39.934 16:49:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:39.934 16:49:25 -- nvmf/common.sh@470 -- # waitforlisten 1148896 00:13:39.934 16:49:25 -- common/autotest_common.sh@829 -- # '[' -z 1148896 ']' 00:13:39.934 16:49:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:39.934 16:49:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:39.934 16:49:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:39.934 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:39.934 16:49:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:39.934 16:49:25 -- common/autotest_common.sh@10 -- # set +x 00:13:39.934 [2024-11-16 16:49:25.548152] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:39.934 [2024-11-16 16:49:25.548226] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:39.934 EAL: No free 2048 kB hugepages reported on node 1 00:13:39.934 [2024-11-16 16:49:25.620607] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:40.193 [2024-11-16 16:49:25.714762] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:40.193 [2024-11-16 16:49:25.714936] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:40.193 [2024-11-16 16:49:25.714956] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:40.193 [2024-11-16 16:49:25.714979] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:40.193 [2024-11-16 16:49:25.715037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:40.193 [2024-11-16 16:49:25.715109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:40.193 [2024-11-16 16:49:25.715161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:40.193 [2024-11-16 16:49:25.715164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:41.128 16:49:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:41.128 16:49:26 -- common/autotest_common.sh@862 -- # return 0 00:13:41.128 16:49:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:41.128 16:49:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:41.128 16:49:26 -- common/autotest_common.sh@10 -- # set +x 00:13:41.129 16:49:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:41.129 16:49:26 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:41.129 16:49:26 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode25937 00:13:41.129 [2024-11-16 16:49:26.767943] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:41.129 16:49:26 -- target/invalid.sh@40 -- # out='request: 00:13:41.129 { 00:13:41.129 "nqn": "nqn.2016-06.io.spdk:cnode25937", 00:13:41.129 "tgt_name": "foobar", 00:13:41.129 "method": "nvmf_create_subsystem", 00:13:41.129 "req_id": 1 00:13:41.129 } 00:13:41.129 Got JSON-RPC error response 00:13:41.129 response: 00:13:41.129 { 00:13:41.129 "code": -32603, 00:13:41.129 "message": "Unable to find target foobar" 00:13:41.129 }' 00:13:41.129 16:49:26 -- target/invalid.sh@41 -- # [[ request: 00:13:41.129 { 00:13:41.129 "nqn": "nqn.2016-06.io.spdk:cnode25937", 00:13:41.129 "tgt_name": "foobar", 00:13:41.129 "method": "nvmf_create_subsystem", 00:13:41.129 "req_id": 1 00:13:41.129 } 00:13:41.129 Got JSON-RPC error response 00:13:41.129 response: 00:13:41.129 { 00:13:41.129 "code": -32603, 00:13:41.129 "message": "Unable to find target foobar" 00:13:41.129 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:41.129 16:49:26 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:41.129 16:49:26 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode17661 00:13:41.387 [2024-11-16 16:49:27.016739] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17661: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:41.387 16:49:27 -- target/invalid.sh@45 -- # out='request: 00:13:41.387 { 00:13:41.387 "nqn": "nqn.2016-06.io.spdk:cnode17661", 00:13:41.387 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:41.387 "method": "nvmf_create_subsystem", 00:13:41.387 "req_id": 1 00:13:41.387 } 00:13:41.387 Got JSON-RPC error response 00:13:41.387 response: 00:13:41.387 { 00:13:41.387 "code": -32602, 00:13:41.387 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:41.387 }' 00:13:41.387 16:49:27 -- target/invalid.sh@46 -- # [[ request: 00:13:41.387 { 00:13:41.387 "nqn": "nqn.2016-06.io.spdk:cnode17661", 00:13:41.387 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:41.387 "method": "nvmf_create_subsystem", 00:13:41.387 "req_id": 1 00:13:41.387 } 00:13:41.387 Got JSON-RPC error response 00:13:41.387 response: 00:13:41.387 { 00:13:41.387 "code": -32602, 00:13:41.387 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:41.387 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:41.387 16:49:27 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:41.387 16:49:27 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode31328 00:13:41.646 [2024-11-16 16:49:27.265512] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode31328: invalid model number 'SPDK_Controller' 00:13:41.646 16:49:27 -- target/invalid.sh@50 -- # out='request: 00:13:41.646 { 00:13:41.646 "nqn": "nqn.2016-06.io.spdk:cnode31328", 00:13:41.646 "model_number": "SPDK_Controller\u001f", 00:13:41.646 "method": "nvmf_create_subsystem", 00:13:41.646 "req_id": 1 00:13:41.646 } 00:13:41.646 Got JSON-RPC error response 00:13:41.646 response: 00:13:41.646 { 00:13:41.646 "code": -32602, 00:13:41.646 "message": "Invalid MN SPDK_Controller\u001f" 00:13:41.646 }' 00:13:41.646 16:49:27 -- target/invalid.sh@51 -- # [[ request: 00:13:41.646 { 00:13:41.646 "nqn": "nqn.2016-06.io.spdk:cnode31328", 00:13:41.646 "model_number": "SPDK_Controller\u001f", 00:13:41.646 "method": "nvmf_create_subsystem", 00:13:41.646 "req_id": 1 00:13:41.646 } 00:13:41.646 Got JSON-RPC error response 00:13:41.646 response: 00:13:41.646 { 00:13:41.646 "code": -32602, 00:13:41.646 "message": "Invalid MN SPDK_Controller\u001f" 00:13:41.646 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:41.646 16:49:27 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:41.646 16:49:27 -- target/invalid.sh@19 -- # local length=21 ll 00:13:41.646 16:49:27 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:41.646 16:49:27 -- target/invalid.sh@21 -- # local chars 00:13:41.646 16:49:27 -- target/invalid.sh@22 -- # local string 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # printf %x 79 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # string+=O 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # printf %x 121 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x79' 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # string+=y 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # printf %x 37 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x25' 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # string+=% 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # printf %x 81 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x51' 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # string+=Q 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # printf %x 98 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # string+=b 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # printf %x 70 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # string+=F 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # printf %x 62 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # string+='>' 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # printf %x 69 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x45' 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # string+=E 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # printf %x 93 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # string+=']' 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # printf %x 120 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x78' 00:13:41.646 16:49:27 -- target/invalid.sh@25 -- # string+=x 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.646 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # printf %x 101 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x65' 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # string+=e 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # printf %x 71 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # string+=G 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # printf %x 55 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x37' 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # string+=7 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # printf %x 88 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x58' 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # string+=X 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # printf %x 80 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # string+=P 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # printf %x 46 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # string+=. 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # printf %x 117 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # string+=u 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # printf %x 44 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # string+=, 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # printf %x 67 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x43' 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # string+=C 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # printf %x 88 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x58' 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # string+=X 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # printf %x 111 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:41.647 16:49:27 -- target/invalid.sh@25 -- # string+=o 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.647 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.647 16:49:27 -- target/invalid.sh@28 -- # [[ O == \- ]] 00:13:41.647 16:49:27 -- target/invalid.sh@31 -- # echo 'Oy%QbF>E]xeG7XP.u,CXo' 00:13:41.647 16:49:27 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'Oy%QbF>E]xeG7XP.u,CXo' nqn.2016-06.io.spdk:cnode7441 00:13:41.906 [2024-11-16 16:49:27.638739] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode7441: invalid serial number 'Oy%QbF>E]xeG7XP.u,CXo' 00:13:42.165 16:49:27 -- target/invalid.sh@54 -- # out='request: 00:13:42.165 { 00:13:42.165 "nqn": "nqn.2016-06.io.spdk:cnode7441", 00:13:42.165 "serial_number": "Oy%QbF>E]xeG7XP.u,CXo", 00:13:42.165 "method": "nvmf_create_subsystem", 00:13:42.165 "req_id": 1 00:13:42.165 } 00:13:42.165 Got JSON-RPC error response 00:13:42.165 response: 00:13:42.165 { 00:13:42.165 "code": -32602, 00:13:42.165 "message": "Invalid SN Oy%QbF>E]xeG7XP.u,CXo" 00:13:42.165 }' 00:13:42.165 16:49:27 -- target/invalid.sh@55 -- # [[ request: 00:13:42.165 { 00:13:42.165 "nqn": "nqn.2016-06.io.spdk:cnode7441", 00:13:42.165 "serial_number": "Oy%QbF>E]xeG7XP.u,CXo", 00:13:42.165 "method": "nvmf_create_subsystem", 00:13:42.165 "req_id": 1 00:13:42.165 } 00:13:42.165 Got JSON-RPC error response 00:13:42.165 response: 00:13:42.165 { 00:13:42.165 "code": -32602, 00:13:42.165 "message": "Invalid SN Oy%QbF>E]xeG7XP.u,CXo" 00:13:42.165 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:42.165 16:49:27 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:42.165 16:49:27 -- target/invalid.sh@19 -- # local length=41 ll 00:13:42.165 16:49:27 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:42.165 16:49:27 -- target/invalid.sh@21 -- # local chars 00:13:42.165 16:49:27 -- target/invalid.sh@22 -- # local string 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 54 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+=6 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 56 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x38' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+=8 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 64 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x40' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+=@ 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 35 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x23' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+='#' 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 123 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+='{' 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 114 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x72' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+=r 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 102 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+=f 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 126 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+='~' 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 53 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x35' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+=5 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 109 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+=m 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 48 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x30' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+=0 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 37 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x25' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+=% 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 98 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+=b 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 63 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+='?' 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 124 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+='|' 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 53 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x35' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+=5 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 98 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+=b 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 96 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+='`' 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.165 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # printf %x 107 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:13:42.165 16:49:27 -- target/invalid.sh@25 -- # string+=k 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 66 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x42' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=B 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 82 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=R 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 86 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x56' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=V 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 127 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=$'\177' 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 105 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=i 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 67 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x43' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=C 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 86 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x56' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=V 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 70 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=F 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 43 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=+ 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 118 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x76' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=v 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 49 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x31' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=1 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 116 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x74' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=t 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 104 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x68' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=h 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 69 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x45' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=E 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 60 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+='<' 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 64 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x40' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=@ 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 69 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x45' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=E 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 113 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x71' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=q 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 117 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=u 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 127 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=$'\177' 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 72 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x48' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=H 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # printf %x 49 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # echo -e '\x31' 00:13:42.166 16:49:27 -- target/invalid.sh@25 -- # string+=1 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:42.166 16:49:27 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:42.166 16:49:27 -- target/invalid.sh@28 -- # [[ 6 == \- ]] 00:13:42.166 16:49:27 -- target/invalid.sh@31 -- # echo '68@#{rf~5m0%b?|5b`kBRViCVF+v1thE<@EquH1' 00:13:42.166 16:49:27 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d '68@#{rf~5m0%b?|5b`kBRViCVF+v1thE<@EquH1' nqn.2016-06.io.spdk:cnode7093 00:13:42.425 [2024-11-16 16:49:28.007971] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode7093: invalid model number '68@#{rf~5m0%b?|5b`kBRViCVF+v1thE<@EquH1' 00:13:42.425 16:49:28 -- target/invalid.sh@58 -- # out='request: 00:13:42.425 { 00:13:42.425 "nqn": "nqn.2016-06.io.spdk:cnode7093", 00:13:42.425 "model_number": "68@#{rf~5m0%b?|5b`kBRV\u007fiCVF+v1thE<@Equ\u007fH1", 00:13:42.425 "method": "nvmf_create_subsystem", 00:13:42.425 "req_id": 1 00:13:42.425 } 00:13:42.425 Got JSON-RPC error response 00:13:42.425 response: 00:13:42.425 { 00:13:42.425 "code": -32602, 00:13:42.425 "message": "Invalid MN 68@#{rf~5m0%b?|5b`kBRV\u007fiCVF+v1thE<@Equ\u007fH1" 00:13:42.425 }' 00:13:42.425 16:49:28 -- target/invalid.sh@59 -- # [[ request: 00:13:42.425 { 00:13:42.425 "nqn": "nqn.2016-06.io.spdk:cnode7093", 00:13:42.425 "model_number": "68@#{rf~5m0%b?|5b`kBRV\u007fiCVF+v1thE<@Equ\u007fH1", 00:13:42.425 "method": "nvmf_create_subsystem", 00:13:42.425 "req_id": 1 00:13:42.425 } 00:13:42.425 Got JSON-RPC error response 00:13:42.425 response: 00:13:42.425 { 00:13:42.425 "code": -32602, 00:13:42.425 "message": "Invalid MN 68@#{rf~5m0%b?|5b`kBRV\u007fiCVF+v1thE<@Equ\u007fH1" 00:13:42.425 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:42.425 16:49:28 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:13:42.682 [2024-11-16 16:49:28.252850] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:42.682 16:49:28 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:13:42.940 16:49:28 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:13:42.940 16:49:28 -- target/invalid.sh@67 -- # echo '' 00:13:42.940 16:49:28 -- target/invalid.sh@67 -- # head -n 1 00:13:42.940 16:49:28 -- target/invalid.sh@67 -- # IP= 00:13:42.940 16:49:28 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:13:43.199 [2024-11-16 16:49:28.770623] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:13:43.199 16:49:28 -- target/invalid.sh@69 -- # out='request: 00:13:43.199 { 00:13:43.199 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:43.199 "listen_address": { 00:13:43.199 "trtype": "tcp", 00:13:43.199 "traddr": "", 00:13:43.199 "trsvcid": "4421" 00:13:43.199 }, 00:13:43.199 "method": "nvmf_subsystem_remove_listener", 00:13:43.199 "req_id": 1 00:13:43.199 } 00:13:43.199 Got JSON-RPC error response 00:13:43.199 response: 00:13:43.199 { 00:13:43.199 "code": -32602, 00:13:43.199 "message": "Invalid parameters" 00:13:43.199 }' 00:13:43.199 16:49:28 -- target/invalid.sh@70 -- # [[ request: 00:13:43.199 { 00:13:43.199 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:43.199 "listen_address": { 00:13:43.199 "trtype": "tcp", 00:13:43.199 "traddr": "", 00:13:43.199 "trsvcid": "4421" 00:13:43.199 }, 00:13:43.199 "method": "nvmf_subsystem_remove_listener", 00:13:43.199 "req_id": 1 00:13:43.199 } 00:13:43.199 Got JSON-RPC error response 00:13:43.199 response: 00:13:43.199 { 00:13:43.199 "code": -32602, 00:13:43.199 "message": "Invalid parameters" 00:13:43.199 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:13:43.199 16:49:28 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4464 -i 0 00:13:43.457 [2024-11-16 16:49:29.027439] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode4464: invalid cntlid range [0-65519] 00:13:43.457 16:49:29 -- target/invalid.sh@73 -- # out='request: 00:13:43.457 { 00:13:43.457 "nqn": "nqn.2016-06.io.spdk:cnode4464", 00:13:43.457 "min_cntlid": 0, 00:13:43.457 "method": "nvmf_create_subsystem", 00:13:43.457 "req_id": 1 00:13:43.457 } 00:13:43.457 Got JSON-RPC error response 00:13:43.457 response: 00:13:43.457 { 00:13:43.457 "code": -32602, 00:13:43.457 "message": "Invalid cntlid range [0-65519]" 00:13:43.457 }' 00:13:43.457 16:49:29 -- target/invalid.sh@74 -- # [[ request: 00:13:43.457 { 00:13:43.457 "nqn": "nqn.2016-06.io.spdk:cnode4464", 00:13:43.457 "min_cntlid": 0, 00:13:43.457 "method": "nvmf_create_subsystem", 00:13:43.457 "req_id": 1 00:13:43.457 } 00:13:43.457 Got JSON-RPC error response 00:13:43.457 response: 00:13:43.457 { 00:13:43.457 "code": -32602, 00:13:43.457 "message": "Invalid cntlid range [0-65519]" 00:13:43.457 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:43.457 16:49:29 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode25600 -i 65520 00:13:43.714 [2024-11-16 16:49:29.280333] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25600: invalid cntlid range [65520-65519] 00:13:43.714 16:49:29 -- target/invalid.sh@75 -- # out='request: 00:13:43.714 { 00:13:43.714 "nqn": "nqn.2016-06.io.spdk:cnode25600", 00:13:43.714 "min_cntlid": 65520, 00:13:43.714 "method": "nvmf_create_subsystem", 00:13:43.714 "req_id": 1 00:13:43.714 } 00:13:43.714 Got JSON-RPC error response 00:13:43.714 response: 00:13:43.714 { 00:13:43.714 "code": -32602, 00:13:43.714 "message": "Invalid cntlid range [65520-65519]" 00:13:43.714 }' 00:13:43.714 16:49:29 -- target/invalid.sh@76 -- # [[ request: 00:13:43.714 { 00:13:43.714 "nqn": "nqn.2016-06.io.spdk:cnode25600", 00:13:43.714 "min_cntlid": 65520, 00:13:43.714 "method": "nvmf_create_subsystem", 00:13:43.714 "req_id": 1 00:13:43.714 } 00:13:43.714 Got JSON-RPC error response 00:13:43.714 response: 00:13:43.714 { 00:13:43.714 "code": -32602, 00:13:43.714 "message": "Invalid cntlid range [65520-65519]" 00:13:43.714 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:43.714 16:49:29 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode16960 -I 0 00:13:43.974 [2024-11-16 16:49:29.525139] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16960: invalid cntlid range [1-0] 00:13:43.974 16:49:29 -- target/invalid.sh@77 -- # out='request: 00:13:43.974 { 00:13:43.974 "nqn": "nqn.2016-06.io.spdk:cnode16960", 00:13:43.974 "max_cntlid": 0, 00:13:43.974 "method": "nvmf_create_subsystem", 00:13:43.974 "req_id": 1 00:13:43.974 } 00:13:43.974 Got JSON-RPC error response 00:13:43.974 response: 00:13:43.974 { 00:13:43.974 "code": -32602, 00:13:43.974 "message": "Invalid cntlid range [1-0]" 00:13:43.974 }' 00:13:43.974 16:49:29 -- target/invalid.sh@78 -- # [[ request: 00:13:43.974 { 00:13:43.974 "nqn": "nqn.2016-06.io.spdk:cnode16960", 00:13:43.974 "max_cntlid": 0, 00:13:43.974 "method": "nvmf_create_subsystem", 00:13:43.974 "req_id": 1 00:13:43.974 } 00:13:43.974 Got JSON-RPC error response 00:13:43.974 response: 00:13:43.974 { 00:13:43.974 "code": -32602, 00:13:43.974 "message": "Invalid cntlid range [1-0]" 00:13:43.974 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:43.974 16:49:29 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode31427 -I 65520 00:13:44.274 [2024-11-16 16:49:29.774021] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode31427: invalid cntlid range [1-65520] 00:13:44.274 16:49:29 -- target/invalid.sh@79 -- # out='request: 00:13:44.274 { 00:13:44.274 "nqn": "nqn.2016-06.io.spdk:cnode31427", 00:13:44.274 "max_cntlid": 65520, 00:13:44.274 "method": "nvmf_create_subsystem", 00:13:44.274 "req_id": 1 00:13:44.274 } 00:13:44.274 Got JSON-RPC error response 00:13:44.274 response: 00:13:44.274 { 00:13:44.274 "code": -32602, 00:13:44.274 "message": "Invalid cntlid range [1-65520]" 00:13:44.274 }' 00:13:44.274 16:49:29 -- target/invalid.sh@80 -- # [[ request: 00:13:44.274 { 00:13:44.274 "nqn": "nqn.2016-06.io.spdk:cnode31427", 00:13:44.274 "max_cntlid": 65520, 00:13:44.274 "method": "nvmf_create_subsystem", 00:13:44.274 "req_id": 1 00:13:44.274 } 00:13:44.274 Got JSON-RPC error response 00:13:44.274 response: 00:13:44.274 { 00:13:44.274 "code": -32602, 00:13:44.274 "message": "Invalid cntlid range [1-65520]" 00:13:44.274 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:44.274 16:49:29 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode23145 -i 6 -I 5 00:13:44.557 [2024-11-16 16:49:30.042978] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode23145: invalid cntlid range [6-5] 00:13:44.557 16:49:30 -- target/invalid.sh@83 -- # out='request: 00:13:44.557 { 00:13:44.557 "nqn": "nqn.2016-06.io.spdk:cnode23145", 00:13:44.557 "min_cntlid": 6, 00:13:44.557 "max_cntlid": 5, 00:13:44.557 "method": "nvmf_create_subsystem", 00:13:44.557 "req_id": 1 00:13:44.557 } 00:13:44.557 Got JSON-RPC error response 00:13:44.557 response: 00:13:44.557 { 00:13:44.557 "code": -32602, 00:13:44.557 "message": "Invalid cntlid range [6-5]" 00:13:44.557 }' 00:13:44.557 16:49:30 -- target/invalid.sh@84 -- # [[ request: 00:13:44.557 { 00:13:44.558 "nqn": "nqn.2016-06.io.spdk:cnode23145", 00:13:44.558 "min_cntlid": 6, 00:13:44.558 "max_cntlid": 5, 00:13:44.558 "method": "nvmf_create_subsystem", 00:13:44.558 "req_id": 1 00:13:44.558 } 00:13:44.558 Got JSON-RPC error response 00:13:44.558 response: 00:13:44.558 { 00:13:44.558 "code": -32602, 00:13:44.558 "message": "Invalid cntlid range [6-5]" 00:13:44.558 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:44.558 16:49:30 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:13:44.558 16:49:30 -- target/invalid.sh@87 -- # out='request: 00:13:44.558 { 00:13:44.558 "name": "foobar", 00:13:44.558 "method": "nvmf_delete_target", 00:13:44.558 "req_id": 1 00:13:44.558 } 00:13:44.558 Got JSON-RPC error response 00:13:44.558 response: 00:13:44.558 { 00:13:44.558 "code": -32602, 00:13:44.558 "message": "The specified target doesn'\''t exist, cannot delete it." 00:13:44.558 }' 00:13:44.558 16:49:30 -- target/invalid.sh@88 -- # [[ request: 00:13:44.558 { 00:13:44.558 "name": "foobar", 00:13:44.558 "method": "nvmf_delete_target", 00:13:44.558 "req_id": 1 00:13:44.558 } 00:13:44.558 Got JSON-RPC error response 00:13:44.558 response: 00:13:44.558 { 00:13:44.558 "code": -32602, 00:13:44.558 "message": "The specified target doesn't exist, cannot delete it." 00:13:44.558 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:13:44.558 16:49:30 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:13:44.558 16:49:30 -- target/invalid.sh@91 -- # nvmftestfini 00:13:44.558 16:49:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:44.558 16:49:30 -- nvmf/common.sh@116 -- # sync 00:13:44.558 16:49:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:44.558 16:49:30 -- nvmf/common.sh@119 -- # set +e 00:13:44.558 16:49:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:44.558 16:49:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:44.558 rmmod nvme_tcp 00:13:44.558 rmmod nvme_fabrics 00:13:44.558 rmmod nvme_keyring 00:13:44.558 16:49:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:44.558 16:49:30 -- nvmf/common.sh@123 -- # set -e 00:13:44.558 16:49:30 -- nvmf/common.sh@124 -- # return 0 00:13:44.558 16:49:30 -- nvmf/common.sh@477 -- # '[' -n 1148896 ']' 00:13:44.558 16:49:30 -- nvmf/common.sh@478 -- # killprocess 1148896 00:13:44.558 16:49:30 -- common/autotest_common.sh@936 -- # '[' -z 1148896 ']' 00:13:44.558 16:49:30 -- common/autotest_common.sh@940 -- # kill -0 1148896 00:13:44.558 16:49:30 -- common/autotest_common.sh@941 -- # uname 00:13:44.558 16:49:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:44.558 16:49:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1148896 00:13:44.558 16:49:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:44.558 16:49:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:44.558 16:49:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1148896' 00:13:44.558 killing process with pid 1148896 00:13:44.558 16:49:30 -- common/autotest_common.sh@955 -- # kill 1148896 00:13:44.558 16:49:30 -- common/autotest_common.sh@960 -- # wait 1148896 00:13:44.816 16:49:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:44.816 16:49:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:44.816 16:49:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:44.816 16:49:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:44.816 16:49:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:44.816 16:49:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:44.816 16:49:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:44.816 16:49:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:47.355 16:49:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:47.356 00:13:47.356 real 0m9.319s 00:13:47.356 user 0m23.019s 00:13:47.356 sys 0m2.378s 00:13:47.356 16:49:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:47.356 16:49:32 -- common/autotest_common.sh@10 -- # set +x 00:13:47.356 ************************************ 00:13:47.356 END TEST nvmf_invalid 00:13:47.356 ************************************ 00:13:47.356 16:49:32 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:47.356 16:49:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:47.356 16:49:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:47.356 16:49:32 -- common/autotest_common.sh@10 -- # set +x 00:13:47.356 ************************************ 00:13:47.356 START TEST nvmf_abort 00:13:47.356 ************************************ 00:13:47.356 16:49:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:47.356 * Looking for test storage... 00:13:47.356 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:47.356 16:49:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:47.356 16:49:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:47.356 16:49:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:47.356 16:49:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:47.356 16:49:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:47.356 16:49:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:47.356 16:49:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:47.356 16:49:32 -- scripts/common.sh@335 -- # IFS=.-: 00:13:47.356 16:49:32 -- scripts/common.sh@335 -- # read -ra ver1 00:13:47.356 16:49:32 -- scripts/common.sh@336 -- # IFS=.-: 00:13:47.356 16:49:32 -- scripts/common.sh@336 -- # read -ra ver2 00:13:47.356 16:49:32 -- scripts/common.sh@337 -- # local 'op=<' 00:13:47.356 16:49:32 -- scripts/common.sh@339 -- # ver1_l=2 00:13:47.356 16:49:32 -- scripts/common.sh@340 -- # ver2_l=1 00:13:47.356 16:49:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:47.356 16:49:32 -- scripts/common.sh@343 -- # case "$op" in 00:13:47.356 16:49:32 -- scripts/common.sh@344 -- # : 1 00:13:47.356 16:49:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:47.356 16:49:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:47.356 16:49:32 -- scripts/common.sh@364 -- # decimal 1 00:13:47.356 16:49:32 -- scripts/common.sh@352 -- # local d=1 00:13:47.356 16:49:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:47.356 16:49:32 -- scripts/common.sh@354 -- # echo 1 00:13:47.356 16:49:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:47.356 16:49:32 -- scripts/common.sh@365 -- # decimal 2 00:13:47.356 16:49:32 -- scripts/common.sh@352 -- # local d=2 00:13:47.356 16:49:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:47.356 16:49:32 -- scripts/common.sh@354 -- # echo 2 00:13:47.356 16:49:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:47.356 16:49:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:47.356 16:49:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:47.356 16:49:32 -- scripts/common.sh@367 -- # return 0 00:13:47.356 16:49:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:47.356 16:49:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:47.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:47.356 --rc genhtml_branch_coverage=1 00:13:47.356 --rc genhtml_function_coverage=1 00:13:47.356 --rc genhtml_legend=1 00:13:47.356 --rc geninfo_all_blocks=1 00:13:47.356 --rc geninfo_unexecuted_blocks=1 00:13:47.356 00:13:47.356 ' 00:13:47.356 16:49:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:47.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:47.356 --rc genhtml_branch_coverage=1 00:13:47.356 --rc genhtml_function_coverage=1 00:13:47.356 --rc genhtml_legend=1 00:13:47.356 --rc geninfo_all_blocks=1 00:13:47.356 --rc geninfo_unexecuted_blocks=1 00:13:47.356 00:13:47.356 ' 00:13:47.356 16:49:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:47.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:47.356 --rc genhtml_branch_coverage=1 00:13:47.356 --rc genhtml_function_coverage=1 00:13:47.356 --rc genhtml_legend=1 00:13:47.356 --rc geninfo_all_blocks=1 00:13:47.356 --rc geninfo_unexecuted_blocks=1 00:13:47.356 00:13:47.356 ' 00:13:47.356 16:49:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:47.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:47.356 --rc genhtml_branch_coverage=1 00:13:47.356 --rc genhtml_function_coverage=1 00:13:47.356 --rc genhtml_legend=1 00:13:47.356 --rc geninfo_all_blocks=1 00:13:47.356 --rc geninfo_unexecuted_blocks=1 00:13:47.356 00:13:47.356 ' 00:13:47.356 16:49:32 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:47.356 16:49:32 -- nvmf/common.sh@7 -- # uname -s 00:13:47.356 16:49:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:47.356 16:49:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:47.356 16:49:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:47.356 16:49:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:47.356 16:49:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:47.356 16:49:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:47.356 16:49:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:47.356 16:49:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:47.356 16:49:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:47.356 16:49:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:47.356 16:49:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:47.356 16:49:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:47.356 16:49:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:47.356 16:49:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:47.356 16:49:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:47.356 16:49:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:47.356 16:49:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:47.356 16:49:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:47.356 16:49:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:47.356 16:49:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.356 16:49:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.356 16:49:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.356 16:49:32 -- paths/export.sh@5 -- # export PATH 00:13:47.356 16:49:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.356 16:49:32 -- nvmf/common.sh@46 -- # : 0 00:13:47.356 16:49:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:47.356 16:49:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:47.356 16:49:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:47.356 16:49:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:47.356 16:49:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:47.357 16:49:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:47.357 16:49:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:47.357 16:49:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:47.357 16:49:32 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:47.357 16:49:32 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:47.357 16:49:32 -- target/abort.sh@14 -- # nvmftestinit 00:13:47.357 16:49:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:47.357 16:49:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:47.357 16:49:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:47.357 16:49:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:47.357 16:49:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:47.357 16:49:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:47.357 16:49:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:47.357 16:49:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:47.357 16:49:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:47.357 16:49:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:47.357 16:49:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:47.357 16:49:32 -- common/autotest_common.sh@10 -- # set +x 00:13:49.262 16:49:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:49.262 16:49:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:49.262 16:49:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:49.262 16:49:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:49.262 16:49:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:49.262 16:49:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:49.262 16:49:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:49.262 16:49:34 -- nvmf/common.sh@294 -- # net_devs=() 00:13:49.262 16:49:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:49.262 16:49:34 -- nvmf/common.sh@295 -- # e810=() 00:13:49.262 16:49:34 -- nvmf/common.sh@295 -- # local -ga e810 00:13:49.262 16:49:34 -- nvmf/common.sh@296 -- # x722=() 00:13:49.262 16:49:34 -- nvmf/common.sh@296 -- # local -ga x722 00:13:49.262 16:49:34 -- nvmf/common.sh@297 -- # mlx=() 00:13:49.262 16:49:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:49.262 16:49:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:49.262 16:49:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:49.262 16:49:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:49.262 16:49:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:49.262 16:49:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:49.262 16:49:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:49.262 16:49:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:49.262 16:49:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:49.262 16:49:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:49.262 16:49:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:49.262 16:49:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:49.262 16:49:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:49.262 16:49:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:49.262 16:49:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:49.262 16:49:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:49.262 16:49:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:49.262 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:49.262 16:49:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:49.262 16:49:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:49.262 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:49.262 16:49:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:49.262 16:49:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:49.262 16:49:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:49.262 16:49:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:49.262 16:49:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:49.262 16:49:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:49.262 16:49:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:49.262 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:49.262 16:49:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:49.262 16:49:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:49.262 16:49:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:49.263 16:49:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:49.263 16:49:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:49.263 16:49:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:49.263 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:49.263 16:49:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:49.263 16:49:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:49.263 16:49:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:49.263 16:49:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:49.263 16:49:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:49.263 16:49:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:49.263 16:49:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:49.263 16:49:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:49.263 16:49:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:49.263 16:49:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:49.263 16:49:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:49.263 16:49:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:49.263 16:49:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:49.263 16:49:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:49.263 16:49:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:49.263 16:49:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:49.263 16:49:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:49.263 16:49:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:49.263 16:49:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:49.263 16:49:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:49.263 16:49:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:49.263 16:49:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:49.263 16:49:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:49.263 16:49:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:49.263 16:49:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:49.263 16:49:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:49.263 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:49.263 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:13:49.263 00:13:49.263 --- 10.0.0.2 ping statistics --- 00:13:49.263 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:49.263 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:13:49.263 16:49:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:49.263 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:49.263 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:13:49.263 00:13:49.263 --- 10.0.0.1 ping statistics --- 00:13:49.263 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:49.263 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:13:49.263 16:49:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:49.263 16:49:34 -- nvmf/common.sh@410 -- # return 0 00:13:49.263 16:49:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:49.263 16:49:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:49.263 16:49:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:49.263 16:49:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:49.263 16:49:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:49.263 16:49:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:49.263 16:49:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:49.263 16:49:34 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:49.263 16:49:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:49.263 16:49:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:49.263 16:49:34 -- common/autotest_common.sh@10 -- # set +x 00:13:49.263 16:49:34 -- nvmf/common.sh@469 -- # nvmfpid=1151586 00:13:49.263 16:49:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:49.263 16:49:34 -- nvmf/common.sh@470 -- # waitforlisten 1151586 00:13:49.263 16:49:34 -- common/autotest_common.sh@829 -- # '[' -z 1151586 ']' 00:13:49.263 16:49:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:49.263 16:49:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:49.263 16:49:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:49.263 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:49.263 16:49:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:49.263 16:49:34 -- common/autotest_common.sh@10 -- # set +x 00:13:49.263 [2024-11-16 16:49:34.974009] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:49.263 [2024-11-16 16:49:34.974085] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:49.263 EAL: No free 2048 kB hugepages reported on node 1 00:13:49.524 [2024-11-16 16:49:35.042549] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:49.524 [2024-11-16 16:49:35.134003] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:49.524 [2024-11-16 16:49:35.134173] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:49.524 [2024-11-16 16:49:35.134192] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:49.524 [2024-11-16 16:49:35.134207] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:49.524 [2024-11-16 16:49:35.134293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:49.524 [2024-11-16 16:49:35.134350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:49.524 [2024-11-16 16:49:35.134354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:50.463 16:49:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:50.463 16:49:35 -- common/autotest_common.sh@862 -- # return 0 00:13:50.463 16:49:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:50.463 16:49:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:50.463 16:49:35 -- common/autotest_common.sh@10 -- # set +x 00:13:50.463 16:49:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:50.463 16:49:35 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:50.463 16:49:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.463 16:49:35 -- common/autotest_common.sh@10 -- # set +x 00:13:50.463 [2024-11-16 16:49:35.973571] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:50.463 16:49:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.463 16:49:35 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:50.463 16:49:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.463 16:49:35 -- common/autotest_common.sh@10 -- # set +x 00:13:50.463 Malloc0 00:13:50.463 16:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.463 16:49:36 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:50.463 16:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.463 16:49:36 -- common/autotest_common.sh@10 -- # set +x 00:13:50.463 Delay0 00:13:50.463 16:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.463 16:49:36 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:50.463 16:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.463 16:49:36 -- common/autotest_common.sh@10 -- # set +x 00:13:50.463 16:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.463 16:49:36 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:50.463 16:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.463 16:49:36 -- common/autotest_common.sh@10 -- # set +x 00:13:50.463 16:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.463 16:49:36 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:50.463 16:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.463 16:49:36 -- common/autotest_common.sh@10 -- # set +x 00:13:50.463 [2024-11-16 16:49:36.036383] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:50.463 16:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.463 16:49:36 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:50.463 16:49:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.463 16:49:36 -- common/autotest_common.sh@10 -- # set +x 00:13:50.463 16:49:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.463 16:49:36 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:50.463 EAL: No free 2048 kB hugepages reported on node 1 00:13:50.463 [2024-11-16 16:49:36.172760] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:52.998 Initializing NVMe Controllers 00:13:52.998 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:52.998 controller IO queue size 128 less than required 00:13:52.998 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:52.998 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:52.998 Initialization complete. Launching workers. 00:13:52.998 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 127, failed: 33500 00:13:52.998 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33565, failed to submit 62 00:13:52.998 success 33500, unsuccess 65, failed 0 00:13:52.998 16:49:38 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:52.998 16:49:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:52.998 16:49:38 -- common/autotest_common.sh@10 -- # set +x 00:13:52.998 16:49:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:52.998 16:49:38 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:52.998 16:49:38 -- target/abort.sh@38 -- # nvmftestfini 00:13:52.998 16:49:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:52.998 16:49:38 -- nvmf/common.sh@116 -- # sync 00:13:52.998 16:49:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:52.998 16:49:38 -- nvmf/common.sh@119 -- # set +e 00:13:52.998 16:49:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:52.998 16:49:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:52.998 rmmod nvme_tcp 00:13:52.998 rmmod nvme_fabrics 00:13:52.998 rmmod nvme_keyring 00:13:52.998 16:49:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:52.998 16:49:38 -- nvmf/common.sh@123 -- # set -e 00:13:52.998 16:49:38 -- nvmf/common.sh@124 -- # return 0 00:13:52.998 16:49:38 -- nvmf/common.sh@477 -- # '[' -n 1151586 ']' 00:13:52.998 16:49:38 -- nvmf/common.sh@478 -- # killprocess 1151586 00:13:52.998 16:49:38 -- common/autotest_common.sh@936 -- # '[' -z 1151586 ']' 00:13:52.998 16:49:38 -- common/autotest_common.sh@940 -- # kill -0 1151586 00:13:52.998 16:49:38 -- common/autotest_common.sh@941 -- # uname 00:13:52.998 16:49:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:52.998 16:49:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1151586 00:13:52.998 16:49:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:52.998 16:49:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:52.998 16:49:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1151586' 00:13:52.998 killing process with pid 1151586 00:13:52.998 16:49:38 -- common/autotest_common.sh@955 -- # kill 1151586 00:13:52.998 16:49:38 -- common/autotest_common.sh@960 -- # wait 1151586 00:13:52.998 16:49:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:52.998 16:49:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:52.998 16:49:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:52.998 16:49:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:52.998 16:49:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:52.998 16:49:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.998 16:49:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:52.998 16:49:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:54.906 16:49:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:54.906 00:13:54.906 real 0m8.064s 00:13:54.906 user 0m12.922s 00:13:54.906 sys 0m2.421s 00:13:54.906 16:49:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:54.906 16:49:40 -- common/autotest_common.sh@10 -- # set +x 00:13:54.906 ************************************ 00:13:54.906 END TEST nvmf_abort 00:13:54.906 ************************************ 00:13:54.906 16:49:40 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:54.906 16:49:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:54.906 16:49:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:54.906 16:49:40 -- common/autotest_common.sh@10 -- # set +x 00:13:54.906 ************************************ 00:13:54.906 START TEST nvmf_ns_hotplug_stress 00:13:54.906 ************************************ 00:13:54.906 16:49:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:55.164 * Looking for test storage... 00:13:55.164 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:55.164 16:49:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:55.164 16:49:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:55.164 16:49:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:55.164 16:49:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:55.164 16:49:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:55.164 16:49:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:55.165 16:49:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:55.165 16:49:40 -- scripts/common.sh@335 -- # IFS=.-: 00:13:55.165 16:49:40 -- scripts/common.sh@335 -- # read -ra ver1 00:13:55.165 16:49:40 -- scripts/common.sh@336 -- # IFS=.-: 00:13:55.165 16:49:40 -- scripts/common.sh@336 -- # read -ra ver2 00:13:55.165 16:49:40 -- scripts/common.sh@337 -- # local 'op=<' 00:13:55.165 16:49:40 -- scripts/common.sh@339 -- # ver1_l=2 00:13:55.165 16:49:40 -- scripts/common.sh@340 -- # ver2_l=1 00:13:55.165 16:49:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:55.165 16:49:40 -- scripts/common.sh@343 -- # case "$op" in 00:13:55.165 16:49:40 -- scripts/common.sh@344 -- # : 1 00:13:55.165 16:49:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:55.165 16:49:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:55.165 16:49:40 -- scripts/common.sh@364 -- # decimal 1 00:13:55.165 16:49:40 -- scripts/common.sh@352 -- # local d=1 00:13:55.165 16:49:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:55.165 16:49:40 -- scripts/common.sh@354 -- # echo 1 00:13:55.165 16:49:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:55.165 16:49:40 -- scripts/common.sh@365 -- # decimal 2 00:13:55.165 16:49:40 -- scripts/common.sh@352 -- # local d=2 00:13:55.165 16:49:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:55.165 16:49:40 -- scripts/common.sh@354 -- # echo 2 00:13:55.165 16:49:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:55.165 16:49:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:55.165 16:49:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:55.165 16:49:40 -- scripts/common.sh@367 -- # return 0 00:13:55.165 16:49:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:55.165 16:49:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:55.165 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.165 --rc genhtml_branch_coverage=1 00:13:55.165 --rc genhtml_function_coverage=1 00:13:55.165 --rc genhtml_legend=1 00:13:55.165 --rc geninfo_all_blocks=1 00:13:55.165 --rc geninfo_unexecuted_blocks=1 00:13:55.165 00:13:55.165 ' 00:13:55.165 16:49:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:55.165 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.165 --rc genhtml_branch_coverage=1 00:13:55.165 --rc genhtml_function_coverage=1 00:13:55.165 --rc genhtml_legend=1 00:13:55.165 --rc geninfo_all_blocks=1 00:13:55.165 --rc geninfo_unexecuted_blocks=1 00:13:55.165 00:13:55.165 ' 00:13:55.165 16:49:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:55.165 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.165 --rc genhtml_branch_coverage=1 00:13:55.165 --rc genhtml_function_coverage=1 00:13:55.165 --rc genhtml_legend=1 00:13:55.165 --rc geninfo_all_blocks=1 00:13:55.165 --rc geninfo_unexecuted_blocks=1 00:13:55.165 00:13:55.165 ' 00:13:55.165 16:49:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:55.165 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.165 --rc genhtml_branch_coverage=1 00:13:55.165 --rc genhtml_function_coverage=1 00:13:55.165 --rc genhtml_legend=1 00:13:55.165 --rc geninfo_all_blocks=1 00:13:55.165 --rc geninfo_unexecuted_blocks=1 00:13:55.165 00:13:55.165 ' 00:13:55.165 16:49:40 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:55.165 16:49:40 -- nvmf/common.sh@7 -- # uname -s 00:13:55.165 16:49:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:55.165 16:49:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:55.165 16:49:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:55.165 16:49:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:55.165 16:49:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:55.165 16:49:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:55.165 16:49:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:55.165 16:49:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:55.165 16:49:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:55.165 16:49:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:55.165 16:49:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:55.165 16:49:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:55.165 16:49:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:55.165 16:49:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:55.165 16:49:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:55.165 16:49:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:55.165 16:49:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:55.165 16:49:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:55.165 16:49:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:55.165 16:49:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.165 16:49:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.165 16:49:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.165 16:49:40 -- paths/export.sh@5 -- # export PATH 00:13:55.165 16:49:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.165 16:49:40 -- nvmf/common.sh@46 -- # : 0 00:13:55.165 16:49:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:55.165 16:49:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:55.165 16:49:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:55.166 16:49:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:55.166 16:49:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:55.166 16:49:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:55.166 16:49:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:55.166 16:49:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:55.166 16:49:40 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:55.166 16:49:40 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:13:55.166 16:49:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:55.166 16:49:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:55.166 16:49:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:55.166 16:49:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:55.166 16:49:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:55.166 16:49:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:55.166 16:49:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:55.166 16:49:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:55.166 16:49:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:55.166 16:49:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:55.166 16:49:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:55.166 16:49:40 -- common/autotest_common.sh@10 -- # set +x 00:13:57.693 16:49:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:57.693 16:49:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:57.693 16:49:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:57.693 16:49:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:57.693 16:49:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:57.693 16:49:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:57.693 16:49:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:57.693 16:49:42 -- nvmf/common.sh@294 -- # net_devs=() 00:13:57.693 16:49:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:57.693 16:49:42 -- nvmf/common.sh@295 -- # e810=() 00:13:57.693 16:49:42 -- nvmf/common.sh@295 -- # local -ga e810 00:13:57.693 16:49:42 -- nvmf/common.sh@296 -- # x722=() 00:13:57.693 16:49:42 -- nvmf/common.sh@296 -- # local -ga x722 00:13:57.693 16:49:42 -- nvmf/common.sh@297 -- # mlx=() 00:13:57.693 16:49:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:57.693 16:49:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:57.693 16:49:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:57.693 16:49:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:57.693 16:49:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:57.693 16:49:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:57.693 16:49:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:57.693 16:49:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:57.693 16:49:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:57.693 16:49:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:57.693 16:49:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:57.693 16:49:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:57.693 16:49:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:57.693 16:49:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:57.693 16:49:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:57.693 16:49:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:57.693 16:49:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:57.693 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:57.693 16:49:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:57.693 16:49:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:57.693 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:57.693 16:49:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:57.693 16:49:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:57.693 16:49:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:57.693 16:49:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:57.693 16:49:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:57.693 16:49:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:57.693 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:57.693 16:49:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:57.693 16:49:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:57.693 16:49:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:57.693 16:49:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:57.693 16:49:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:57.693 16:49:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:57.693 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:57.693 16:49:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:57.693 16:49:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:57.693 16:49:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:57.693 16:49:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:57.693 16:49:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:57.693 16:49:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:57.693 16:49:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:57.693 16:49:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:57.693 16:49:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:57.693 16:49:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:57.693 16:49:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:57.693 16:49:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:57.693 16:49:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:57.693 16:49:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:57.693 16:49:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:57.693 16:49:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:57.693 16:49:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:57.693 16:49:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:57.693 16:49:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:57.693 16:49:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:57.693 16:49:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:57.693 16:49:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:57.693 16:49:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:57.693 16:49:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:57.694 16:49:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:57.694 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:57.694 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:13:57.694 00:13:57.694 --- 10.0.0.2 ping statistics --- 00:13:57.694 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:57.694 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:13:57.694 16:49:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:57.694 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:57.694 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:13:57.694 00:13:57.694 --- 10.0.0.1 ping statistics --- 00:13:57.694 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:57.694 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:13:57.694 16:49:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:57.694 16:49:42 -- nvmf/common.sh@410 -- # return 0 00:13:57.694 16:49:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:57.694 16:49:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:57.694 16:49:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:57.694 16:49:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:57.694 16:49:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:57.694 16:49:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:57.694 16:49:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:57.694 16:49:43 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:13:57.694 16:49:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:57.694 16:49:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:57.694 16:49:43 -- common/autotest_common.sh@10 -- # set +x 00:13:57.694 16:49:43 -- nvmf/common.sh@469 -- # nvmfpid=1153969 00:13:57.694 16:49:43 -- nvmf/common.sh@470 -- # waitforlisten 1153969 00:13:57.694 16:49:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:57.694 16:49:43 -- common/autotest_common.sh@829 -- # '[' -z 1153969 ']' 00:13:57.694 16:49:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:57.694 16:49:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:57.694 16:49:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:57.694 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:57.694 16:49:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:57.694 16:49:43 -- common/autotest_common.sh@10 -- # set +x 00:13:57.694 [2024-11-16 16:49:43.063426] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:57.694 [2024-11-16 16:49:43.063494] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:57.694 EAL: No free 2048 kB hugepages reported on node 1 00:13:57.694 [2024-11-16 16:49:43.125373] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:57.694 [2024-11-16 16:49:43.212341] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:57.694 [2024-11-16 16:49:43.212539] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:57.694 [2024-11-16 16:49:43.212557] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:57.694 [2024-11-16 16:49:43.212570] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:57.694 [2024-11-16 16:49:43.212670] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:57.694 [2024-11-16 16:49:43.212722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:57.694 [2024-11-16 16:49:43.212726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:58.630 16:49:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:58.630 16:49:44 -- common/autotest_common.sh@862 -- # return 0 00:13:58.630 16:49:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:58.630 16:49:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:58.630 16:49:44 -- common/autotest_common.sh@10 -- # set +x 00:13:58.630 16:49:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:58.630 16:49:44 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:13:58.630 16:49:44 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:58.630 [2024-11-16 16:49:44.334053] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:58.630 16:49:44 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:58.888 16:49:44 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:59.144 [2024-11-16 16:49:44.840942] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:59.144 16:49:44 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:59.402 16:49:45 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:59.660 Malloc0 00:13:59.661 16:49:45 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:59.918 Delay0 00:13:59.918 16:49:45 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.176 16:49:45 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:14:00.434 NULL1 00:14:00.434 16:49:46 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:00.691 16:49:46 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=1154405 00:14:00.691 16:49:46 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:14:00.691 16:49:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:00.691 16:49:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:00.691 EAL: No free 2048 kB hugepages reported on node 1 00:14:02.069 Read completed with error (sct=0, sc=11) 00:14:02.069 16:49:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:02.069 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.069 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.069 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.069 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.069 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.069 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.069 16:49:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:14:02.069 16:49:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:14:02.327 true 00:14:02.586 16:49:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:02.586 16:49:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.155 16:49:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:03.155 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:03.413 16:49:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:14:03.413 16:49:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:14:03.670 true 00:14:03.670 16:49:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:03.670 16:49:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.928 16:49:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:04.186 16:49:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:14:04.186 16:49:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:14:04.444 true 00:14:04.444 16:49:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:04.444 16:49:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:04.702 16:49:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:04.961 16:49:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:14:04.961 16:49:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:14:05.219 true 00:14:05.219 16:49:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:05.219 16:49:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:06.157 16:49:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:06.415 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:06.415 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:06.415 16:49:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:14:06.415 16:49:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:14:06.673 true 00:14:06.934 16:49:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:06.934 16:49:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.192 16:49:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:07.192 16:49:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:14:07.192 16:49:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:14:07.451 true 00:14:07.451 16:49:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:07.451 16:49:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:08.493 16:49:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:08.753 16:49:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:14:08.753 16:49:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:14:08.753 true 00:14:09.012 16:49:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:09.012 16:49:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.271 16:49:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:09.528 16:49:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:14:09.528 16:49:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:14:09.528 true 00:14:09.788 16:49:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:09.788 16:49:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:10.725 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.725 16:49:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:10.725 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.725 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.725 16:49:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:14:10.725 16:49:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:14:10.983 true 00:14:10.983 16:49:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:10.983 16:49:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:11.240 16:49:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:11.498 16:49:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:14:11.498 16:49:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:14:11.757 true 00:14:11.757 16:49:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:11.757 16:49:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.691 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.691 16:49:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:12.691 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.950 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.950 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.950 16:49:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:14:12.950 16:49:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:14:13.208 true 00:14:13.208 16:49:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:13.208 16:49:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:13.466 16:49:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.724 16:49:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:14:13.724 16:49:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:14:13.981 true 00:14:13.982 16:49:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:13.982 16:49:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.917 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:14.917 16:50:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:15.175 16:50:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:14:15.175 16:50:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:14:15.438 true 00:14:15.438 16:50:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:15.438 16:50:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:15.698 16:50:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:15.956 16:50:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:14:15.956 16:50:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:14:16.214 true 00:14:16.214 16:50:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:16.214 16:50:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.149 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:17.149 16:50:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:17.149 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:17.408 16:50:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:14:17.408 16:50:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:14:17.667 true 00:14:17.667 16:50:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:17.667 16:50:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.926 16:50:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:18.184 16:50:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:14:18.184 16:50:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:14:18.441 true 00:14:18.441 16:50:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:18.441 16:50:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.699 16:50:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:18.957 16:50:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:14:18.957 16:50:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:19.215 true 00:14:19.215 16:50:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:19.215 16:50:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.594 16:50:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:20.594 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:20.594 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:20.594 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:20.853 16:50:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:20.853 16:50:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:20.853 true 00:14:20.853 16:50:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:20.853 16:50:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:21.112 16:50:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:21.370 16:50:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:21.370 16:50:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:21.628 true 00:14:21.628 16:50:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:21.628 16:50:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:22.565 16:50:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:22.565 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.823 16:50:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:22.824 16:50:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:23.082 true 00:14:23.082 16:50:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:23.082 16:50:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.340 16:50:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:23.598 16:50:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:23.598 16:50:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:23.856 true 00:14:23.856 16:50:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:23.856 16:50:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:24.792 16:50:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.050 16:50:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:25.050 16:50:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:25.307 true 00:14:25.307 16:50:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:25.307 16:50:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.565 16:50:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.823 16:50:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:25.823 16:50:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:26.082 true 00:14:26.082 16:50:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:26.082 16:50:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:26.340 16:50:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:26.598 16:50:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:26.598 16:50:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:26.856 true 00:14:26.856 16:50:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:26.856 16:50:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:27.793 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:28.051 16:50:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:28.051 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:28.051 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:28.309 16:50:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:28.309 16:50:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:28.568 true 00:14:28.568 16:50:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:28.568 16:50:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:28.826 16:50:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:29.084 16:50:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:29.084 16:50:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:29.342 true 00:14:29.342 16:50:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:29.342 16:50:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.276 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:30.276 16:50:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:30.276 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:30.276 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:30.276 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:30.276 16:50:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:30.276 16:50:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:30.534 true 00:14:30.534 16:50:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:30.534 16:50:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.792 16:50:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:31.050 Initializing NVMe Controllers 00:14:31.050 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:31.050 Controller IO queue size 128, less than required. 00:14:31.050 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:31.050 Controller IO queue size 128, less than required. 00:14:31.050 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:31.050 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:31.050 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:31.050 Initialization complete. Launching workers. 00:14:31.050 ======================================================== 00:14:31.050 Latency(us) 00:14:31.050 Device Information : IOPS MiB/s Average min max 00:14:31.050 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1077.21 0.53 59124.30 3101.37 1023663.09 00:14:31.050 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11264.89 5.50 11362.34 1592.21 443156.93 00:14:31.050 ======================================================== 00:14:31.050 Total : 12342.09 6.03 15530.96 1592.21 1023663.09 00:14:31.050 00:14:31.050 16:50:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:31.050 16:50:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:31.309 true 00:14:31.309 16:50:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1154405 00:14:31.309 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (1154405) - No such process 00:14:31.309 16:50:17 -- target/ns_hotplug_stress.sh@53 -- # wait 1154405 00:14:31.309 16:50:17 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.566 16:50:17 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:31.823 16:50:17 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:31.823 16:50:17 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:31.823 16:50:17 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:31.823 16:50:17 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:31.823 16:50:17 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:32.081 null0 00:14:32.081 16:50:17 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:32.081 16:50:17 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.081 16:50:17 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:32.339 null1 00:14:32.339 16:50:18 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:32.339 16:50:18 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.339 16:50:18 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:32.597 null2 00:14:32.597 16:50:18 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:32.597 16:50:18 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.597 16:50:18 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:32.855 null3 00:14:32.855 16:50:18 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:32.855 16:50:18 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.855 16:50:18 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:33.113 null4 00:14:33.113 16:50:18 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:33.113 16:50:18 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:33.113 16:50:18 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:33.371 null5 00:14:33.371 16:50:19 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:33.371 16:50:19 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:33.371 16:50:19 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:33.627 null6 00:14:33.627 16:50:19 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:33.627 16:50:19 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:33.627 16:50:19 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:33.885 null7 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.885 16:50:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@66 -- # wait 1158560 1158561 1158563 1158565 1158567 1158569 1158571 1158573 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.886 16:50:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:34.157 16:50:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:34.157 16:50:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:34.157 16:50:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.157 16:50:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:34.157 16:50:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:34.157 16:50:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:34.157 16:50:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:34.157 16:50:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.420 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:34.679 16:50:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:34.679 16:50:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:34.679 16:50:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:34.937 16:50:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.937 16:50:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:34.937 16:50:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:34.937 16:50:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:34.937 16:50:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:35.194 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.194 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.194 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:35.194 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.194 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.194 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:35.194 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.194 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.194 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:35.194 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.194 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.194 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:35.195 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.195 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.195 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:35.195 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.195 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.195 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:35.195 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.195 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.195 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:35.195 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.195 16:50:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.195 16:50:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:35.452 16:50:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:35.453 16:50:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:35.453 16:50:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:35.453 16:50:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:35.453 16:50:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.453 16:50:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:35.453 16:50:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:35.453 16:50:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.710 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:35.968 16:50:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:35.968 16:50:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:35.968 16:50:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:35.968 16:50:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:35.968 16:50:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:35.968 16:50:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:35.968 16:50:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.968 16:50:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.226 16:50:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:36.485 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:36.485 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:36.485 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:36.485 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:36.485 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:36.485 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:36.485 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:36.485 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.743 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:37.002 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:37.002 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:37.002 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:37.002 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:37.002 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.002 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:37.002 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:37.002 16:50:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.260 16:50:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:37.518 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:37.518 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:37.518 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:37.518 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:37.518 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:37.518 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.518 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:37.518 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:37.776 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.776 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.776 16:50:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:37.776 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.776 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.776 16:50:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:37.776 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.776 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.776 16:50:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:37.777 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.777 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.777 16:50:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:38.035 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.035 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.035 16:50:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:38.035 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.035 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.035 16:50:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:38.035 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.035 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.035 16:50:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:38.035 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.035 16:50:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.035 16:50:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:38.293 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:38.293 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:38.293 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:38.293 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:38.293 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:38.293 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:38.293 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:38.293 16:50:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.551 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:38.809 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:38.809 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:38.809 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:38.809 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:38.809 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:38.809 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:38.809 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:38.809 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:39.067 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.067 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.067 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:39.067 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.067 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.068 16:50:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:39.326 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:39.326 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:39.326 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:39.326 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:39.326 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:39.326 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:39.326 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:39.326 16:50:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:39.584 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.584 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.584 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.584 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.584 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.585 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.585 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.585 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.585 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.585 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.585 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.585 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.585 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.585 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.585 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.585 16:50:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.585 16:50:25 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:39.585 16:50:25 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:39.585 16:50:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:39.585 16:50:25 -- nvmf/common.sh@116 -- # sync 00:14:39.585 16:50:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:39.585 16:50:25 -- nvmf/common.sh@119 -- # set +e 00:14:39.585 16:50:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:39.585 16:50:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:39.585 rmmod nvme_tcp 00:14:39.585 rmmod nvme_fabrics 00:14:39.585 rmmod nvme_keyring 00:14:39.585 16:50:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:39.585 16:50:25 -- nvmf/common.sh@123 -- # set -e 00:14:39.585 16:50:25 -- nvmf/common.sh@124 -- # return 0 00:14:39.585 16:50:25 -- nvmf/common.sh@477 -- # '[' -n 1153969 ']' 00:14:39.585 16:50:25 -- nvmf/common.sh@478 -- # killprocess 1153969 00:14:39.585 16:50:25 -- common/autotest_common.sh@936 -- # '[' -z 1153969 ']' 00:14:39.585 16:50:25 -- common/autotest_common.sh@940 -- # kill -0 1153969 00:14:39.585 16:50:25 -- common/autotest_common.sh@941 -- # uname 00:14:39.585 16:50:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:39.585 16:50:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1153969 00:14:39.843 16:50:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:39.843 16:50:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:39.843 16:50:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1153969' 00:14:39.843 killing process with pid 1153969 00:14:39.843 16:50:25 -- common/autotest_common.sh@955 -- # kill 1153969 00:14:39.843 16:50:25 -- common/autotest_common.sh@960 -- # wait 1153969 00:14:39.843 16:50:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:39.844 16:50:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:39.844 16:50:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:39.844 16:50:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:39.844 16:50:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:39.844 16:50:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:39.844 16:50:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:39.844 16:50:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:42.385 16:50:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:42.385 00:14:42.385 real 0m46.955s 00:14:42.385 user 3m35.429s 00:14:42.385 sys 0m15.307s 00:14:42.385 16:50:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:42.385 16:50:27 -- common/autotest_common.sh@10 -- # set +x 00:14:42.385 ************************************ 00:14:42.385 END TEST nvmf_ns_hotplug_stress 00:14:42.385 ************************************ 00:14:42.385 16:50:27 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:42.385 16:50:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:42.385 16:50:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:42.385 16:50:27 -- common/autotest_common.sh@10 -- # set +x 00:14:42.385 ************************************ 00:14:42.385 START TEST nvmf_connect_stress 00:14:42.385 ************************************ 00:14:42.385 16:50:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:42.385 * Looking for test storage... 00:14:42.385 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:42.385 16:50:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:42.385 16:50:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:42.385 16:50:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:42.385 16:50:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:42.385 16:50:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:42.385 16:50:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:42.385 16:50:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:42.385 16:50:27 -- scripts/common.sh@335 -- # IFS=.-: 00:14:42.385 16:50:27 -- scripts/common.sh@335 -- # read -ra ver1 00:14:42.385 16:50:27 -- scripts/common.sh@336 -- # IFS=.-: 00:14:42.385 16:50:27 -- scripts/common.sh@336 -- # read -ra ver2 00:14:42.385 16:50:27 -- scripts/common.sh@337 -- # local 'op=<' 00:14:42.385 16:50:27 -- scripts/common.sh@339 -- # ver1_l=2 00:14:42.385 16:50:27 -- scripts/common.sh@340 -- # ver2_l=1 00:14:42.385 16:50:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:42.385 16:50:27 -- scripts/common.sh@343 -- # case "$op" in 00:14:42.385 16:50:27 -- scripts/common.sh@344 -- # : 1 00:14:42.385 16:50:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:42.385 16:50:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:42.385 16:50:27 -- scripts/common.sh@364 -- # decimal 1 00:14:42.385 16:50:27 -- scripts/common.sh@352 -- # local d=1 00:14:42.385 16:50:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:42.385 16:50:27 -- scripts/common.sh@354 -- # echo 1 00:14:42.385 16:50:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:42.385 16:50:27 -- scripts/common.sh@365 -- # decimal 2 00:14:42.385 16:50:27 -- scripts/common.sh@352 -- # local d=2 00:14:42.385 16:50:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:42.385 16:50:27 -- scripts/common.sh@354 -- # echo 2 00:14:42.385 16:50:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:42.385 16:50:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:42.385 16:50:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:42.385 16:50:27 -- scripts/common.sh@367 -- # return 0 00:14:42.385 16:50:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:42.385 16:50:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:42.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.385 --rc genhtml_branch_coverage=1 00:14:42.385 --rc genhtml_function_coverage=1 00:14:42.385 --rc genhtml_legend=1 00:14:42.385 --rc geninfo_all_blocks=1 00:14:42.385 --rc geninfo_unexecuted_blocks=1 00:14:42.385 00:14:42.385 ' 00:14:42.385 16:50:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:42.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.385 --rc genhtml_branch_coverage=1 00:14:42.385 --rc genhtml_function_coverage=1 00:14:42.385 --rc genhtml_legend=1 00:14:42.385 --rc geninfo_all_blocks=1 00:14:42.385 --rc geninfo_unexecuted_blocks=1 00:14:42.385 00:14:42.385 ' 00:14:42.385 16:50:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:42.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.385 --rc genhtml_branch_coverage=1 00:14:42.385 --rc genhtml_function_coverage=1 00:14:42.385 --rc genhtml_legend=1 00:14:42.385 --rc geninfo_all_blocks=1 00:14:42.385 --rc geninfo_unexecuted_blocks=1 00:14:42.385 00:14:42.385 ' 00:14:42.385 16:50:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:42.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.385 --rc genhtml_branch_coverage=1 00:14:42.385 --rc genhtml_function_coverage=1 00:14:42.385 --rc genhtml_legend=1 00:14:42.385 --rc geninfo_all_blocks=1 00:14:42.385 --rc geninfo_unexecuted_blocks=1 00:14:42.385 00:14:42.385 ' 00:14:42.385 16:50:27 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:42.385 16:50:27 -- nvmf/common.sh@7 -- # uname -s 00:14:42.386 16:50:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:42.386 16:50:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:42.386 16:50:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:42.386 16:50:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:42.386 16:50:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:42.386 16:50:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:42.386 16:50:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:42.386 16:50:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:42.386 16:50:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:42.386 16:50:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:42.386 16:50:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:42.386 16:50:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:42.386 16:50:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:42.386 16:50:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:42.386 16:50:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:42.386 16:50:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:42.386 16:50:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:42.386 16:50:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:42.386 16:50:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:42.386 16:50:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.386 16:50:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.386 16:50:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.386 16:50:27 -- paths/export.sh@5 -- # export PATH 00:14:42.386 16:50:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.386 16:50:27 -- nvmf/common.sh@46 -- # : 0 00:14:42.386 16:50:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:42.386 16:50:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:42.386 16:50:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:42.386 16:50:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:42.386 16:50:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:42.386 16:50:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:42.386 16:50:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:42.386 16:50:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:42.386 16:50:27 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:42.386 16:50:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:42.386 16:50:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:42.386 16:50:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:42.386 16:50:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:42.386 16:50:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:42.386 16:50:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:42.386 16:50:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:42.386 16:50:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:42.386 16:50:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:42.386 16:50:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:42.386 16:50:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:42.386 16:50:27 -- common/autotest_common.sh@10 -- # set +x 00:14:44.295 16:50:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:44.295 16:50:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:44.295 16:50:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:44.295 16:50:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:44.295 16:50:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:44.295 16:50:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:44.295 16:50:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:44.295 16:50:29 -- nvmf/common.sh@294 -- # net_devs=() 00:14:44.295 16:50:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:44.295 16:50:29 -- nvmf/common.sh@295 -- # e810=() 00:14:44.295 16:50:29 -- nvmf/common.sh@295 -- # local -ga e810 00:14:44.295 16:50:29 -- nvmf/common.sh@296 -- # x722=() 00:14:44.295 16:50:29 -- nvmf/common.sh@296 -- # local -ga x722 00:14:44.295 16:50:29 -- nvmf/common.sh@297 -- # mlx=() 00:14:44.295 16:50:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:44.295 16:50:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:44.295 16:50:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:44.295 16:50:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:44.295 16:50:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:44.295 16:50:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:44.295 16:50:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:44.295 16:50:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:44.295 16:50:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:44.295 16:50:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:44.295 16:50:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:44.295 16:50:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:44.295 16:50:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:44.295 16:50:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:44.295 16:50:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:44.295 16:50:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:44.295 16:50:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:44.295 16:50:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:44.295 16:50:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:44.295 16:50:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:44.295 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:44.295 16:50:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:44.295 16:50:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:44.295 16:50:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:44.295 16:50:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:44.295 16:50:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:44.295 16:50:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:44.295 16:50:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:44.295 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:44.295 16:50:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:44.295 16:50:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:44.295 16:50:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:44.296 16:50:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:44.296 16:50:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:44.296 16:50:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:44.296 16:50:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:44.296 16:50:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:44.296 16:50:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:44.296 16:50:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:44.296 16:50:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:44.296 16:50:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:44.296 16:50:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:44.296 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:44.296 16:50:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:44.296 16:50:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:44.296 16:50:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:44.296 16:50:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:44.296 16:50:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:44.296 16:50:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:44.296 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:44.296 16:50:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:44.296 16:50:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:44.296 16:50:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:44.296 16:50:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:44.296 16:50:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:44.296 16:50:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:44.296 16:50:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:44.296 16:50:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:44.296 16:50:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:44.296 16:50:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:44.296 16:50:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:44.296 16:50:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:44.296 16:50:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:44.296 16:50:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:44.296 16:50:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:44.296 16:50:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:44.296 16:50:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:44.296 16:50:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:44.296 16:50:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:44.296 16:50:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:44.296 16:50:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:44.296 16:50:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:44.296 16:50:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:44.296 16:50:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:44.296 16:50:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:44.296 16:50:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:44.296 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:44.296 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.171 ms 00:14:44.296 00:14:44.296 --- 10.0.0.2 ping statistics --- 00:14:44.296 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:44.296 rtt min/avg/max/mdev = 0.171/0.171/0.171/0.000 ms 00:14:44.296 16:50:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:44.296 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:44.296 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:14:44.296 00:14:44.296 --- 10.0.0.1 ping statistics --- 00:14:44.296 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:44.296 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:14:44.296 16:50:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:44.296 16:50:29 -- nvmf/common.sh@410 -- # return 0 00:14:44.296 16:50:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:44.296 16:50:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:44.296 16:50:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:44.296 16:50:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:44.296 16:50:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:44.296 16:50:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:44.296 16:50:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:44.296 16:50:29 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:44.296 16:50:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:44.296 16:50:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:44.296 16:50:29 -- common/autotest_common.sh@10 -- # set +x 00:14:44.296 16:50:29 -- nvmf/common.sh@469 -- # nvmfpid=1161355 00:14:44.296 16:50:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:44.296 16:50:29 -- nvmf/common.sh@470 -- # waitforlisten 1161355 00:14:44.296 16:50:29 -- common/autotest_common.sh@829 -- # '[' -z 1161355 ']' 00:14:44.296 16:50:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:44.296 16:50:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:44.296 16:50:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:44.296 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:44.296 16:50:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:44.296 16:50:29 -- common/autotest_common.sh@10 -- # set +x 00:14:44.296 [2024-11-16 16:50:29.963560] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:44.296 [2024-11-16 16:50:29.963668] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:44.296 EAL: No free 2048 kB hugepages reported on node 1 00:14:44.296 [2024-11-16 16:50:30.032854] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:44.557 [2024-11-16 16:50:30.123743] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:44.557 [2024-11-16 16:50:30.123911] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:44.557 [2024-11-16 16:50:30.123931] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:44.557 [2024-11-16 16:50:30.123957] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:44.557 [2024-11-16 16:50:30.124065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:44.557 [2024-11-16 16:50:30.124119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:44.557 [2024-11-16 16:50:30.124122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:45.497 16:50:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:45.497 16:50:30 -- common/autotest_common.sh@862 -- # return 0 00:14:45.497 16:50:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:45.497 16:50:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:45.497 16:50:30 -- common/autotest_common.sh@10 -- # set +x 00:14:45.497 16:50:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:45.497 16:50:30 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:45.497 16:50:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.497 16:50:30 -- common/autotest_common.sh@10 -- # set +x 00:14:45.497 [2024-11-16 16:50:30.964278] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:45.497 16:50:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.497 16:50:30 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:45.497 16:50:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.497 16:50:30 -- common/autotest_common.sh@10 -- # set +x 00:14:45.497 16:50:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.497 16:50:30 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:45.497 16:50:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.497 16:50:30 -- common/autotest_common.sh@10 -- # set +x 00:14:45.497 [2024-11-16 16:50:30.992774] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:45.497 16:50:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.497 16:50:30 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:45.497 16:50:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.497 16:50:30 -- common/autotest_common.sh@10 -- # set +x 00:14:45.497 NULL1 00:14:45.497 16:50:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.497 16:50:31 -- target/connect_stress.sh@21 -- # PERF_PID=1161515 00:14:45.497 16:50:31 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:45.497 16:50:31 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:45.497 16:50:31 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 EAL: No free 2048 kB hugepages reported on node 1 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.497 16:50:31 -- target/connect_stress.sh@28 -- # cat 00:14:45.497 16:50:31 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:45.497 16:50:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.497 16:50:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.497 16:50:31 -- common/autotest_common.sh@10 -- # set +x 00:14:45.758 16:50:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.758 16:50:31 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:45.758 16:50:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.758 16:50:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.758 16:50:31 -- common/autotest_common.sh@10 -- # set +x 00:14:46.018 16:50:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.018 16:50:31 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:46.018 16:50:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.018 16:50:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.018 16:50:31 -- common/autotest_common.sh@10 -- # set +x 00:14:46.279 16:50:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.279 16:50:32 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:46.279 16:50:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.279 16:50:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.279 16:50:32 -- common/autotest_common.sh@10 -- # set +x 00:14:46.848 16:50:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.848 16:50:32 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:46.848 16:50:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.848 16:50:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.848 16:50:32 -- common/autotest_common.sh@10 -- # set +x 00:14:47.109 16:50:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.109 16:50:32 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:47.109 16:50:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.109 16:50:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.109 16:50:32 -- common/autotest_common.sh@10 -- # set +x 00:14:47.371 16:50:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.371 16:50:32 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:47.371 16:50:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.371 16:50:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.371 16:50:32 -- common/autotest_common.sh@10 -- # set +x 00:14:47.632 16:50:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.632 16:50:33 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:47.632 16:50:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.632 16:50:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.632 16:50:33 -- common/autotest_common.sh@10 -- # set +x 00:14:47.891 16:50:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.891 16:50:33 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:47.891 16:50:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.891 16:50:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.891 16:50:33 -- common/autotest_common.sh@10 -- # set +x 00:14:48.483 16:50:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.483 16:50:33 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:48.483 16:50:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.483 16:50:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.483 16:50:33 -- common/autotest_common.sh@10 -- # set +x 00:14:48.781 16:50:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.781 16:50:34 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:48.781 16:50:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.781 16:50:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.781 16:50:34 -- common/autotest_common.sh@10 -- # set +x 00:14:49.074 16:50:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.074 16:50:34 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:49.074 16:50:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.074 16:50:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.074 16:50:34 -- common/autotest_common.sh@10 -- # set +x 00:14:49.334 16:50:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.334 16:50:34 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:49.334 16:50:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.334 16:50:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.334 16:50:34 -- common/autotest_common.sh@10 -- # set +x 00:14:49.593 16:50:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.593 16:50:35 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:49.593 16:50:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.593 16:50:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.593 16:50:35 -- common/autotest_common.sh@10 -- # set +x 00:14:49.851 16:50:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.851 16:50:35 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:49.851 16:50:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.851 16:50:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.851 16:50:35 -- common/autotest_common.sh@10 -- # set +x 00:14:50.420 16:50:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.420 16:50:35 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:50.420 16:50:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.420 16:50:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.420 16:50:35 -- common/autotest_common.sh@10 -- # set +x 00:14:50.679 16:50:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.679 16:50:36 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:50.679 16:50:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.679 16:50:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.679 16:50:36 -- common/autotest_common.sh@10 -- # set +x 00:14:50.939 16:50:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.939 16:50:36 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:50.939 16:50:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.939 16:50:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.939 16:50:36 -- common/autotest_common.sh@10 -- # set +x 00:14:51.199 16:50:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.199 16:50:36 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:51.199 16:50:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:51.199 16:50:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.199 16:50:36 -- common/autotest_common.sh@10 -- # set +x 00:14:51.457 16:50:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.457 16:50:37 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:51.457 16:50:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:51.458 16:50:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.458 16:50:37 -- common/autotest_common.sh@10 -- # set +x 00:14:52.024 16:50:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.024 16:50:37 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:52.024 16:50:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.024 16:50:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.024 16:50:37 -- common/autotest_common.sh@10 -- # set +x 00:14:52.282 16:50:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.282 16:50:37 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:52.282 16:50:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.282 16:50:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.282 16:50:37 -- common/autotest_common.sh@10 -- # set +x 00:14:52.543 16:50:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.543 16:50:38 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:52.543 16:50:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.543 16:50:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.543 16:50:38 -- common/autotest_common.sh@10 -- # set +x 00:14:52.801 16:50:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.802 16:50:38 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:52.802 16:50:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.802 16:50:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.802 16:50:38 -- common/autotest_common.sh@10 -- # set +x 00:14:53.061 16:50:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.061 16:50:38 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:53.061 16:50:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.061 16:50:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.061 16:50:38 -- common/autotest_common.sh@10 -- # set +x 00:14:53.633 16:50:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.633 16:50:39 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:53.633 16:50:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.633 16:50:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.633 16:50:39 -- common/autotest_common.sh@10 -- # set +x 00:14:53.894 16:50:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.894 16:50:39 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:53.894 16:50:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.894 16:50:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.894 16:50:39 -- common/autotest_common.sh@10 -- # set +x 00:14:54.153 16:50:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.153 16:50:39 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:54.153 16:50:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:54.153 16:50:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.153 16:50:39 -- common/autotest_common.sh@10 -- # set +x 00:14:54.414 16:50:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.414 16:50:40 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:54.414 16:50:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:54.414 16:50:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.414 16:50:40 -- common/autotest_common.sh@10 -- # set +x 00:14:54.673 16:50:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.673 16:50:40 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:54.673 16:50:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:54.673 16:50:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.673 16:50:40 -- common/autotest_common.sh@10 -- # set +x 00:14:55.240 16:50:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.240 16:50:40 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:55.240 16:50:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:55.240 16:50:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.240 16:50:40 -- common/autotest_common.sh@10 -- # set +x 00:14:55.499 16:50:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.499 16:50:41 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:55.499 16:50:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:55.499 16:50:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.499 16:50:41 -- common/autotest_common.sh@10 -- # set +x 00:14:55.499 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:55.759 16:50:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.759 16:50:41 -- target/connect_stress.sh@34 -- # kill -0 1161515 00:14:55.759 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1161515) - No such process 00:14:55.759 16:50:41 -- target/connect_stress.sh@38 -- # wait 1161515 00:14:55.759 16:50:41 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:55.759 16:50:41 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:55.759 16:50:41 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:55.759 16:50:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:55.759 16:50:41 -- nvmf/common.sh@116 -- # sync 00:14:55.759 16:50:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:55.759 16:50:41 -- nvmf/common.sh@119 -- # set +e 00:14:55.759 16:50:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:55.759 16:50:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:55.759 rmmod nvme_tcp 00:14:55.759 rmmod nvme_fabrics 00:14:55.759 rmmod nvme_keyring 00:14:55.759 16:50:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:55.759 16:50:41 -- nvmf/common.sh@123 -- # set -e 00:14:55.759 16:50:41 -- nvmf/common.sh@124 -- # return 0 00:14:55.759 16:50:41 -- nvmf/common.sh@477 -- # '[' -n 1161355 ']' 00:14:55.759 16:50:41 -- nvmf/common.sh@478 -- # killprocess 1161355 00:14:55.759 16:50:41 -- common/autotest_common.sh@936 -- # '[' -z 1161355 ']' 00:14:55.759 16:50:41 -- common/autotest_common.sh@940 -- # kill -0 1161355 00:14:55.759 16:50:41 -- common/autotest_common.sh@941 -- # uname 00:14:55.759 16:50:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:55.759 16:50:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1161355 00:14:55.759 16:50:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:55.759 16:50:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:55.759 16:50:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1161355' 00:14:55.759 killing process with pid 1161355 00:14:55.759 16:50:41 -- common/autotest_common.sh@955 -- # kill 1161355 00:14:55.759 16:50:41 -- common/autotest_common.sh@960 -- # wait 1161355 00:14:56.017 16:50:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:56.017 16:50:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:56.017 16:50:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:56.017 16:50:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:56.017 16:50:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:56.017 16:50:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:56.017 16:50:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:56.017 16:50:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:58.550 16:50:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:58.550 00:14:58.550 real 0m16.077s 00:14:58.550 user 0m40.664s 00:14:58.550 sys 0m5.775s 00:14:58.550 16:50:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:58.550 16:50:43 -- common/autotest_common.sh@10 -- # set +x 00:14:58.550 ************************************ 00:14:58.550 END TEST nvmf_connect_stress 00:14:58.550 ************************************ 00:14:58.550 16:50:43 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:58.550 16:50:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:58.550 16:50:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:58.550 16:50:43 -- common/autotest_common.sh@10 -- # set +x 00:14:58.550 ************************************ 00:14:58.550 START TEST nvmf_fused_ordering 00:14:58.550 ************************************ 00:14:58.550 16:50:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:58.550 * Looking for test storage... 00:14:58.550 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:58.550 16:50:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:58.550 16:50:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:58.550 16:50:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:58.550 16:50:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:58.550 16:50:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:58.550 16:50:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:58.550 16:50:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:58.550 16:50:43 -- scripts/common.sh@335 -- # IFS=.-: 00:14:58.550 16:50:43 -- scripts/common.sh@335 -- # read -ra ver1 00:14:58.550 16:50:43 -- scripts/common.sh@336 -- # IFS=.-: 00:14:58.550 16:50:43 -- scripts/common.sh@336 -- # read -ra ver2 00:14:58.550 16:50:43 -- scripts/common.sh@337 -- # local 'op=<' 00:14:58.550 16:50:43 -- scripts/common.sh@339 -- # ver1_l=2 00:14:58.550 16:50:43 -- scripts/common.sh@340 -- # ver2_l=1 00:14:58.550 16:50:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:58.550 16:50:43 -- scripts/common.sh@343 -- # case "$op" in 00:14:58.550 16:50:43 -- scripts/common.sh@344 -- # : 1 00:14:58.550 16:50:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:58.550 16:50:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:58.550 16:50:43 -- scripts/common.sh@364 -- # decimal 1 00:14:58.550 16:50:43 -- scripts/common.sh@352 -- # local d=1 00:14:58.550 16:50:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:58.550 16:50:43 -- scripts/common.sh@354 -- # echo 1 00:14:58.550 16:50:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:58.550 16:50:43 -- scripts/common.sh@365 -- # decimal 2 00:14:58.550 16:50:43 -- scripts/common.sh@352 -- # local d=2 00:14:58.550 16:50:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:58.550 16:50:43 -- scripts/common.sh@354 -- # echo 2 00:14:58.550 16:50:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:58.550 16:50:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:58.550 16:50:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:58.550 16:50:43 -- scripts/common.sh@367 -- # return 0 00:14:58.550 16:50:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:58.550 16:50:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:58.550 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.550 --rc genhtml_branch_coverage=1 00:14:58.550 --rc genhtml_function_coverage=1 00:14:58.550 --rc genhtml_legend=1 00:14:58.550 --rc geninfo_all_blocks=1 00:14:58.550 --rc geninfo_unexecuted_blocks=1 00:14:58.550 00:14:58.550 ' 00:14:58.550 16:50:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:58.550 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.550 --rc genhtml_branch_coverage=1 00:14:58.550 --rc genhtml_function_coverage=1 00:14:58.550 --rc genhtml_legend=1 00:14:58.550 --rc geninfo_all_blocks=1 00:14:58.550 --rc geninfo_unexecuted_blocks=1 00:14:58.550 00:14:58.550 ' 00:14:58.550 16:50:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:58.550 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.550 --rc genhtml_branch_coverage=1 00:14:58.550 --rc genhtml_function_coverage=1 00:14:58.550 --rc genhtml_legend=1 00:14:58.550 --rc geninfo_all_blocks=1 00:14:58.550 --rc geninfo_unexecuted_blocks=1 00:14:58.550 00:14:58.550 ' 00:14:58.550 16:50:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:58.550 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.550 --rc genhtml_branch_coverage=1 00:14:58.550 --rc genhtml_function_coverage=1 00:14:58.550 --rc genhtml_legend=1 00:14:58.550 --rc geninfo_all_blocks=1 00:14:58.550 --rc geninfo_unexecuted_blocks=1 00:14:58.550 00:14:58.550 ' 00:14:58.550 16:50:43 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:58.550 16:50:43 -- nvmf/common.sh@7 -- # uname -s 00:14:58.550 16:50:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:58.550 16:50:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:58.550 16:50:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:58.550 16:50:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:58.550 16:50:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:58.550 16:50:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:58.550 16:50:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:58.550 16:50:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:58.550 16:50:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:58.550 16:50:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:58.550 16:50:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:58.550 16:50:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:58.550 16:50:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:58.550 16:50:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:58.550 16:50:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:58.550 16:50:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:58.550 16:50:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:58.550 16:50:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:58.550 16:50:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:58.550 16:50:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.550 16:50:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.550 16:50:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.550 16:50:43 -- paths/export.sh@5 -- # export PATH 00:14:58.550 16:50:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.550 16:50:43 -- nvmf/common.sh@46 -- # : 0 00:14:58.550 16:50:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:58.551 16:50:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:58.551 16:50:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:58.551 16:50:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:58.551 16:50:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:58.551 16:50:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:58.551 16:50:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:58.551 16:50:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:58.551 16:50:43 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:58.551 16:50:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:58.551 16:50:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:58.551 16:50:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:58.551 16:50:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:58.551 16:50:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:58.551 16:50:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:58.551 16:50:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:58.551 16:50:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:58.551 16:50:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:58.551 16:50:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:58.551 16:50:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:58.551 16:50:43 -- common/autotest_common.sh@10 -- # set +x 00:15:00.453 16:50:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:00.453 16:50:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:00.453 16:50:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:00.453 16:50:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:00.453 16:50:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:00.453 16:50:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:00.453 16:50:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:00.453 16:50:45 -- nvmf/common.sh@294 -- # net_devs=() 00:15:00.453 16:50:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:00.453 16:50:45 -- nvmf/common.sh@295 -- # e810=() 00:15:00.453 16:50:45 -- nvmf/common.sh@295 -- # local -ga e810 00:15:00.453 16:50:45 -- nvmf/common.sh@296 -- # x722=() 00:15:00.453 16:50:45 -- nvmf/common.sh@296 -- # local -ga x722 00:15:00.453 16:50:45 -- nvmf/common.sh@297 -- # mlx=() 00:15:00.453 16:50:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:00.453 16:50:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:00.453 16:50:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:00.453 16:50:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:00.453 16:50:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:00.453 16:50:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:00.453 16:50:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:00.453 16:50:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:00.453 16:50:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:00.453 16:50:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:00.453 16:50:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:00.453 16:50:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:00.453 16:50:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:00.453 16:50:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:00.453 16:50:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:00.453 16:50:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:00.453 16:50:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:00.453 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:00.453 16:50:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:00.453 16:50:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:00.453 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:00.453 16:50:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:00.453 16:50:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:00.453 16:50:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:00.453 16:50:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:00.453 16:50:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:00.453 16:50:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:00.453 16:50:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:00.453 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:00.453 16:50:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:00.453 16:50:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:00.453 16:50:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:00.453 16:50:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:00.454 16:50:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:00.454 16:50:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:00.454 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:00.454 16:50:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:00.454 16:50:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:00.454 16:50:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:00.454 16:50:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:00.454 16:50:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:00.454 16:50:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:00.454 16:50:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:00.454 16:50:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:00.454 16:50:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:00.454 16:50:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:00.454 16:50:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:00.454 16:50:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:00.454 16:50:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:00.454 16:50:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:00.454 16:50:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:00.454 16:50:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:00.454 16:50:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:00.454 16:50:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:00.454 16:50:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:00.454 16:50:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:00.454 16:50:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:00.454 16:50:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:00.454 16:50:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:00.454 16:50:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:00.454 16:50:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:00.454 16:50:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:00.454 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:00.454 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:15:00.454 00:15:00.454 --- 10.0.0.2 ping statistics --- 00:15:00.454 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:00.454 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:15:00.454 16:50:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:00.454 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:00.454 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:15:00.454 00:15:00.454 --- 10.0.0.1 ping statistics --- 00:15:00.454 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:00.454 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:15:00.454 16:50:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:00.454 16:50:46 -- nvmf/common.sh@410 -- # return 0 00:15:00.454 16:50:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:00.454 16:50:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:00.454 16:50:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:00.454 16:50:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:00.454 16:50:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:00.454 16:50:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:00.454 16:50:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:00.454 16:50:46 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:15:00.454 16:50:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:00.454 16:50:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:00.454 16:50:46 -- common/autotest_common.sh@10 -- # set +x 00:15:00.454 16:50:46 -- nvmf/common.sh@469 -- # nvmfpid=1164720 00:15:00.454 16:50:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:00.454 16:50:46 -- nvmf/common.sh@470 -- # waitforlisten 1164720 00:15:00.454 16:50:46 -- common/autotest_common.sh@829 -- # '[' -z 1164720 ']' 00:15:00.454 16:50:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:00.454 16:50:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:00.454 16:50:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:00.454 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:00.454 16:50:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:00.454 16:50:46 -- common/autotest_common.sh@10 -- # set +x 00:15:00.454 [2024-11-16 16:50:46.093976] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:00.454 [2024-11-16 16:50:46.094052] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:00.454 EAL: No free 2048 kB hugepages reported on node 1 00:15:00.454 [2024-11-16 16:50:46.156210] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:00.713 [2024-11-16 16:50:46.241221] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:00.713 [2024-11-16 16:50:46.241394] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:00.713 [2024-11-16 16:50:46.241411] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:00.713 [2024-11-16 16:50:46.241433] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:00.713 [2024-11-16 16:50:46.241459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:01.652 16:50:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:01.652 16:50:47 -- common/autotest_common.sh@862 -- # return 0 00:15:01.652 16:50:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:01.652 16:50:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:01.652 16:50:47 -- common/autotest_common.sh@10 -- # set +x 00:15:01.652 16:50:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:01.652 16:50:47 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:01.652 16:50:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.652 16:50:47 -- common/autotest_common.sh@10 -- # set +x 00:15:01.652 [2024-11-16 16:50:47.086690] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:01.652 16:50:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.652 16:50:47 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:01.652 16:50:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.652 16:50:47 -- common/autotest_common.sh@10 -- # set +x 00:15:01.652 16:50:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.652 16:50:47 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:01.652 16:50:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.652 16:50:47 -- common/autotest_common.sh@10 -- # set +x 00:15:01.652 [2024-11-16 16:50:47.102904] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:01.652 16:50:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.652 16:50:47 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:01.652 16:50:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.652 16:50:47 -- common/autotest_common.sh@10 -- # set +x 00:15:01.652 NULL1 00:15:01.652 16:50:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.652 16:50:47 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:15:01.652 16:50:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.652 16:50:47 -- common/autotest_common.sh@10 -- # set +x 00:15:01.652 16:50:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.652 16:50:47 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:01.652 16:50:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.652 16:50:47 -- common/autotest_common.sh@10 -- # set +x 00:15:01.652 16:50:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.652 16:50:47 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:15:01.652 [2024-11-16 16:50:47.147079] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:01.652 [2024-11-16 16:50:47.147118] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1164873 ] 00:15:01.652 EAL: No free 2048 kB hugepages reported on node 1 00:15:01.911 Attached to nqn.2016-06.io.spdk:cnode1 00:15:01.911 Namespace ID: 1 size: 1GB 00:15:01.911 fused_ordering(0) 00:15:01.911 fused_ordering(1) 00:15:01.911 fused_ordering(2) 00:15:01.911 fused_ordering(3) 00:15:01.911 fused_ordering(4) 00:15:01.911 fused_ordering(5) 00:15:01.911 fused_ordering(6) 00:15:01.911 fused_ordering(7) 00:15:01.911 fused_ordering(8) 00:15:01.911 fused_ordering(9) 00:15:01.911 fused_ordering(10) 00:15:01.911 fused_ordering(11) 00:15:01.911 fused_ordering(12) 00:15:01.911 fused_ordering(13) 00:15:01.911 fused_ordering(14) 00:15:01.911 fused_ordering(15) 00:15:01.911 fused_ordering(16) 00:15:01.911 fused_ordering(17) 00:15:01.911 fused_ordering(18) 00:15:01.911 fused_ordering(19) 00:15:01.911 fused_ordering(20) 00:15:01.911 fused_ordering(21) 00:15:01.911 fused_ordering(22) 00:15:01.911 fused_ordering(23) 00:15:01.911 fused_ordering(24) 00:15:01.911 fused_ordering(25) 00:15:01.911 fused_ordering(26) 00:15:01.911 fused_ordering(27) 00:15:01.911 fused_ordering(28) 00:15:01.911 fused_ordering(29) 00:15:01.911 fused_ordering(30) 00:15:01.911 fused_ordering(31) 00:15:01.911 fused_ordering(32) 00:15:01.911 fused_ordering(33) 00:15:01.911 fused_ordering(34) 00:15:01.911 fused_ordering(35) 00:15:01.911 fused_ordering(36) 00:15:01.911 fused_ordering(37) 00:15:01.911 fused_ordering(38) 00:15:01.911 fused_ordering(39) 00:15:01.911 fused_ordering(40) 00:15:01.911 fused_ordering(41) 00:15:01.911 fused_ordering(42) 00:15:01.911 fused_ordering(43) 00:15:01.911 fused_ordering(44) 00:15:01.911 fused_ordering(45) 00:15:01.911 fused_ordering(46) 00:15:01.911 fused_ordering(47) 00:15:01.911 fused_ordering(48) 00:15:01.911 fused_ordering(49) 00:15:01.911 fused_ordering(50) 00:15:01.911 fused_ordering(51) 00:15:01.911 fused_ordering(52) 00:15:01.911 fused_ordering(53) 00:15:01.911 fused_ordering(54) 00:15:01.911 fused_ordering(55) 00:15:01.911 fused_ordering(56) 00:15:01.911 fused_ordering(57) 00:15:01.911 fused_ordering(58) 00:15:01.911 fused_ordering(59) 00:15:01.911 fused_ordering(60) 00:15:01.911 fused_ordering(61) 00:15:01.911 fused_ordering(62) 00:15:01.911 fused_ordering(63) 00:15:01.911 fused_ordering(64) 00:15:01.911 fused_ordering(65) 00:15:01.911 fused_ordering(66) 00:15:01.911 fused_ordering(67) 00:15:01.911 fused_ordering(68) 00:15:01.911 fused_ordering(69) 00:15:01.911 fused_ordering(70) 00:15:01.911 fused_ordering(71) 00:15:01.911 fused_ordering(72) 00:15:01.911 fused_ordering(73) 00:15:01.911 fused_ordering(74) 00:15:01.911 fused_ordering(75) 00:15:01.911 fused_ordering(76) 00:15:01.911 fused_ordering(77) 00:15:01.911 fused_ordering(78) 00:15:01.911 fused_ordering(79) 00:15:01.911 fused_ordering(80) 00:15:01.911 fused_ordering(81) 00:15:01.911 fused_ordering(82) 00:15:01.911 fused_ordering(83) 00:15:01.911 fused_ordering(84) 00:15:01.911 fused_ordering(85) 00:15:01.911 fused_ordering(86) 00:15:01.911 fused_ordering(87) 00:15:01.911 fused_ordering(88) 00:15:01.911 fused_ordering(89) 00:15:01.911 fused_ordering(90) 00:15:01.911 fused_ordering(91) 00:15:01.911 fused_ordering(92) 00:15:01.911 fused_ordering(93) 00:15:01.911 fused_ordering(94) 00:15:01.911 fused_ordering(95) 00:15:01.911 fused_ordering(96) 00:15:01.911 fused_ordering(97) 00:15:01.911 fused_ordering(98) 00:15:01.911 fused_ordering(99) 00:15:01.911 fused_ordering(100) 00:15:01.911 fused_ordering(101) 00:15:01.911 fused_ordering(102) 00:15:01.911 fused_ordering(103) 00:15:01.911 fused_ordering(104) 00:15:01.911 fused_ordering(105) 00:15:01.911 fused_ordering(106) 00:15:01.911 fused_ordering(107) 00:15:01.911 fused_ordering(108) 00:15:01.911 fused_ordering(109) 00:15:01.911 fused_ordering(110) 00:15:01.911 fused_ordering(111) 00:15:01.911 fused_ordering(112) 00:15:01.911 fused_ordering(113) 00:15:01.911 fused_ordering(114) 00:15:01.911 fused_ordering(115) 00:15:01.911 fused_ordering(116) 00:15:01.911 fused_ordering(117) 00:15:01.911 fused_ordering(118) 00:15:01.911 fused_ordering(119) 00:15:01.911 fused_ordering(120) 00:15:01.911 fused_ordering(121) 00:15:01.911 fused_ordering(122) 00:15:01.911 fused_ordering(123) 00:15:01.911 fused_ordering(124) 00:15:01.911 fused_ordering(125) 00:15:01.911 fused_ordering(126) 00:15:01.911 fused_ordering(127) 00:15:01.911 fused_ordering(128) 00:15:01.911 fused_ordering(129) 00:15:01.911 fused_ordering(130) 00:15:01.911 fused_ordering(131) 00:15:01.911 fused_ordering(132) 00:15:01.911 fused_ordering(133) 00:15:01.911 fused_ordering(134) 00:15:01.911 fused_ordering(135) 00:15:01.911 fused_ordering(136) 00:15:01.911 fused_ordering(137) 00:15:01.911 fused_ordering(138) 00:15:01.911 fused_ordering(139) 00:15:01.911 fused_ordering(140) 00:15:01.911 fused_ordering(141) 00:15:01.911 fused_ordering(142) 00:15:01.911 fused_ordering(143) 00:15:01.911 fused_ordering(144) 00:15:01.911 fused_ordering(145) 00:15:01.911 fused_ordering(146) 00:15:01.911 fused_ordering(147) 00:15:01.911 fused_ordering(148) 00:15:01.912 fused_ordering(149) 00:15:01.912 fused_ordering(150) 00:15:01.912 fused_ordering(151) 00:15:01.912 fused_ordering(152) 00:15:01.912 fused_ordering(153) 00:15:01.912 fused_ordering(154) 00:15:01.912 fused_ordering(155) 00:15:01.912 fused_ordering(156) 00:15:01.912 fused_ordering(157) 00:15:01.912 fused_ordering(158) 00:15:01.912 fused_ordering(159) 00:15:01.912 fused_ordering(160) 00:15:01.912 fused_ordering(161) 00:15:01.912 fused_ordering(162) 00:15:01.912 fused_ordering(163) 00:15:01.912 fused_ordering(164) 00:15:01.912 fused_ordering(165) 00:15:01.912 fused_ordering(166) 00:15:01.912 fused_ordering(167) 00:15:01.912 fused_ordering(168) 00:15:01.912 fused_ordering(169) 00:15:01.912 fused_ordering(170) 00:15:01.912 fused_ordering(171) 00:15:01.912 fused_ordering(172) 00:15:01.912 fused_ordering(173) 00:15:01.912 fused_ordering(174) 00:15:01.912 fused_ordering(175) 00:15:01.912 fused_ordering(176) 00:15:01.912 fused_ordering(177) 00:15:01.912 fused_ordering(178) 00:15:01.912 fused_ordering(179) 00:15:01.912 fused_ordering(180) 00:15:01.912 fused_ordering(181) 00:15:01.912 fused_ordering(182) 00:15:01.912 fused_ordering(183) 00:15:01.912 fused_ordering(184) 00:15:01.912 fused_ordering(185) 00:15:01.912 fused_ordering(186) 00:15:01.912 fused_ordering(187) 00:15:01.912 fused_ordering(188) 00:15:01.912 fused_ordering(189) 00:15:01.912 fused_ordering(190) 00:15:01.912 fused_ordering(191) 00:15:01.912 fused_ordering(192) 00:15:01.912 fused_ordering(193) 00:15:01.912 fused_ordering(194) 00:15:01.912 fused_ordering(195) 00:15:01.912 fused_ordering(196) 00:15:01.912 fused_ordering(197) 00:15:01.912 fused_ordering(198) 00:15:01.912 fused_ordering(199) 00:15:01.912 fused_ordering(200) 00:15:01.912 fused_ordering(201) 00:15:01.912 fused_ordering(202) 00:15:01.912 fused_ordering(203) 00:15:01.912 fused_ordering(204) 00:15:01.912 fused_ordering(205) 00:15:02.173 fused_ordering(206) 00:15:02.173 fused_ordering(207) 00:15:02.173 fused_ordering(208) 00:15:02.173 fused_ordering(209) 00:15:02.173 fused_ordering(210) 00:15:02.173 fused_ordering(211) 00:15:02.173 fused_ordering(212) 00:15:02.173 fused_ordering(213) 00:15:02.173 fused_ordering(214) 00:15:02.173 fused_ordering(215) 00:15:02.173 fused_ordering(216) 00:15:02.173 fused_ordering(217) 00:15:02.173 fused_ordering(218) 00:15:02.173 fused_ordering(219) 00:15:02.173 fused_ordering(220) 00:15:02.173 fused_ordering(221) 00:15:02.173 fused_ordering(222) 00:15:02.173 fused_ordering(223) 00:15:02.173 fused_ordering(224) 00:15:02.173 fused_ordering(225) 00:15:02.173 fused_ordering(226) 00:15:02.173 fused_ordering(227) 00:15:02.173 fused_ordering(228) 00:15:02.173 fused_ordering(229) 00:15:02.173 fused_ordering(230) 00:15:02.173 fused_ordering(231) 00:15:02.173 fused_ordering(232) 00:15:02.173 fused_ordering(233) 00:15:02.173 fused_ordering(234) 00:15:02.173 fused_ordering(235) 00:15:02.173 fused_ordering(236) 00:15:02.173 fused_ordering(237) 00:15:02.173 fused_ordering(238) 00:15:02.173 fused_ordering(239) 00:15:02.173 fused_ordering(240) 00:15:02.173 fused_ordering(241) 00:15:02.173 fused_ordering(242) 00:15:02.173 fused_ordering(243) 00:15:02.173 fused_ordering(244) 00:15:02.173 fused_ordering(245) 00:15:02.173 fused_ordering(246) 00:15:02.173 fused_ordering(247) 00:15:02.173 fused_ordering(248) 00:15:02.173 fused_ordering(249) 00:15:02.173 fused_ordering(250) 00:15:02.173 fused_ordering(251) 00:15:02.173 fused_ordering(252) 00:15:02.173 fused_ordering(253) 00:15:02.173 fused_ordering(254) 00:15:02.173 fused_ordering(255) 00:15:02.173 fused_ordering(256) 00:15:02.173 fused_ordering(257) 00:15:02.173 fused_ordering(258) 00:15:02.173 fused_ordering(259) 00:15:02.173 fused_ordering(260) 00:15:02.173 fused_ordering(261) 00:15:02.173 fused_ordering(262) 00:15:02.173 fused_ordering(263) 00:15:02.173 fused_ordering(264) 00:15:02.173 fused_ordering(265) 00:15:02.173 fused_ordering(266) 00:15:02.173 fused_ordering(267) 00:15:02.173 fused_ordering(268) 00:15:02.173 fused_ordering(269) 00:15:02.173 fused_ordering(270) 00:15:02.173 fused_ordering(271) 00:15:02.173 fused_ordering(272) 00:15:02.173 fused_ordering(273) 00:15:02.173 fused_ordering(274) 00:15:02.173 fused_ordering(275) 00:15:02.173 fused_ordering(276) 00:15:02.173 fused_ordering(277) 00:15:02.173 fused_ordering(278) 00:15:02.173 fused_ordering(279) 00:15:02.173 fused_ordering(280) 00:15:02.173 fused_ordering(281) 00:15:02.173 fused_ordering(282) 00:15:02.173 fused_ordering(283) 00:15:02.173 fused_ordering(284) 00:15:02.173 fused_ordering(285) 00:15:02.173 fused_ordering(286) 00:15:02.173 fused_ordering(287) 00:15:02.173 fused_ordering(288) 00:15:02.173 fused_ordering(289) 00:15:02.173 fused_ordering(290) 00:15:02.173 fused_ordering(291) 00:15:02.173 fused_ordering(292) 00:15:02.173 fused_ordering(293) 00:15:02.173 fused_ordering(294) 00:15:02.173 fused_ordering(295) 00:15:02.173 fused_ordering(296) 00:15:02.173 fused_ordering(297) 00:15:02.173 fused_ordering(298) 00:15:02.173 fused_ordering(299) 00:15:02.173 fused_ordering(300) 00:15:02.173 fused_ordering(301) 00:15:02.173 fused_ordering(302) 00:15:02.173 fused_ordering(303) 00:15:02.173 fused_ordering(304) 00:15:02.173 fused_ordering(305) 00:15:02.173 fused_ordering(306) 00:15:02.173 fused_ordering(307) 00:15:02.173 fused_ordering(308) 00:15:02.173 fused_ordering(309) 00:15:02.173 fused_ordering(310) 00:15:02.173 fused_ordering(311) 00:15:02.173 fused_ordering(312) 00:15:02.173 fused_ordering(313) 00:15:02.173 fused_ordering(314) 00:15:02.173 fused_ordering(315) 00:15:02.173 fused_ordering(316) 00:15:02.173 fused_ordering(317) 00:15:02.173 fused_ordering(318) 00:15:02.173 fused_ordering(319) 00:15:02.173 fused_ordering(320) 00:15:02.173 fused_ordering(321) 00:15:02.173 fused_ordering(322) 00:15:02.173 fused_ordering(323) 00:15:02.173 fused_ordering(324) 00:15:02.173 fused_ordering(325) 00:15:02.173 fused_ordering(326) 00:15:02.173 fused_ordering(327) 00:15:02.173 fused_ordering(328) 00:15:02.173 fused_ordering(329) 00:15:02.173 fused_ordering(330) 00:15:02.173 fused_ordering(331) 00:15:02.173 fused_ordering(332) 00:15:02.173 fused_ordering(333) 00:15:02.173 fused_ordering(334) 00:15:02.173 fused_ordering(335) 00:15:02.173 fused_ordering(336) 00:15:02.173 fused_ordering(337) 00:15:02.173 fused_ordering(338) 00:15:02.173 fused_ordering(339) 00:15:02.173 fused_ordering(340) 00:15:02.173 fused_ordering(341) 00:15:02.173 fused_ordering(342) 00:15:02.173 fused_ordering(343) 00:15:02.173 fused_ordering(344) 00:15:02.173 fused_ordering(345) 00:15:02.173 fused_ordering(346) 00:15:02.173 fused_ordering(347) 00:15:02.173 fused_ordering(348) 00:15:02.173 fused_ordering(349) 00:15:02.173 fused_ordering(350) 00:15:02.173 fused_ordering(351) 00:15:02.173 fused_ordering(352) 00:15:02.173 fused_ordering(353) 00:15:02.173 fused_ordering(354) 00:15:02.173 fused_ordering(355) 00:15:02.173 fused_ordering(356) 00:15:02.173 fused_ordering(357) 00:15:02.173 fused_ordering(358) 00:15:02.173 fused_ordering(359) 00:15:02.173 fused_ordering(360) 00:15:02.173 fused_ordering(361) 00:15:02.173 fused_ordering(362) 00:15:02.173 fused_ordering(363) 00:15:02.173 fused_ordering(364) 00:15:02.173 fused_ordering(365) 00:15:02.173 fused_ordering(366) 00:15:02.173 fused_ordering(367) 00:15:02.173 fused_ordering(368) 00:15:02.174 fused_ordering(369) 00:15:02.174 fused_ordering(370) 00:15:02.174 fused_ordering(371) 00:15:02.174 fused_ordering(372) 00:15:02.174 fused_ordering(373) 00:15:02.174 fused_ordering(374) 00:15:02.174 fused_ordering(375) 00:15:02.174 fused_ordering(376) 00:15:02.174 fused_ordering(377) 00:15:02.174 fused_ordering(378) 00:15:02.174 fused_ordering(379) 00:15:02.174 fused_ordering(380) 00:15:02.174 fused_ordering(381) 00:15:02.174 fused_ordering(382) 00:15:02.174 fused_ordering(383) 00:15:02.174 fused_ordering(384) 00:15:02.174 fused_ordering(385) 00:15:02.174 fused_ordering(386) 00:15:02.174 fused_ordering(387) 00:15:02.174 fused_ordering(388) 00:15:02.174 fused_ordering(389) 00:15:02.174 fused_ordering(390) 00:15:02.174 fused_ordering(391) 00:15:02.174 fused_ordering(392) 00:15:02.174 fused_ordering(393) 00:15:02.174 fused_ordering(394) 00:15:02.174 fused_ordering(395) 00:15:02.174 fused_ordering(396) 00:15:02.174 fused_ordering(397) 00:15:02.174 fused_ordering(398) 00:15:02.174 fused_ordering(399) 00:15:02.174 fused_ordering(400) 00:15:02.174 fused_ordering(401) 00:15:02.174 fused_ordering(402) 00:15:02.174 fused_ordering(403) 00:15:02.174 fused_ordering(404) 00:15:02.174 fused_ordering(405) 00:15:02.174 fused_ordering(406) 00:15:02.174 fused_ordering(407) 00:15:02.174 fused_ordering(408) 00:15:02.174 fused_ordering(409) 00:15:02.174 fused_ordering(410) 00:15:02.743 fused_ordering(411) 00:15:02.743 fused_ordering(412) 00:15:02.743 fused_ordering(413) 00:15:02.743 fused_ordering(414) 00:15:02.743 fused_ordering(415) 00:15:02.743 fused_ordering(416) 00:15:02.743 fused_ordering(417) 00:15:02.743 fused_ordering(418) 00:15:02.743 fused_ordering(419) 00:15:02.743 fused_ordering(420) 00:15:02.743 fused_ordering(421) 00:15:02.743 fused_ordering(422) 00:15:02.743 fused_ordering(423) 00:15:02.743 fused_ordering(424) 00:15:02.743 fused_ordering(425) 00:15:02.743 fused_ordering(426) 00:15:02.743 fused_ordering(427) 00:15:02.743 fused_ordering(428) 00:15:02.743 fused_ordering(429) 00:15:02.743 fused_ordering(430) 00:15:02.743 fused_ordering(431) 00:15:02.743 fused_ordering(432) 00:15:02.743 fused_ordering(433) 00:15:02.743 fused_ordering(434) 00:15:02.743 fused_ordering(435) 00:15:02.743 fused_ordering(436) 00:15:02.743 fused_ordering(437) 00:15:02.743 fused_ordering(438) 00:15:02.743 fused_ordering(439) 00:15:02.743 fused_ordering(440) 00:15:02.743 fused_ordering(441) 00:15:02.743 fused_ordering(442) 00:15:02.743 fused_ordering(443) 00:15:02.743 fused_ordering(444) 00:15:02.743 fused_ordering(445) 00:15:02.743 fused_ordering(446) 00:15:02.743 fused_ordering(447) 00:15:02.743 fused_ordering(448) 00:15:02.743 fused_ordering(449) 00:15:02.743 fused_ordering(450) 00:15:02.743 fused_ordering(451) 00:15:02.743 fused_ordering(452) 00:15:02.743 fused_ordering(453) 00:15:02.743 fused_ordering(454) 00:15:02.743 fused_ordering(455) 00:15:02.743 fused_ordering(456) 00:15:02.743 fused_ordering(457) 00:15:02.743 fused_ordering(458) 00:15:02.743 fused_ordering(459) 00:15:02.743 fused_ordering(460) 00:15:02.743 fused_ordering(461) 00:15:02.743 fused_ordering(462) 00:15:02.743 fused_ordering(463) 00:15:02.743 fused_ordering(464) 00:15:02.743 fused_ordering(465) 00:15:02.743 fused_ordering(466) 00:15:02.743 fused_ordering(467) 00:15:02.743 fused_ordering(468) 00:15:02.743 fused_ordering(469) 00:15:02.743 fused_ordering(470) 00:15:02.743 fused_ordering(471) 00:15:02.743 fused_ordering(472) 00:15:02.743 fused_ordering(473) 00:15:02.744 fused_ordering(474) 00:15:02.744 fused_ordering(475) 00:15:02.744 fused_ordering(476) 00:15:02.744 fused_ordering(477) 00:15:02.744 fused_ordering(478) 00:15:02.744 fused_ordering(479) 00:15:02.744 fused_ordering(480) 00:15:02.744 fused_ordering(481) 00:15:02.744 fused_ordering(482) 00:15:02.744 fused_ordering(483) 00:15:02.744 fused_ordering(484) 00:15:02.744 fused_ordering(485) 00:15:02.744 fused_ordering(486) 00:15:02.744 fused_ordering(487) 00:15:02.744 fused_ordering(488) 00:15:02.744 fused_ordering(489) 00:15:02.744 fused_ordering(490) 00:15:02.744 fused_ordering(491) 00:15:02.744 fused_ordering(492) 00:15:02.744 fused_ordering(493) 00:15:02.744 fused_ordering(494) 00:15:02.744 fused_ordering(495) 00:15:02.744 fused_ordering(496) 00:15:02.744 fused_ordering(497) 00:15:02.744 fused_ordering(498) 00:15:02.744 fused_ordering(499) 00:15:02.744 fused_ordering(500) 00:15:02.744 fused_ordering(501) 00:15:02.744 fused_ordering(502) 00:15:02.744 fused_ordering(503) 00:15:02.744 fused_ordering(504) 00:15:02.744 fused_ordering(505) 00:15:02.744 fused_ordering(506) 00:15:02.744 fused_ordering(507) 00:15:02.744 fused_ordering(508) 00:15:02.744 fused_ordering(509) 00:15:02.744 fused_ordering(510) 00:15:02.744 fused_ordering(511) 00:15:02.744 fused_ordering(512) 00:15:02.744 fused_ordering(513) 00:15:02.744 fused_ordering(514) 00:15:02.744 fused_ordering(515) 00:15:02.744 fused_ordering(516) 00:15:02.744 fused_ordering(517) 00:15:02.744 fused_ordering(518) 00:15:02.744 fused_ordering(519) 00:15:02.744 fused_ordering(520) 00:15:02.744 fused_ordering(521) 00:15:02.744 fused_ordering(522) 00:15:02.744 fused_ordering(523) 00:15:02.744 fused_ordering(524) 00:15:02.744 fused_ordering(525) 00:15:02.744 fused_ordering(526) 00:15:02.744 fused_ordering(527) 00:15:02.744 fused_ordering(528) 00:15:02.744 fused_ordering(529) 00:15:02.744 fused_ordering(530) 00:15:02.744 fused_ordering(531) 00:15:02.744 fused_ordering(532) 00:15:02.744 fused_ordering(533) 00:15:02.744 fused_ordering(534) 00:15:02.744 fused_ordering(535) 00:15:02.744 fused_ordering(536) 00:15:02.744 fused_ordering(537) 00:15:02.744 fused_ordering(538) 00:15:02.744 fused_ordering(539) 00:15:02.744 fused_ordering(540) 00:15:02.744 fused_ordering(541) 00:15:02.744 fused_ordering(542) 00:15:02.744 fused_ordering(543) 00:15:02.744 fused_ordering(544) 00:15:02.744 fused_ordering(545) 00:15:02.744 fused_ordering(546) 00:15:02.744 fused_ordering(547) 00:15:02.744 fused_ordering(548) 00:15:02.744 fused_ordering(549) 00:15:02.744 fused_ordering(550) 00:15:02.744 fused_ordering(551) 00:15:02.744 fused_ordering(552) 00:15:02.744 fused_ordering(553) 00:15:02.744 fused_ordering(554) 00:15:02.744 fused_ordering(555) 00:15:02.744 fused_ordering(556) 00:15:02.744 fused_ordering(557) 00:15:02.744 fused_ordering(558) 00:15:02.744 fused_ordering(559) 00:15:02.744 fused_ordering(560) 00:15:02.744 fused_ordering(561) 00:15:02.744 fused_ordering(562) 00:15:02.744 fused_ordering(563) 00:15:02.744 fused_ordering(564) 00:15:02.744 fused_ordering(565) 00:15:02.744 fused_ordering(566) 00:15:02.744 fused_ordering(567) 00:15:02.744 fused_ordering(568) 00:15:02.744 fused_ordering(569) 00:15:02.744 fused_ordering(570) 00:15:02.744 fused_ordering(571) 00:15:02.744 fused_ordering(572) 00:15:02.744 fused_ordering(573) 00:15:02.744 fused_ordering(574) 00:15:02.744 fused_ordering(575) 00:15:02.744 fused_ordering(576) 00:15:02.744 fused_ordering(577) 00:15:02.744 fused_ordering(578) 00:15:02.744 fused_ordering(579) 00:15:02.744 fused_ordering(580) 00:15:02.744 fused_ordering(581) 00:15:02.744 fused_ordering(582) 00:15:02.744 fused_ordering(583) 00:15:02.744 fused_ordering(584) 00:15:02.744 fused_ordering(585) 00:15:02.744 fused_ordering(586) 00:15:02.744 fused_ordering(587) 00:15:02.744 fused_ordering(588) 00:15:02.744 fused_ordering(589) 00:15:02.744 fused_ordering(590) 00:15:02.744 fused_ordering(591) 00:15:02.744 fused_ordering(592) 00:15:02.744 fused_ordering(593) 00:15:02.744 fused_ordering(594) 00:15:02.744 fused_ordering(595) 00:15:02.744 fused_ordering(596) 00:15:02.744 fused_ordering(597) 00:15:02.744 fused_ordering(598) 00:15:02.744 fused_ordering(599) 00:15:02.744 fused_ordering(600) 00:15:02.744 fused_ordering(601) 00:15:02.744 fused_ordering(602) 00:15:02.744 fused_ordering(603) 00:15:02.744 fused_ordering(604) 00:15:02.744 fused_ordering(605) 00:15:02.744 fused_ordering(606) 00:15:02.744 fused_ordering(607) 00:15:02.744 fused_ordering(608) 00:15:02.744 fused_ordering(609) 00:15:02.744 fused_ordering(610) 00:15:02.744 fused_ordering(611) 00:15:02.744 fused_ordering(612) 00:15:02.744 fused_ordering(613) 00:15:02.744 fused_ordering(614) 00:15:02.744 fused_ordering(615) 00:15:03.312 fused_ordering(616) 00:15:03.312 fused_ordering(617) 00:15:03.312 fused_ordering(618) 00:15:03.312 fused_ordering(619) 00:15:03.312 fused_ordering(620) 00:15:03.312 fused_ordering(621) 00:15:03.312 fused_ordering(622) 00:15:03.312 fused_ordering(623) 00:15:03.312 fused_ordering(624) 00:15:03.312 fused_ordering(625) 00:15:03.312 fused_ordering(626) 00:15:03.312 fused_ordering(627) 00:15:03.312 fused_ordering(628) 00:15:03.312 fused_ordering(629) 00:15:03.312 fused_ordering(630) 00:15:03.312 fused_ordering(631) 00:15:03.312 fused_ordering(632) 00:15:03.312 fused_ordering(633) 00:15:03.312 fused_ordering(634) 00:15:03.312 fused_ordering(635) 00:15:03.312 fused_ordering(636) 00:15:03.312 fused_ordering(637) 00:15:03.312 fused_ordering(638) 00:15:03.312 fused_ordering(639) 00:15:03.312 fused_ordering(640) 00:15:03.312 fused_ordering(641) 00:15:03.312 fused_ordering(642) 00:15:03.312 fused_ordering(643) 00:15:03.312 fused_ordering(644) 00:15:03.312 fused_ordering(645) 00:15:03.312 fused_ordering(646) 00:15:03.312 fused_ordering(647) 00:15:03.312 fused_ordering(648) 00:15:03.312 fused_ordering(649) 00:15:03.312 fused_ordering(650) 00:15:03.312 fused_ordering(651) 00:15:03.312 fused_ordering(652) 00:15:03.312 fused_ordering(653) 00:15:03.312 fused_ordering(654) 00:15:03.312 fused_ordering(655) 00:15:03.312 fused_ordering(656) 00:15:03.312 fused_ordering(657) 00:15:03.312 fused_ordering(658) 00:15:03.312 fused_ordering(659) 00:15:03.312 fused_ordering(660) 00:15:03.312 fused_ordering(661) 00:15:03.312 fused_ordering(662) 00:15:03.312 fused_ordering(663) 00:15:03.312 fused_ordering(664) 00:15:03.312 fused_ordering(665) 00:15:03.312 fused_ordering(666) 00:15:03.312 fused_ordering(667) 00:15:03.312 fused_ordering(668) 00:15:03.312 fused_ordering(669) 00:15:03.312 fused_ordering(670) 00:15:03.312 fused_ordering(671) 00:15:03.312 fused_ordering(672) 00:15:03.312 fused_ordering(673) 00:15:03.312 fused_ordering(674) 00:15:03.312 fused_ordering(675) 00:15:03.312 fused_ordering(676) 00:15:03.312 fused_ordering(677) 00:15:03.312 fused_ordering(678) 00:15:03.312 fused_ordering(679) 00:15:03.312 fused_ordering(680) 00:15:03.312 fused_ordering(681) 00:15:03.312 fused_ordering(682) 00:15:03.312 fused_ordering(683) 00:15:03.312 fused_ordering(684) 00:15:03.312 fused_ordering(685) 00:15:03.312 fused_ordering(686) 00:15:03.312 fused_ordering(687) 00:15:03.312 fused_ordering(688) 00:15:03.312 fused_ordering(689) 00:15:03.312 fused_ordering(690) 00:15:03.312 fused_ordering(691) 00:15:03.312 fused_ordering(692) 00:15:03.312 fused_ordering(693) 00:15:03.312 fused_ordering(694) 00:15:03.312 fused_ordering(695) 00:15:03.312 fused_ordering(696) 00:15:03.312 fused_ordering(697) 00:15:03.312 fused_ordering(698) 00:15:03.312 fused_ordering(699) 00:15:03.312 fused_ordering(700) 00:15:03.312 fused_ordering(701) 00:15:03.312 fused_ordering(702) 00:15:03.312 fused_ordering(703) 00:15:03.312 fused_ordering(704) 00:15:03.312 fused_ordering(705) 00:15:03.312 fused_ordering(706) 00:15:03.312 fused_ordering(707) 00:15:03.312 fused_ordering(708) 00:15:03.312 fused_ordering(709) 00:15:03.312 fused_ordering(710) 00:15:03.312 fused_ordering(711) 00:15:03.312 fused_ordering(712) 00:15:03.312 fused_ordering(713) 00:15:03.312 fused_ordering(714) 00:15:03.312 fused_ordering(715) 00:15:03.312 fused_ordering(716) 00:15:03.312 fused_ordering(717) 00:15:03.312 fused_ordering(718) 00:15:03.312 fused_ordering(719) 00:15:03.312 fused_ordering(720) 00:15:03.312 fused_ordering(721) 00:15:03.312 fused_ordering(722) 00:15:03.312 fused_ordering(723) 00:15:03.312 fused_ordering(724) 00:15:03.312 fused_ordering(725) 00:15:03.312 fused_ordering(726) 00:15:03.312 fused_ordering(727) 00:15:03.312 fused_ordering(728) 00:15:03.312 fused_ordering(729) 00:15:03.312 fused_ordering(730) 00:15:03.312 fused_ordering(731) 00:15:03.312 fused_ordering(732) 00:15:03.312 fused_ordering(733) 00:15:03.312 fused_ordering(734) 00:15:03.312 fused_ordering(735) 00:15:03.312 fused_ordering(736) 00:15:03.312 fused_ordering(737) 00:15:03.312 fused_ordering(738) 00:15:03.312 fused_ordering(739) 00:15:03.312 fused_ordering(740) 00:15:03.312 fused_ordering(741) 00:15:03.312 fused_ordering(742) 00:15:03.312 fused_ordering(743) 00:15:03.312 fused_ordering(744) 00:15:03.312 fused_ordering(745) 00:15:03.312 fused_ordering(746) 00:15:03.312 fused_ordering(747) 00:15:03.312 fused_ordering(748) 00:15:03.312 fused_ordering(749) 00:15:03.312 fused_ordering(750) 00:15:03.312 fused_ordering(751) 00:15:03.312 fused_ordering(752) 00:15:03.312 fused_ordering(753) 00:15:03.312 fused_ordering(754) 00:15:03.312 fused_ordering(755) 00:15:03.312 fused_ordering(756) 00:15:03.312 fused_ordering(757) 00:15:03.312 fused_ordering(758) 00:15:03.312 fused_ordering(759) 00:15:03.312 fused_ordering(760) 00:15:03.312 fused_ordering(761) 00:15:03.312 fused_ordering(762) 00:15:03.312 fused_ordering(763) 00:15:03.312 fused_ordering(764) 00:15:03.312 fused_ordering(765) 00:15:03.312 fused_ordering(766) 00:15:03.312 fused_ordering(767) 00:15:03.312 fused_ordering(768) 00:15:03.312 fused_ordering(769) 00:15:03.312 fused_ordering(770) 00:15:03.312 fused_ordering(771) 00:15:03.312 fused_ordering(772) 00:15:03.312 fused_ordering(773) 00:15:03.312 fused_ordering(774) 00:15:03.312 fused_ordering(775) 00:15:03.312 fused_ordering(776) 00:15:03.312 fused_ordering(777) 00:15:03.312 fused_ordering(778) 00:15:03.312 fused_ordering(779) 00:15:03.312 fused_ordering(780) 00:15:03.312 fused_ordering(781) 00:15:03.312 fused_ordering(782) 00:15:03.312 fused_ordering(783) 00:15:03.312 fused_ordering(784) 00:15:03.312 fused_ordering(785) 00:15:03.312 fused_ordering(786) 00:15:03.312 fused_ordering(787) 00:15:03.312 fused_ordering(788) 00:15:03.312 fused_ordering(789) 00:15:03.312 fused_ordering(790) 00:15:03.312 fused_ordering(791) 00:15:03.312 fused_ordering(792) 00:15:03.312 fused_ordering(793) 00:15:03.312 fused_ordering(794) 00:15:03.312 fused_ordering(795) 00:15:03.312 fused_ordering(796) 00:15:03.312 fused_ordering(797) 00:15:03.312 fused_ordering(798) 00:15:03.312 fused_ordering(799) 00:15:03.312 fused_ordering(800) 00:15:03.312 fused_ordering(801) 00:15:03.312 fused_ordering(802) 00:15:03.312 fused_ordering(803) 00:15:03.312 fused_ordering(804) 00:15:03.312 fused_ordering(805) 00:15:03.312 fused_ordering(806) 00:15:03.312 fused_ordering(807) 00:15:03.312 fused_ordering(808) 00:15:03.312 fused_ordering(809) 00:15:03.312 fused_ordering(810) 00:15:03.312 fused_ordering(811) 00:15:03.313 fused_ordering(812) 00:15:03.313 fused_ordering(813) 00:15:03.313 fused_ordering(814) 00:15:03.313 fused_ordering(815) 00:15:03.313 fused_ordering(816) 00:15:03.313 fused_ordering(817) 00:15:03.313 fused_ordering(818) 00:15:03.313 fused_ordering(819) 00:15:03.313 fused_ordering(820) 00:15:03.881 fused_ordering(821) 00:15:03.881 fused_ordering(822) 00:15:03.881 fused_ordering(823) 00:15:03.881 fused_ordering(824) 00:15:03.881 fused_ordering(825) 00:15:03.881 fused_ordering(826) 00:15:03.881 fused_ordering(827) 00:15:03.881 fused_ordering(828) 00:15:03.881 fused_ordering(829) 00:15:03.881 fused_ordering(830) 00:15:03.881 fused_ordering(831) 00:15:03.881 fused_ordering(832) 00:15:03.881 fused_ordering(833) 00:15:03.881 fused_ordering(834) 00:15:03.881 fused_ordering(835) 00:15:03.881 fused_ordering(836) 00:15:03.881 fused_ordering(837) 00:15:03.881 fused_ordering(838) 00:15:03.881 fused_ordering(839) 00:15:03.881 fused_ordering(840) 00:15:03.881 fused_ordering(841) 00:15:03.881 fused_ordering(842) 00:15:03.881 fused_ordering(843) 00:15:03.881 fused_ordering(844) 00:15:03.881 fused_ordering(845) 00:15:03.881 fused_ordering(846) 00:15:03.881 fused_ordering(847) 00:15:03.881 fused_ordering(848) 00:15:03.881 fused_ordering(849) 00:15:03.881 fused_ordering(850) 00:15:03.881 fused_ordering(851) 00:15:03.881 fused_ordering(852) 00:15:03.881 fused_ordering(853) 00:15:03.881 fused_ordering(854) 00:15:03.881 fused_ordering(855) 00:15:03.881 fused_ordering(856) 00:15:03.881 fused_ordering(857) 00:15:03.881 fused_ordering(858) 00:15:03.881 fused_ordering(859) 00:15:03.881 fused_ordering(860) 00:15:03.881 fused_ordering(861) 00:15:03.881 fused_ordering(862) 00:15:03.881 fused_ordering(863) 00:15:03.881 fused_ordering(864) 00:15:03.881 fused_ordering(865) 00:15:03.881 fused_ordering(866) 00:15:03.881 fused_ordering(867) 00:15:03.881 fused_ordering(868) 00:15:03.881 fused_ordering(869) 00:15:03.881 fused_ordering(870) 00:15:03.881 fused_ordering(871) 00:15:03.881 fused_ordering(872) 00:15:03.881 fused_ordering(873) 00:15:03.881 fused_ordering(874) 00:15:03.881 fused_ordering(875) 00:15:03.881 fused_ordering(876) 00:15:03.881 fused_ordering(877) 00:15:03.881 fused_ordering(878) 00:15:03.881 fused_ordering(879) 00:15:03.881 fused_ordering(880) 00:15:03.881 fused_ordering(881) 00:15:03.881 fused_ordering(882) 00:15:03.881 fused_ordering(883) 00:15:03.881 fused_ordering(884) 00:15:03.881 fused_ordering(885) 00:15:03.881 fused_ordering(886) 00:15:03.881 fused_ordering(887) 00:15:03.881 fused_ordering(888) 00:15:03.881 fused_ordering(889) 00:15:03.881 fused_ordering(890) 00:15:03.881 fused_ordering(891) 00:15:03.881 fused_ordering(892) 00:15:03.881 fused_ordering(893) 00:15:03.881 fused_ordering(894) 00:15:03.881 fused_ordering(895) 00:15:03.881 fused_ordering(896) 00:15:03.881 fused_ordering(897) 00:15:03.881 fused_ordering(898) 00:15:03.881 fused_ordering(899) 00:15:03.881 fused_ordering(900) 00:15:03.881 fused_ordering(901) 00:15:03.881 fused_ordering(902) 00:15:03.881 fused_ordering(903) 00:15:03.881 fused_ordering(904) 00:15:03.881 fused_ordering(905) 00:15:03.881 fused_ordering(906) 00:15:03.881 fused_ordering(907) 00:15:03.881 fused_ordering(908) 00:15:03.881 fused_ordering(909) 00:15:03.881 fused_ordering(910) 00:15:03.881 fused_ordering(911) 00:15:03.881 fused_ordering(912) 00:15:03.881 fused_ordering(913) 00:15:03.881 fused_ordering(914) 00:15:03.881 fused_ordering(915) 00:15:03.881 fused_ordering(916) 00:15:03.881 fused_ordering(917) 00:15:03.881 fused_ordering(918) 00:15:03.881 fused_ordering(919) 00:15:03.881 fused_ordering(920) 00:15:03.881 fused_ordering(921) 00:15:03.881 fused_ordering(922) 00:15:03.881 fused_ordering(923) 00:15:03.881 fused_ordering(924) 00:15:03.881 fused_ordering(925) 00:15:03.881 fused_ordering(926) 00:15:03.881 fused_ordering(927) 00:15:03.881 fused_ordering(928) 00:15:03.881 fused_ordering(929) 00:15:03.881 fused_ordering(930) 00:15:03.881 fused_ordering(931) 00:15:03.881 fused_ordering(932) 00:15:03.881 fused_ordering(933) 00:15:03.881 fused_ordering(934) 00:15:03.881 fused_ordering(935) 00:15:03.881 fused_ordering(936) 00:15:03.881 fused_ordering(937) 00:15:03.881 fused_ordering(938) 00:15:03.881 fused_ordering(939) 00:15:03.881 fused_ordering(940) 00:15:03.881 fused_ordering(941) 00:15:03.881 fused_ordering(942) 00:15:03.881 fused_ordering(943) 00:15:03.881 fused_ordering(944) 00:15:03.881 fused_ordering(945) 00:15:03.881 fused_ordering(946) 00:15:03.881 fused_ordering(947) 00:15:03.881 fused_ordering(948) 00:15:03.881 fused_ordering(949) 00:15:03.881 fused_ordering(950) 00:15:03.881 fused_ordering(951) 00:15:03.881 fused_ordering(952) 00:15:03.881 fused_ordering(953) 00:15:03.881 fused_ordering(954) 00:15:03.881 fused_ordering(955) 00:15:03.881 fused_ordering(956) 00:15:03.881 fused_ordering(957) 00:15:03.881 fused_ordering(958) 00:15:03.881 fused_ordering(959) 00:15:03.881 fused_ordering(960) 00:15:03.881 fused_ordering(961) 00:15:03.881 fused_ordering(962) 00:15:03.881 fused_ordering(963) 00:15:03.881 fused_ordering(964) 00:15:03.881 fused_ordering(965) 00:15:03.881 fused_ordering(966) 00:15:03.881 fused_ordering(967) 00:15:03.881 fused_ordering(968) 00:15:03.881 fused_ordering(969) 00:15:03.881 fused_ordering(970) 00:15:03.881 fused_ordering(971) 00:15:03.881 fused_ordering(972) 00:15:03.881 fused_ordering(973) 00:15:03.881 fused_ordering(974) 00:15:03.881 fused_ordering(975) 00:15:03.881 fused_ordering(976) 00:15:03.881 fused_ordering(977) 00:15:03.881 fused_ordering(978) 00:15:03.881 fused_ordering(979) 00:15:03.881 fused_ordering(980) 00:15:03.881 fused_ordering(981) 00:15:03.881 fused_ordering(982) 00:15:03.881 fused_ordering(983) 00:15:03.881 fused_ordering(984) 00:15:03.881 fused_ordering(985) 00:15:03.881 fused_ordering(986) 00:15:03.881 fused_ordering(987) 00:15:03.881 fused_ordering(988) 00:15:03.881 fused_ordering(989) 00:15:03.881 fused_ordering(990) 00:15:03.881 fused_ordering(991) 00:15:03.881 fused_ordering(992) 00:15:03.881 fused_ordering(993) 00:15:03.881 fused_ordering(994) 00:15:03.881 fused_ordering(995) 00:15:03.881 fused_ordering(996) 00:15:03.881 fused_ordering(997) 00:15:03.881 fused_ordering(998) 00:15:03.881 fused_ordering(999) 00:15:03.881 fused_ordering(1000) 00:15:03.881 fused_ordering(1001) 00:15:03.881 fused_ordering(1002) 00:15:03.881 fused_ordering(1003) 00:15:03.881 fused_ordering(1004) 00:15:03.881 fused_ordering(1005) 00:15:03.881 fused_ordering(1006) 00:15:03.881 fused_ordering(1007) 00:15:03.881 fused_ordering(1008) 00:15:03.881 fused_ordering(1009) 00:15:03.881 fused_ordering(1010) 00:15:03.881 fused_ordering(1011) 00:15:03.881 fused_ordering(1012) 00:15:03.881 fused_ordering(1013) 00:15:03.881 fused_ordering(1014) 00:15:03.881 fused_ordering(1015) 00:15:03.881 fused_ordering(1016) 00:15:03.881 fused_ordering(1017) 00:15:03.881 fused_ordering(1018) 00:15:03.881 fused_ordering(1019) 00:15:03.881 fused_ordering(1020) 00:15:03.881 fused_ordering(1021) 00:15:03.881 fused_ordering(1022) 00:15:03.881 fused_ordering(1023) 00:15:03.881 16:50:49 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:15:03.881 16:50:49 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:15:03.881 16:50:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:03.881 16:50:49 -- nvmf/common.sh@116 -- # sync 00:15:03.881 16:50:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:03.881 16:50:49 -- nvmf/common.sh@119 -- # set +e 00:15:03.881 16:50:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:03.881 16:50:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:03.881 rmmod nvme_tcp 00:15:03.881 rmmod nvme_fabrics 00:15:03.881 rmmod nvme_keyring 00:15:03.881 16:50:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:03.881 16:50:49 -- nvmf/common.sh@123 -- # set -e 00:15:03.881 16:50:49 -- nvmf/common.sh@124 -- # return 0 00:15:03.881 16:50:49 -- nvmf/common.sh@477 -- # '[' -n 1164720 ']' 00:15:03.881 16:50:49 -- nvmf/common.sh@478 -- # killprocess 1164720 00:15:03.881 16:50:49 -- common/autotest_common.sh@936 -- # '[' -z 1164720 ']' 00:15:03.881 16:50:49 -- common/autotest_common.sh@940 -- # kill -0 1164720 00:15:03.881 16:50:49 -- common/autotest_common.sh@941 -- # uname 00:15:03.881 16:50:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:03.881 16:50:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1164720 00:15:03.881 16:50:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:03.881 16:50:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:03.881 16:50:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1164720' 00:15:03.881 killing process with pid 1164720 00:15:03.881 16:50:49 -- common/autotest_common.sh@955 -- # kill 1164720 00:15:03.881 16:50:49 -- common/autotest_common.sh@960 -- # wait 1164720 00:15:04.141 16:50:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:04.141 16:50:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:04.141 16:50:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:04.141 16:50:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:04.141 16:50:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:04.141 16:50:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:04.141 16:50:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:04.141 16:50:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:06.050 16:50:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:06.050 00:15:06.050 real 0m8.049s 00:15:06.050 user 0m5.810s 00:15:06.050 sys 0m3.080s 00:15:06.050 16:50:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:06.050 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:15:06.050 ************************************ 00:15:06.050 END TEST nvmf_fused_ordering 00:15:06.050 ************************************ 00:15:06.309 16:50:51 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:06.309 16:50:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:06.309 16:50:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:06.309 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:15:06.309 ************************************ 00:15:06.309 START TEST nvmf_delete_subsystem 00:15:06.309 ************************************ 00:15:06.309 16:50:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:06.309 * Looking for test storage... 00:15:06.309 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:06.309 16:50:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:06.309 16:50:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:06.309 16:50:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:06.309 16:50:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:06.309 16:50:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:06.309 16:50:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:06.309 16:50:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:06.309 16:50:51 -- scripts/common.sh@335 -- # IFS=.-: 00:15:06.309 16:50:51 -- scripts/common.sh@335 -- # read -ra ver1 00:15:06.309 16:50:51 -- scripts/common.sh@336 -- # IFS=.-: 00:15:06.309 16:50:51 -- scripts/common.sh@336 -- # read -ra ver2 00:15:06.309 16:50:51 -- scripts/common.sh@337 -- # local 'op=<' 00:15:06.309 16:50:51 -- scripts/common.sh@339 -- # ver1_l=2 00:15:06.309 16:50:51 -- scripts/common.sh@340 -- # ver2_l=1 00:15:06.309 16:50:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:06.309 16:50:51 -- scripts/common.sh@343 -- # case "$op" in 00:15:06.309 16:50:51 -- scripts/common.sh@344 -- # : 1 00:15:06.309 16:50:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:06.309 16:50:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:06.309 16:50:51 -- scripts/common.sh@364 -- # decimal 1 00:15:06.310 16:50:51 -- scripts/common.sh@352 -- # local d=1 00:15:06.310 16:50:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:06.310 16:50:51 -- scripts/common.sh@354 -- # echo 1 00:15:06.310 16:50:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:06.310 16:50:51 -- scripts/common.sh@365 -- # decimal 2 00:15:06.310 16:50:51 -- scripts/common.sh@352 -- # local d=2 00:15:06.310 16:50:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:06.310 16:50:51 -- scripts/common.sh@354 -- # echo 2 00:15:06.310 16:50:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:06.310 16:50:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:06.310 16:50:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:06.310 16:50:51 -- scripts/common.sh@367 -- # return 0 00:15:06.310 16:50:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:06.310 16:50:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:06.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:06.310 --rc genhtml_branch_coverage=1 00:15:06.310 --rc genhtml_function_coverage=1 00:15:06.310 --rc genhtml_legend=1 00:15:06.310 --rc geninfo_all_blocks=1 00:15:06.310 --rc geninfo_unexecuted_blocks=1 00:15:06.310 00:15:06.310 ' 00:15:06.310 16:50:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:06.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:06.310 --rc genhtml_branch_coverage=1 00:15:06.310 --rc genhtml_function_coverage=1 00:15:06.310 --rc genhtml_legend=1 00:15:06.310 --rc geninfo_all_blocks=1 00:15:06.310 --rc geninfo_unexecuted_blocks=1 00:15:06.310 00:15:06.310 ' 00:15:06.310 16:50:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:06.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:06.310 --rc genhtml_branch_coverage=1 00:15:06.310 --rc genhtml_function_coverage=1 00:15:06.310 --rc genhtml_legend=1 00:15:06.310 --rc geninfo_all_blocks=1 00:15:06.310 --rc geninfo_unexecuted_blocks=1 00:15:06.310 00:15:06.310 ' 00:15:06.310 16:50:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:06.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:06.310 --rc genhtml_branch_coverage=1 00:15:06.310 --rc genhtml_function_coverage=1 00:15:06.310 --rc genhtml_legend=1 00:15:06.310 --rc geninfo_all_blocks=1 00:15:06.310 --rc geninfo_unexecuted_blocks=1 00:15:06.310 00:15:06.310 ' 00:15:06.310 16:50:51 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:06.310 16:50:51 -- nvmf/common.sh@7 -- # uname -s 00:15:06.310 16:50:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:06.310 16:50:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:06.310 16:50:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:06.310 16:50:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:06.310 16:50:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:06.310 16:50:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:06.310 16:50:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:06.310 16:50:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:06.310 16:50:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:06.310 16:50:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:06.310 16:50:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:06.310 16:50:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:06.310 16:50:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:06.310 16:50:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:06.310 16:50:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:06.310 16:50:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:06.310 16:50:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:06.310 16:50:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:06.310 16:50:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:06.310 16:50:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.310 16:50:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.310 16:50:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.310 16:50:51 -- paths/export.sh@5 -- # export PATH 00:15:06.310 16:50:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.310 16:50:51 -- nvmf/common.sh@46 -- # : 0 00:15:06.310 16:50:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:06.310 16:50:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:06.310 16:50:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:06.310 16:50:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:06.310 16:50:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:06.310 16:50:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:06.310 16:50:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:06.310 16:50:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:06.310 16:50:51 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:15:06.310 16:50:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:06.310 16:50:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:06.310 16:50:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:06.310 16:50:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:06.310 16:50:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:06.310 16:50:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:06.310 16:50:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:06.310 16:50:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:06.310 16:50:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:06.310 16:50:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:06.310 16:50:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:06.310 16:50:51 -- common/autotest_common.sh@10 -- # set +x 00:15:08.252 16:50:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:08.252 16:50:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:08.252 16:50:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:08.252 16:50:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:08.252 16:50:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:08.252 16:50:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:08.252 16:50:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:08.252 16:50:53 -- nvmf/common.sh@294 -- # net_devs=() 00:15:08.252 16:50:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:08.252 16:50:53 -- nvmf/common.sh@295 -- # e810=() 00:15:08.252 16:50:53 -- nvmf/common.sh@295 -- # local -ga e810 00:15:08.252 16:50:53 -- nvmf/common.sh@296 -- # x722=() 00:15:08.252 16:50:53 -- nvmf/common.sh@296 -- # local -ga x722 00:15:08.252 16:50:53 -- nvmf/common.sh@297 -- # mlx=() 00:15:08.252 16:50:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:08.252 16:50:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:08.252 16:50:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:08.252 16:50:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:08.252 16:50:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:08.252 16:50:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:08.252 16:50:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:08.252 16:50:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:08.252 16:50:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:08.252 16:50:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:08.252 16:50:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:08.252 16:50:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:08.252 16:50:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:08.252 16:50:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:08.252 16:50:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:08.252 16:50:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:08.252 16:50:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:08.252 16:50:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:08.252 16:50:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:08.252 16:50:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:08.252 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:08.252 16:50:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:08.511 16:50:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:08.511 16:50:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:08.511 16:50:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:08.511 16:50:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:08.511 16:50:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:08.511 16:50:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:08.511 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:08.511 16:50:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:08.511 16:50:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:08.511 16:50:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:08.511 16:50:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:08.511 16:50:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:08.511 16:50:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:08.511 16:50:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:08.511 16:50:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:08.511 16:50:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:08.511 16:50:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:08.511 16:50:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:08.511 16:50:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:08.511 16:50:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:08.511 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:08.511 16:50:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:08.511 16:50:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:08.511 16:50:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:08.511 16:50:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:08.511 16:50:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:08.511 16:50:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:08.511 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:08.511 16:50:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:08.511 16:50:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:08.511 16:50:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:08.511 16:50:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:08.511 16:50:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:08.511 16:50:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:08.511 16:50:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:08.511 16:50:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:08.512 16:50:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:08.512 16:50:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:08.512 16:50:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:08.512 16:50:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:08.512 16:50:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:08.512 16:50:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:08.512 16:50:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:08.512 16:50:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:08.512 16:50:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:08.512 16:50:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:08.512 16:50:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:08.512 16:50:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:08.512 16:50:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:08.512 16:50:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:08.512 16:50:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:08.512 16:50:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:08.512 16:50:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:08.512 16:50:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:08.512 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:08.512 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:15:08.512 00:15:08.512 --- 10.0.0.2 ping statistics --- 00:15:08.512 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:08.512 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:15:08.512 16:50:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:08.512 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:08.512 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:15:08.512 00:15:08.512 --- 10.0.0.1 ping statistics --- 00:15:08.512 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:08.512 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:15:08.512 16:50:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:08.512 16:50:54 -- nvmf/common.sh@410 -- # return 0 00:15:08.512 16:50:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:08.512 16:50:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:08.512 16:50:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:08.512 16:50:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:08.512 16:50:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:08.512 16:50:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:08.512 16:50:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:08.512 16:50:54 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:15:08.512 16:50:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:08.512 16:50:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:08.512 16:50:54 -- common/autotest_common.sh@10 -- # set +x 00:15:08.512 16:50:54 -- nvmf/common.sh@469 -- # nvmfpid=1167117 00:15:08.512 16:50:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:08.512 16:50:54 -- nvmf/common.sh@470 -- # waitforlisten 1167117 00:15:08.512 16:50:54 -- common/autotest_common.sh@829 -- # '[' -z 1167117 ']' 00:15:08.512 16:50:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:08.512 16:50:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:08.512 16:50:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:08.512 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:08.512 16:50:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:08.512 16:50:54 -- common/autotest_common.sh@10 -- # set +x 00:15:08.512 [2024-11-16 16:50:54.198772] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:08.512 [2024-11-16 16:50:54.198847] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:08.512 EAL: No free 2048 kB hugepages reported on node 1 00:15:08.770 [2024-11-16 16:50:54.267549] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:08.770 [2024-11-16 16:50:54.361633] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:08.770 [2024-11-16 16:50:54.361801] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:08.770 [2024-11-16 16:50:54.361819] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:08.770 [2024-11-16 16:50:54.361831] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:08.770 [2024-11-16 16:50:54.361893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:08.770 [2024-11-16 16:50:54.361894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:09.710 16:50:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:09.710 16:50:55 -- common/autotest_common.sh@862 -- # return 0 00:15:09.710 16:50:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:09.710 16:50:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:09.710 16:50:55 -- common/autotest_common.sh@10 -- # set +x 00:15:09.710 16:50:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:09.710 16:50:55 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:09.710 16:50:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.710 16:50:55 -- common/autotest_common.sh@10 -- # set +x 00:15:09.710 [2024-11-16 16:50:55.214336] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:09.710 16:50:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.710 16:50:55 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:09.710 16:50:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.710 16:50:55 -- common/autotest_common.sh@10 -- # set +x 00:15:09.710 16:50:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.710 16:50:55 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:09.710 16:50:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.710 16:50:55 -- common/autotest_common.sh@10 -- # set +x 00:15:09.710 [2024-11-16 16:50:55.230575] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:09.710 16:50:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.710 16:50:55 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:09.710 16:50:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.710 16:50:55 -- common/autotest_common.sh@10 -- # set +x 00:15:09.710 NULL1 00:15:09.710 16:50:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.710 16:50:55 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:09.710 16:50:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.710 16:50:55 -- common/autotest_common.sh@10 -- # set +x 00:15:09.710 Delay0 00:15:09.710 16:50:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.710 16:50:55 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:09.710 16:50:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.710 16:50:55 -- common/autotest_common.sh@10 -- # set +x 00:15:09.710 16:50:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.710 16:50:55 -- target/delete_subsystem.sh@28 -- # perf_pid=1167259 00:15:09.710 16:50:55 -- target/delete_subsystem.sh@30 -- # sleep 2 00:15:09.710 16:50:55 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:09.710 EAL: No free 2048 kB hugepages reported on node 1 00:15:09.710 [2024-11-16 16:50:55.305222] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:11.614 16:50:57 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:11.614 16:50:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:11.614 16:50:57 -- common/autotest_common.sh@10 -- # set +x 00:15:11.872 Read completed with error (sct=0, sc=8) 00:15:11.872 Write completed with error (sct=0, sc=8) 00:15:11.872 starting I/O failed: -6 00:15:11.872 Read completed with error (sct=0, sc=8) 00:15:11.872 Read completed with error (sct=0, sc=8) 00:15:11.872 Read completed with error (sct=0, sc=8) 00:15:11.872 Read completed with error (sct=0, sc=8) 00:15:11.872 starting I/O failed: -6 00:15:11.872 Write completed with error (sct=0, sc=8) 00:15:11.872 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 [2024-11-16 16:50:57.385046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21ee9e0 is same with the state(5) to be set 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 starting I/O failed: -6 00:15:11.873 [2024-11-16 16:50:57.386572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fb5cc00c1d0 is same with the state(5) to be set 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Write completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.873 Read completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Write completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Write completed with error (sct=0, sc=8) 00:15:11.874 Write completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Write completed with error (sct=0, sc=8) 00:15:11.874 Write completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Write completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:11.874 Write completed with error (sct=0, sc=8) 00:15:11.874 Read completed with error (sct=0, sc=8) 00:15:12.813 [2024-11-16 16:50:58.361928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f09c0 is same with the state(5) to be set 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Write completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Write completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Write completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Write completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Write completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 [2024-11-16 16:50:58.387877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fb5cc00bf20 is same with the state(5) to be set 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Write completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.813 Write completed with error (sct=0, sc=8) 00:15:12.813 Write completed with error (sct=0, sc=8) 00:15:12.813 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 [2024-11-16 16:50:58.388092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fb5cc00c480 is same with the state(5) to be set 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 [2024-11-16 16:50:58.388348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21eece0 is same with the state(5) to be set 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 Read completed with error (sct=0, sc=8) 00:15:12.814 Write completed with error (sct=0, sc=8) 00:15:12.814 [2024-11-16 16:50:58.388897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21ef240 is same with the state(5) to be set 00:15:12.814 [2024-11-16 16:50:58.389624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21f09c0 (9): Bad file descriptor 00:15:12.814 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:15:12.814 16:50:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.814 16:50:58 -- target/delete_subsystem.sh@34 -- # delay=0 00:15:12.814 16:50:58 -- target/delete_subsystem.sh@35 -- # kill -0 1167259 00:15:12.814 16:50:58 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:15:12.814 Initializing NVMe Controllers 00:15:12.814 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:12.814 Controller IO queue size 128, less than required. 00:15:12.814 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:12.814 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:12.814 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:12.814 Initialization complete. Launching workers. 00:15:12.814 ======================================================== 00:15:12.814 Latency(us) 00:15:12.814 Device Information : IOPS MiB/s Average min max 00:15:12.814 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 159.95 0.08 918477.17 401.74 1011158.34 00:15:12.814 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 157.46 0.08 1027774.09 323.44 2003518.44 00:15:12.814 ======================================================== 00:15:12.814 Total : 317.41 0.15 972698.02 323.44 2003518.44 00:15:12.814 00:15:13.382 16:50:58 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:15:13.382 16:50:58 -- target/delete_subsystem.sh@35 -- # kill -0 1167259 00:15:13.382 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (1167259) - No such process 00:15:13.382 16:50:58 -- target/delete_subsystem.sh@45 -- # NOT wait 1167259 00:15:13.382 16:50:58 -- common/autotest_common.sh@650 -- # local es=0 00:15:13.382 16:50:58 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 1167259 00:15:13.382 16:50:58 -- common/autotest_common.sh@638 -- # local arg=wait 00:15:13.382 16:50:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:13.382 16:50:58 -- common/autotest_common.sh@642 -- # type -t wait 00:15:13.382 16:50:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:13.382 16:50:58 -- common/autotest_common.sh@653 -- # wait 1167259 00:15:13.382 16:50:58 -- common/autotest_common.sh@653 -- # es=1 00:15:13.382 16:50:58 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:13.382 16:50:58 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:13.382 16:50:58 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:13.382 16:50:58 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:13.382 16:50:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:13.382 16:50:58 -- common/autotest_common.sh@10 -- # set +x 00:15:13.382 16:50:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:13.382 16:50:58 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:13.382 16:50:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:13.382 16:50:58 -- common/autotest_common.sh@10 -- # set +x 00:15:13.382 [2024-11-16 16:50:58.914033] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:13.382 16:50:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:13.382 16:50:58 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:13.382 16:50:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:13.382 16:50:58 -- common/autotest_common.sh@10 -- # set +x 00:15:13.382 16:50:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:13.382 16:50:58 -- target/delete_subsystem.sh@54 -- # perf_pid=1167798 00:15:13.382 16:50:58 -- target/delete_subsystem.sh@56 -- # delay=0 00:15:13.382 16:50:58 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:13.382 16:50:58 -- target/delete_subsystem.sh@57 -- # kill -0 1167798 00:15:13.382 16:50:58 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:13.382 EAL: No free 2048 kB hugepages reported on node 1 00:15:13.382 [2024-11-16 16:50:58.977095] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:13.952 16:50:59 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:13.952 16:50:59 -- target/delete_subsystem.sh@57 -- # kill -0 1167798 00:15:13.952 16:50:59 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:14.210 16:50:59 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:14.210 16:50:59 -- target/delete_subsystem.sh@57 -- # kill -0 1167798 00:15:14.210 16:50:59 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:14.776 16:51:00 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:14.776 16:51:00 -- target/delete_subsystem.sh@57 -- # kill -0 1167798 00:15:14.776 16:51:00 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:15.344 16:51:00 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:15.344 16:51:00 -- target/delete_subsystem.sh@57 -- # kill -0 1167798 00:15:15.344 16:51:00 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:15.911 16:51:01 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:15.911 16:51:01 -- target/delete_subsystem.sh@57 -- # kill -0 1167798 00:15:15.911 16:51:01 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:16.478 16:51:01 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:16.478 16:51:01 -- target/delete_subsystem.sh@57 -- # kill -0 1167798 00:15:16.478 16:51:01 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:16.739 Initializing NVMe Controllers 00:15:16.739 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:16.739 Controller IO queue size 128, less than required. 00:15:16.739 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:16.739 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:16.739 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:16.739 Initialization complete. Launching workers. 00:15:16.739 ======================================================== 00:15:16.739 Latency(us) 00:15:16.739 Device Information : IOPS MiB/s Average min max 00:15:16.739 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004101.32 1000177.46 1013435.00 00:15:16.739 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1006309.47 1000183.03 1043182.73 00:15:16.739 ======================================================== 00:15:16.739 Total : 256.00 0.12 1005205.40 1000177.46 1043182.73 00:15:16.739 00:15:16.739 16:51:02 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:16.739 16:51:02 -- target/delete_subsystem.sh@57 -- # kill -0 1167798 00:15:16.739 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (1167798) - No such process 00:15:16.739 16:51:02 -- target/delete_subsystem.sh@67 -- # wait 1167798 00:15:16.739 16:51:02 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:15:16.739 16:51:02 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:15:16.739 16:51:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:16.739 16:51:02 -- nvmf/common.sh@116 -- # sync 00:15:16.739 16:51:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:16.739 16:51:02 -- nvmf/common.sh@119 -- # set +e 00:15:16.739 16:51:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:16.739 16:51:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:16.739 rmmod nvme_tcp 00:15:16.739 rmmod nvme_fabrics 00:15:16.739 rmmod nvme_keyring 00:15:17.030 16:51:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:17.030 16:51:02 -- nvmf/common.sh@123 -- # set -e 00:15:17.030 16:51:02 -- nvmf/common.sh@124 -- # return 0 00:15:17.030 16:51:02 -- nvmf/common.sh@477 -- # '[' -n 1167117 ']' 00:15:17.030 16:51:02 -- nvmf/common.sh@478 -- # killprocess 1167117 00:15:17.030 16:51:02 -- common/autotest_common.sh@936 -- # '[' -z 1167117 ']' 00:15:17.030 16:51:02 -- common/autotest_common.sh@940 -- # kill -0 1167117 00:15:17.030 16:51:02 -- common/autotest_common.sh@941 -- # uname 00:15:17.030 16:51:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:17.030 16:51:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1167117 00:15:17.030 16:51:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:17.030 16:51:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:17.030 16:51:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1167117' 00:15:17.030 killing process with pid 1167117 00:15:17.030 16:51:02 -- common/autotest_common.sh@955 -- # kill 1167117 00:15:17.030 16:51:02 -- common/autotest_common.sh@960 -- # wait 1167117 00:15:17.289 16:51:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:17.289 16:51:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:17.289 16:51:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:17.289 16:51:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:17.289 16:51:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:17.289 16:51:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:17.289 16:51:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:17.289 16:51:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:19.197 16:51:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:19.197 00:15:19.197 real 0m13.006s 00:15:19.197 user 0m29.413s 00:15:19.197 sys 0m3.001s 00:15:19.197 16:51:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:19.197 16:51:04 -- common/autotest_common.sh@10 -- # set +x 00:15:19.197 ************************************ 00:15:19.197 END TEST nvmf_delete_subsystem 00:15:19.197 ************************************ 00:15:19.197 16:51:04 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:19.197 16:51:04 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:19.197 16:51:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:19.197 16:51:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:19.197 16:51:04 -- common/autotest_common.sh@10 -- # set +x 00:15:19.197 ************************************ 00:15:19.197 START TEST nvmf_nvme_cli 00:15:19.197 ************************************ 00:15:19.197 16:51:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:19.197 * Looking for test storage... 00:15:19.197 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:19.197 16:51:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:19.197 16:51:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:19.197 16:51:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:19.456 16:51:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:19.456 16:51:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:19.456 16:51:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:19.456 16:51:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:19.456 16:51:04 -- scripts/common.sh@335 -- # IFS=.-: 00:15:19.456 16:51:04 -- scripts/common.sh@335 -- # read -ra ver1 00:15:19.456 16:51:04 -- scripts/common.sh@336 -- # IFS=.-: 00:15:19.456 16:51:04 -- scripts/common.sh@336 -- # read -ra ver2 00:15:19.456 16:51:04 -- scripts/common.sh@337 -- # local 'op=<' 00:15:19.457 16:51:04 -- scripts/common.sh@339 -- # ver1_l=2 00:15:19.457 16:51:04 -- scripts/common.sh@340 -- # ver2_l=1 00:15:19.457 16:51:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:19.457 16:51:04 -- scripts/common.sh@343 -- # case "$op" in 00:15:19.457 16:51:04 -- scripts/common.sh@344 -- # : 1 00:15:19.457 16:51:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:19.457 16:51:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:19.457 16:51:04 -- scripts/common.sh@364 -- # decimal 1 00:15:19.457 16:51:04 -- scripts/common.sh@352 -- # local d=1 00:15:19.457 16:51:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:19.457 16:51:04 -- scripts/common.sh@354 -- # echo 1 00:15:19.457 16:51:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:19.457 16:51:04 -- scripts/common.sh@365 -- # decimal 2 00:15:19.457 16:51:04 -- scripts/common.sh@352 -- # local d=2 00:15:19.457 16:51:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:19.457 16:51:04 -- scripts/common.sh@354 -- # echo 2 00:15:19.457 16:51:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:19.457 16:51:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:19.457 16:51:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:19.457 16:51:04 -- scripts/common.sh@367 -- # return 0 00:15:19.457 16:51:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:19.457 16:51:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:19.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.457 --rc genhtml_branch_coverage=1 00:15:19.457 --rc genhtml_function_coverage=1 00:15:19.457 --rc genhtml_legend=1 00:15:19.457 --rc geninfo_all_blocks=1 00:15:19.457 --rc geninfo_unexecuted_blocks=1 00:15:19.457 00:15:19.457 ' 00:15:19.457 16:51:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:19.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.457 --rc genhtml_branch_coverage=1 00:15:19.457 --rc genhtml_function_coverage=1 00:15:19.457 --rc genhtml_legend=1 00:15:19.457 --rc geninfo_all_blocks=1 00:15:19.457 --rc geninfo_unexecuted_blocks=1 00:15:19.457 00:15:19.457 ' 00:15:19.457 16:51:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:19.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.457 --rc genhtml_branch_coverage=1 00:15:19.457 --rc genhtml_function_coverage=1 00:15:19.457 --rc genhtml_legend=1 00:15:19.457 --rc geninfo_all_blocks=1 00:15:19.457 --rc geninfo_unexecuted_blocks=1 00:15:19.457 00:15:19.457 ' 00:15:19.457 16:51:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:19.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.457 --rc genhtml_branch_coverage=1 00:15:19.457 --rc genhtml_function_coverage=1 00:15:19.457 --rc genhtml_legend=1 00:15:19.457 --rc geninfo_all_blocks=1 00:15:19.457 --rc geninfo_unexecuted_blocks=1 00:15:19.457 00:15:19.457 ' 00:15:19.457 16:51:04 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:19.457 16:51:04 -- nvmf/common.sh@7 -- # uname -s 00:15:19.457 16:51:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:19.457 16:51:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:19.457 16:51:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:19.457 16:51:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:19.457 16:51:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:19.457 16:51:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:19.457 16:51:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:19.457 16:51:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:19.457 16:51:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:19.457 16:51:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:19.457 16:51:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:19.457 16:51:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:19.457 16:51:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:19.457 16:51:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:19.457 16:51:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:19.457 16:51:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:19.457 16:51:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:19.457 16:51:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:19.457 16:51:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:19.457 16:51:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.457 16:51:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.457 16:51:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.457 16:51:04 -- paths/export.sh@5 -- # export PATH 00:15:19.457 16:51:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.457 16:51:04 -- nvmf/common.sh@46 -- # : 0 00:15:19.457 16:51:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:19.457 16:51:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:19.457 16:51:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:19.457 16:51:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:19.457 16:51:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:19.457 16:51:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:19.457 16:51:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:19.457 16:51:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:19.457 16:51:05 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:19.457 16:51:05 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:19.457 16:51:05 -- target/nvme_cli.sh@14 -- # devs=() 00:15:19.457 16:51:05 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:19.457 16:51:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:19.457 16:51:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:19.457 16:51:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:19.457 16:51:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:19.457 16:51:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:19.457 16:51:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:19.457 16:51:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:19.457 16:51:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:19.457 16:51:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:19.457 16:51:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:19.457 16:51:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:19.457 16:51:05 -- common/autotest_common.sh@10 -- # set +x 00:15:21.365 16:51:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:21.365 16:51:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:21.365 16:51:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:21.365 16:51:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:21.365 16:51:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:21.365 16:51:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:21.365 16:51:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:21.365 16:51:07 -- nvmf/common.sh@294 -- # net_devs=() 00:15:21.365 16:51:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:21.365 16:51:07 -- nvmf/common.sh@295 -- # e810=() 00:15:21.365 16:51:07 -- nvmf/common.sh@295 -- # local -ga e810 00:15:21.365 16:51:07 -- nvmf/common.sh@296 -- # x722=() 00:15:21.365 16:51:07 -- nvmf/common.sh@296 -- # local -ga x722 00:15:21.365 16:51:07 -- nvmf/common.sh@297 -- # mlx=() 00:15:21.365 16:51:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:21.365 16:51:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:21.365 16:51:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:21.365 16:51:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:21.365 16:51:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:21.365 16:51:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:21.365 16:51:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:21.365 16:51:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:21.365 16:51:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:21.365 16:51:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:21.365 16:51:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:21.365 16:51:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:21.365 16:51:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:21.365 16:51:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:21.365 16:51:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:21.365 16:51:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:21.365 16:51:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:21.365 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:21.365 16:51:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:21.365 16:51:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:21.365 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:21.365 16:51:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:21.365 16:51:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:21.365 16:51:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:21.365 16:51:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:21.365 16:51:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:21.365 16:51:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:21.365 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:21.365 16:51:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:21.365 16:51:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:21.365 16:51:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:21.365 16:51:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:21.365 16:51:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:21.365 16:51:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:21.365 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:21.365 16:51:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:21.365 16:51:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:21.365 16:51:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:21.365 16:51:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:21.365 16:51:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:21.365 16:51:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:21.365 16:51:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:21.365 16:51:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:21.365 16:51:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:21.365 16:51:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:21.366 16:51:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:21.366 16:51:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:21.366 16:51:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:21.366 16:51:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:21.366 16:51:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:21.366 16:51:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:21.366 16:51:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:21.366 16:51:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:21.366 16:51:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:21.366 16:51:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:21.366 16:51:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:21.366 16:51:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:21.624 16:51:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:21.624 16:51:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:21.624 16:51:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:21.624 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:21.624 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.144 ms 00:15:21.624 00:15:21.624 --- 10.0.0.2 ping statistics --- 00:15:21.624 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:21.624 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:15:21.624 16:51:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:21.624 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:21.624 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:15:21.624 00:15:21.624 --- 10.0.0.1 ping statistics --- 00:15:21.624 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:21.624 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:15:21.624 16:51:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:21.624 16:51:07 -- nvmf/common.sh@410 -- # return 0 00:15:21.624 16:51:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:21.624 16:51:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:21.624 16:51:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:21.624 16:51:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:21.624 16:51:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:21.624 16:51:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:21.624 16:51:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:21.624 16:51:07 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:21.624 16:51:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:21.624 16:51:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:21.624 16:51:07 -- common/autotest_common.sh@10 -- # set +x 00:15:21.624 16:51:07 -- nvmf/common.sh@469 -- # nvmfpid=1170322 00:15:21.624 16:51:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:21.624 16:51:07 -- nvmf/common.sh@470 -- # waitforlisten 1170322 00:15:21.624 16:51:07 -- common/autotest_common.sh@829 -- # '[' -z 1170322 ']' 00:15:21.624 16:51:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:21.624 16:51:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:21.624 16:51:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:21.624 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:21.624 16:51:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:21.624 16:51:07 -- common/autotest_common.sh@10 -- # set +x 00:15:21.624 [2024-11-16 16:51:07.213824] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:21.624 [2024-11-16 16:51:07.213905] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:21.624 EAL: No free 2048 kB hugepages reported on node 1 00:15:21.624 [2024-11-16 16:51:07.282695] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:21.624 [2024-11-16 16:51:07.369273] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:21.624 [2024-11-16 16:51:07.369429] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:21.624 [2024-11-16 16:51:07.369447] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:21.624 [2024-11-16 16:51:07.369460] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:21.624 [2024-11-16 16:51:07.369516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:21.624 [2024-11-16 16:51:07.369581] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:21.624 [2024-11-16 16:51:07.369622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:21.624 [2024-11-16 16:51:07.369625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:22.563 16:51:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:22.563 16:51:08 -- common/autotest_common.sh@862 -- # return 0 00:15:22.563 16:51:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:22.563 16:51:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:22.563 16:51:08 -- common/autotest_common.sh@10 -- # set +x 00:15:22.563 16:51:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:22.563 16:51:08 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:22.563 16:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.563 16:51:08 -- common/autotest_common.sh@10 -- # set +x 00:15:22.563 [2024-11-16 16:51:08.226330] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:22.563 16:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.563 16:51:08 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:22.563 16:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.563 16:51:08 -- common/autotest_common.sh@10 -- # set +x 00:15:22.563 Malloc0 00:15:22.563 16:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.563 16:51:08 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:22.563 16:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.563 16:51:08 -- common/autotest_common.sh@10 -- # set +x 00:15:22.563 Malloc1 00:15:22.563 16:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.563 16:51:08 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:22.563 16:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.563 16:51:08 -- common/autotest_common.sh@10 -- # set +x 00:15:22.563 16:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.563 16:51:08 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:22.563 16:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.563 16:51:08 -- common/autotest_common.sh@10 -- # set +x 00:15:22.563 16:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.563 16:51:08 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:22.563 16:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.564 16:51:08 -- common/autotest_common.sh@10 -- # set +x 00:15:22.564 16:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.564 16:51:08 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:22.564 16:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.564 16:51:08 -- common/autotest_common.sh@10 -- # set +x 00:15:22.564 [2024-11-16 16:51:08.312160] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:22.823 16:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.823 16:51:08 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:22.823 16:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.823 16:51:08 -- common/autotest_common.sh@10 -- # set +x 00:15:22.823 16:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.823 16:51:08 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:22.823 00:15:22.823 Discovery Log Number of Records 2, Generation counter 2 00:15:22.823 =====Discovery Log Entry 0====== 00:15:22.823 trtype: tcp 00:15:22.823 adrfam: ipv4 00:15:22.823 subtype: current discovery subsystem 00:15:22.823 treq: not required 00:15:22.823 portid: 0 00:15:22.823 trsvcid: 4420 00:15:22.823 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:22.823 traddr: 10.0.0.2 00:15:22.823 eflags: explicit discovery connections, duplicate discovery information 00:15:22.823 sectype: none 00:15:22.823 =====Discovery Log Entry 1====== 00:15:22.823 trtype: tcp 00:15:22.823 adrfam: ipv4 00:15:22.823 subtype: nvme subsystem 00:15:22.823 treq: not required 00:15:22.823 portid: 0 00:15:22.823 trsvcid: 4420 00:15:22.823 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:22.823 traddr: 10.0.0.2 00:15:22.823 eflags: none 00:15:22.823 sectype: none 00:15:22.823 16:51:08 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:22.823 16:51:08 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:22.823 16:51:08 -- nvmf/common.sh@510 -- # local dev _ 00:15:22.823 16:51:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.823 16:51:08 -- nvmf/common.sh@509 -- # nvme list 00:15:22.823 16:51:08 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:22.823 16:51:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.823 16:51:08 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:22.823 16:51:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.823 16:51:08 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:22.823 16:51:08 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:23.759 16:51:09 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:23.759 16:51:09 -- common/autotest_common.sh@1187 -- # local i=0 00:15:23.759 16:51:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:23.759 16:51:09 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:15:23.759 16:51:09 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:15:23.759 16:51:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:25.658 16:51:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:25.658 16:51:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:25.658 16:51:11 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:25.658 16:51:11 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:15:25.658 16:51:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:25.658 16:51:11 -- common/autotest_common.sh@1197 -- # return 0 00:15:25.658 16:51:11 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:25.658 16:51:11 -- nvmf/common.sh@510 -- # local dev _ 00:15:25.658 16:51:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.658 16:51:11 -- nvmf/common.sh@509 -- # nvme list 00:15:25.658 16:51:11 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:25.658 16:51:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.658 16:51:11 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:25.658 16:51:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.658 16:51:11 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:25.658 16:51:11 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:25.658 16:51:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.658 16:51:11 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:25.658 16:51:11 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:25.658 16:51:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.658 16:51:11 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:25.658 /dev/nvme0n2 ]] 00:15:25.658 16:51:11 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:25.658 16:51:11 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:25.658 16:51:11 -- nvmf/common.sh@510 -- # local dev _ 00:15:25.658 16:51:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.658 16:51:11 -- nvmf/common.sh@509 -- # nvme list 00:15:25.917 16:51:11 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:25.917 16:51:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.917 16:51:11 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:25.917 16:51:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.917 16:51:11 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:25.917 16:51:11 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:25.917 16:51:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.917 16:51:11 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:25.917 16:51:11 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:25.917 16:51:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.917 16:51:11 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:25.917 16:51:11 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:26.176 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:26.176 16:51:11 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:26.176 16:51:11 -- common/autotest_common.sh@1208 -- # local i=0 00:15:26.176 16:51:11 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:26.176 16:51:11 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:26.176 16:51:11 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:26.176 16:51:11 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:26.176 16:51:11 -- common/autotest_common.sh@1220 -- # return 0 00:15:26.176 16:51:11 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:26.176 16:51:11 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:26.176 16:51:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:26.176 16:51:11 -- common/autotest_common.sh@10 -- # set +x 00:15:26.176 16:51:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:26.176 16:51:11 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:26.176 16:51:11 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:26.176 16:51:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:26.176 16:51:11 -- nvmf/common.sh@116 -- # sync 00:15:26.176 16:51:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:26.176 16:51:11 -- nvmf/common.sh@119 -- # set +e 00:15:26.176 16:51:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:26.176 16:51:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:26.176 rmmod nvme_tcp 00:15:26.176 rmmod nvme_fabrics 00:15:26.176 rmmod nvme_keyring 00:15:26.176 16:51:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:26.176 16:51:11 -- nvmf/common.sh@123 -- # set -e 00:15:26.176 16:51:11 -- nvmf/common.sh@124 -- # return 0 00:15:26.176 16:51:11 -- nvmf/common.sh@477 -- # '[' -n 1170322 ']' 00:15:26.176 16:51:11 -- nvmf/common.sh@478 -- # killprocess 1170322 00:15:26.176 16:51:11 -- common/autotest_common.sh@936 -- # '[' -z 1170322 ']' 00:15:26.176 16:51:11 -- common/autotest_common.sh@940 -- # kill -0 1170322 00:15:26.176 16:51:11 -- common/autotest_common.sh@941 -- # uname 00:15:26.176 16:51:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:26.176 16:51:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1170322 00:15:26.176 16:51:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:26.176 16:51:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:26.176 16:51:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1170322' 00:15:26.176 killing process with pid 1170322 00:15:26.176 16:51:11 -- common/autotest_common.sh@955 -- # kill 1170322 00:15:26.176 16:51:11 -- common/autotest_common.sh@960 -- # wait 1170322 00:15:26.436 16:51:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:26.436 16:51:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:26.436 16:51:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:26.436 16:51:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:26.436 16:51:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:26.436 16:51:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:26.436 16:51:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:26.436 16:51:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:28.972 16:51:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:28.972 00:15:28.972 real 0m9.361s 00:15:28.972 user 0m19.775s 00:15:28.972 sys 0m2.344s 00:15:28.973 16:51:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:28.973 16:51:14 -- common/autotest_common.sh@10 -- # set +x 00:15:28.973 ************************************ 00:15:28.973 END TEST nvmf_nvme_cli 00:15:28.973 ************************************ 00:15:28.973 16:51:14 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:28.973 16:51:14 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:28.973 16:51:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:28.973 16:51:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:28.973 16:51:14 -- common/autotest_common.sh@10 -- # set +x 00:15:28.973 ************************************ 00:15:28.973 START TEST nvmf_vfio_user 00:15:28.973 ************************************ 00:15:28.973 16:51:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:28.973 * Looking for test storage... 00:15:28.973 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:28.973 16:51:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:28.973 16:51:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:28.973 16:51:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:28.973 16:51:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:28.973 16:51:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:28.973 16:51:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:28.973 16:51:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:28.973 16:51:14 -- scripts/common.sh@335 -- # IFS=.-: 00:15:28.973 16:51:14 -- scripts/common.sh@335 -- # read -ra ver1 00:15:28.973 16:51:14 -- scripts/common.sh@336 -- # IFS=.-: 00:15:28.973 16:51:14 -- scripts/common.sh@336 -- # read -ra ver2 00:15:28.973 16:51:14 -- scripts/common.sh@337 -- # local 'op=<' 00:15:28.973 16:51:14 -- scripts/common.sh@339 -- # ver1_l=2 00:15:28.973 16:51:14 -- scripts/common.sh@340 -- # ver2_l=1 00:15:28.973 16:51:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:28.973 16:51:14 -- scripts/common.sh@343 -- # case "$op" in 00:15:28.973 16:51:14 -- scripts/common.sh@344 -- # : 1 00:15:28.973 16:51:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:28.973 16:51:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:28.973 16:51:14 -- scripts/common.sh@364 -- # decimal 1 00:15:28.973 16:51:14 -- scripts/common.sh@352 -- # local d=1 00:15:28.973 16:51:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:28.973 16:51:14 -- scripts/common.sh@354 -- # echo 1 00:15:28.973 16:51:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:28.973 16:51:14 -- scripts/common.sh@365 -- # decimal 2 00:15:28.973 16:51:14 -- scripts/common.sh@352 -- # local d=2 00:15:28.973 16:51:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:28.973 16:51:14 -- scripts/common.sh@354 -- # echo 2 00:15:28.973 16:51:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:28.973 16:51:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:28.973 16:51:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:28.973 16:51:14 -- scripts/common.sh@367 -- # return 0 00:15:28.973 16:51:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:28.973 16:51:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:28.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.973 --rc genhtml_branch_coverage=1 00:15:28.973 --rc genhtml_function_coverage=1 00:15:28.973 --rc genhtml_legend=1 00:15:28.973 --rc geninfo_all_blocks=1 00:15:28.973 --rc geninfo_unexecuted_blocks=1 00:15:28.973 00:15:28.973 ' 00:15:28.973 16:51:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:28.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.973 --rc genhtml_branch_coverage=1 00:15:28.973 --rc genhtml_function_coverage=1 00:15:28.973 --rc genhtml_legend=1 00:15:28.973 --rc geninfo_all_blocks=1 00:15:28.973 --rc geninfo_unexecuted_blocks=1 00:15:28.973 00:15:28.973 ' 00:15:28.973 16:51:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:28.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.973 --rc genhtml_branch_coverage=1 00:15:28.973 --rc genhtml_function_coverage=1 00:15:28.973 --rc genhtml_legend=1 00:15:28.973 --rc geninfo_all_blocks=1 00:15:28.973 --rc geninfo_unexecuted_blocks=1 00:15:28.973 00:15:28.973 ' 00:15:28.973 16:51:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:28.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.973 --rc genhtml_branch_coverage=1 00:15:28.973 --rc genhtml_function_coverage=1 00:15:28.973 --rc genhtml_legend=1 00:15:28.973 --rc geninfo_all_blocks=1 00:15:28.973 --rc geninfo_unexecuted_blocks=1 00:15:28.973 00:15:28.973 ' 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:28.973 16:51:14 -- nvmf/common.sh@7 -- # uname -s 00:15:28.973 16:51:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:28.973 16:51:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:28.973 16:51:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:28.973 16:51:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:28.973 16:51:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:28.973 16:51:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:28.973 16:51:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:28.973 16:51:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:28.973 16:51:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:28.973 16:51:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:28.973 16:51:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:28.973 16:51:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:28.973 16:51:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:28.973 16:51:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:28.973 16:51:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:28.973 16:51:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:28.973 16:51:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:28.973 16:51:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:28.973 16:51:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:28.973 16:51:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.973 16:51:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.973 16:51:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.973 16:51:14 -- paths/export.sh@5 -- # export PATH 00:15:28.973 16:51:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.973 16:51:14 -- nvmf/common.sh@46 -- # : 0 00:15:28.973 16:51:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:28.973 16:51:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:28.973 16:51:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:28.973 16:51:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:28.973 16:51:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:28.973 16:51:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:28.973 16:51:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:28.973 16:51:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1171753 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1171753' 00:15:28.973 Process pid: 1171753 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:28.973 16:51:14 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1171753 00:15:28.973 16:51:14 -- common/autotest_common.sh@829 -- # '[' -z 1171753 ']' 00:15:28.973 16:51:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:28.973 16:51:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:28.974 16:51:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:28.974 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:28.974 16:51:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:28.974 16:51:14 -- common/autotest_common.sh@10 -- # set +x 00:15:28.974 [2024-11-16 16:51:14.433840] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:28.974 [2024-11-16 16:51:14.433941] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:28.974 EAL: No free 2048 kB hugepages reported on node 1 00:15:28.974 [2024-11-16 16:51:14.494286] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:28.974 [2024-11-16 16:51:14.585740] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:28.974 [2024-11-16 16:51:14.585880] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:28.974 [2024-11-16 16:51:14.585899] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:28.974 [2024-11-16 16:51:14.585913] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:28.974 [2024-11-16 16:51:14.588641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:28.974 [2024-11-16 16:51:14.588703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:28.974 [2024-11-16 16:51:14.588770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:28.974 [2024-11-16 16:51:14.588773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:29.908 16:51:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:29.908 16:51:15 -- common/autotest_common.sh@862 -- # return 0 00:15:29.908 16:51:15 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:30.841 16:51:16 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:31.099 16:51:16 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:31.099 16:51:16 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:31.099 16:51:16 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:31.099 16:51:16 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:31.099 16:51:16 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:31.357 Malloc1 00:15:31.357 16:51:17 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:31.615 16:51:17 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:31.873 16:51:17 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:32.131 16:51:17 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:32.131 16:51:17 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:32.131 16:51:17 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:32.389 Malloc2 00:15:32.389 16:51:18 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:32.646 16:51:18 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:32.904 16:51:18 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:33.161 16:51:18 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:33.162 16:51:18 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:33.162 16:51:18 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:33.162 16:51:18 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:33.162 16:51:18 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:33.162 16:51:18 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:33.162 [2024-11-16 16:51:18.871493] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:33.162 [2024-11-16 16:51:18.871529] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1172316 ] 00:15:33.162 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.162 [2024-11-16 16:51:18.904797] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:33.162 [2024-11-16 16:51:18.909967] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:33.162 [2024-11-16 16:51:18.909996] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f19149a8000 00:15:33.162 [2024-11-16 16:51:18.910963] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:33.162 [2024-11-16 16:51:18.911939] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:33.421 [2024-11-16 16:51:18.912941] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:33.421 [2024-11-16 16:51:18.913950] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:33.421 [2024-11-16 16:51:18.914965] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:33.421 [2024-11-16 16:51:18.915958] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:33.421 [2024-11-16 16:51:18.916966] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:33.421 [2024-11-16 16:51:18.917993] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:33.421 [2024-11-16 16:51:18.918984] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:33.421 [2024-11-16 16:51:18.919005] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f19136a2000 00:15:33.421 [2024-11-16 16:51:18.920127] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:33.421 [2024-11-16 16:51:18.935284] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:33.421 [2024-11-16 16:51:18.935331] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:33.421 [2024-11-16 16:51:18.940119] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:33.421 [2024-11-16 16:51:18.940172] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:33.421 [2024-11-16 16:51:18.940265] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:33.421 [2024-11-16 16:51:18.940298] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:33.421 [2024-11-16 16:51:18.940309] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:33.421 [2024-11-16 16:51:18.941115] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:33.421 [2024-11-16 16:51:18.941135] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:33.421 [2024-11-16 16:51:18.941147] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:33.421 [2024-11-16 16:51:18.942116] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:33.421 [2024-11-16 16:51:18.942133] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:33.421 [2024-11-16 16:51:18.942147] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:33.421 [2024-11-16 16:51:18.943123] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:33.421 [2024-11-16 16:51:18.943141] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:33.421 [2024-11-16 16:51:18.944131] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:33.421 [2024-11-16 16:51:18.944150] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:33.421 [2024-11-16 16:51:18.944159] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:33.421 [2024-11-16 16:51:18.944170] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:33.421 [2024-11-16 16:51:18.944279] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:33.421 [2024-11-16 16:51:18.944287] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:33.421 [2024-11-16 16:51:18.944295] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:33.421 [2024-11-16 16:51:18.945626] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:33.421 [2024-11-16 16:51:18.946141] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:33.421 [2024-11-16 16:51:18.947145] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:33.421 [2024-11-16 16:51:18.948176] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:33.422 [2024-11-16 16:51:18.949154] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:33.422 [2024-11-16 16:51:18.949172] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:33.422 [2024-11-16 16:51:18.949181] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949205] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:33.422 [2024-11-16 16:51:18.949218] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949241] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:33.422 [2024-11-16 16:51:18.949251] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:33.422 [2024-11-16 16:51:18.949271] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:33.422 [2024-11-16 16:51:18.949345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:33.422 [2024-11-16 16:51:18.949362] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:33.422 [2024-11-16 16:51:18.949370] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:33.422 [2024-11-16 16:51:18.949377] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:33.422 [2024-11-16 16:51:18.949384] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:33.422 [2024-11-16 16:51:18.949393] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:33.422 [2024-11-16 16:51:18.949404] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:33.422 [2024-11-16 16:51:18.949412] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949428] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949444] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:33.422 [2024-11-16 16:51:18.949461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:33.422 [2024-11-16 16:51:18.949481] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:33.422 [2024-11-16 16:51:18.949494] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:33.422 [2024-11-16 16:51:18.949505] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:33.422 [2024-11-16 16:51:18.949517] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:33.422 [2024-11-16 16:51:18.949525] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949541] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949556] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:33.422 [2024-11-16 16:51:18.949570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:33.422 [2024-11-16 16:51:18.949581] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:33.422 [2024-11-16 16:51:18.949589] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949623] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949640] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949654] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:33.422 [2024-11-16 16:51:18.949667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:33.422 [2024-11-16 16:51:18.949729] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949744] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949756] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:33.422 [2024-11-16 16:51:18.949765] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:33.422 [2024-11-16 16:51:18.949774] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:33.422 [2024-11-16 16:51:18.949790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:33.422 [2024-11-16 16:51:18.949816] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:33.422 [2024-11-16 16:51:18.949836] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949851] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949863] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:33.422 [2024-11-16 16:51:18.949871] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:33.422 [2024-11-16 16:51:18.949880] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:33.422 [2024-11-16 16:51:18.949903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:33.422 [2024-11-16 16:51:18.949941] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949956] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.949968] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:33.422 [2024-11-16 16:51:18.949976] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:33.422 [2024-11-16 16:51:18.949985] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:33.422 [2024-11-16 16:51:18.949998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:33.422 [2024-11-16 16:51:18.950012] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.950022] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.950036] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.950046] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.950054] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.950062] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:33.422 [2024-11-16 16:51:18.950070] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:33.422 [2024-11-16 16:51:18.950078] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:33.422 [2024-11-16 16:51:18.950103] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:33.422 [2024-11-16 16:51:18.950120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:33.422 [2024-11-16 16:51:18.950138] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:33.422 [2024-11-16 16:51:18.950156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:33.422 [2024-11-16 16:51:18.950175] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:33.422 [2024-11-16 16:51:18.950187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:33.422 [2024-11-16 16:51:18.950202] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:33.422 [2024-11-16 16:51:18.950216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:33.422 [2024-11-16 16:51:18.950234] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:33.422 [2024-11-16 16:51:18.950243] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:33.422 [2024-11-16 16:51:18.950248] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:33.422 [2024-11-16 16:51:18.950254] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:33.422 [2024-11-16 16:51:18.950263] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:33.422 [2024-11-16 16:51:18.950274] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:33.422 [2024-11-16 16:51:18.950282] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:33.422 [2024-11-16 16:51:18.950290] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:33.422 [2024-11-16 16:51:18.950301] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:33.422 [2024-11-16 16:51:18.950308] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:33.422 [2024-11-16 16:51:18.950316] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:33.422 [2024-11-16 16:51:18.950328] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:33.423 [2024-11-16 16:51:18.950336] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:33.423 [2024-11-16 16:51:18.950344] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:33.423 [2024-11-16 16:51:18.950355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:33.423 [2024-11-16 16:51:18.950375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:33.423 [2024-11-16 16:51:18.950391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:33.423 [2024-11-16 16:51:18.950402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:33.423 ===================================================== 00:15:33.423 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:33.423 ===================================================== 00:15:33.423 Controller Capabilities/Features 00:15:33.423 ================================ 00:15:33.423 Vendor ID: 4e58 00:15:33.423 Subsystem Vendor ID: 4e58 00:15:33.423 Serial Number: SPDK1 00:15:33.423 Model Number: SPDK bdev Controller 00:15:33.423 Firmware Version: 24.01.1 00:15:33.423 Recommended Arb Burst: 6 00:15:33.423 IEEE OUI Identifier: 8d 6b 50 00:15:33.423 Multi-path I/O 00:15:33.423 May have multiple subsystem ports: Yes 00:15:33.423 May have multiple controllers: Yes 00:15:33.423 Associated with SR-IOV VF: No 00:15:33.423 Max Data Transfer Size: 131072 00:15:33.423 Max Number of Namespaces: 32 00:15:33.423 Max Number of I/O Queues: 127 00:15:33.423 NVMe Specification Version (VS): 1.3 00:15:33.423 NVMe Specification Version (Identify): 1.3 00:15:33.423 Maximum Queue Entries: 256 00:15:33.423 Contiguous Queues Required: Yes 00:15:33.423 Arbitration Mechanisms Supported 00:15:33.423 Weighted Round Robin: Not Supported 00:15:33.423 Vendor Specific: Not Supported 00:15:33.423 Reset Timeout: 15000 ms 00:15:33.423 Doorbell Stride: 4 bytes 00:15:33.423 NVM Subsystem Reset: Not Supported 00:15:33.423 Command Sets Supported 00:15:33.423 NVM Command Set: Supported 00:15:33.423 Boot Partition: Not Supported 00:15:33.423 Memory Page Size Minimum: 4096 bytes 00:15:33.423 Memory Page Size Maximum: 4096 bytes 00:15:33.423 Persistent Memory Region: Not Supported 00:15:33.423 Optional Asynchronous Events Supported 00:15:33.423 Namespace Attribute Notices: Supported 00:15:33.423 Firmware Activation Notices: Not Supported 00:15:33.423 ANA Change Notices: Not Supported 00:15:33.423 PLE Aggregate Log Change Notices: Not Supported 00:15:33.423 LBA Status Info Alert Notices: Not Supported 00:15:33.423 EGE Aggregate Log Change Notices: Not Supported 00:15:33.423 Normal NVM Subsystem Shutdown event: Not Supported 00:15:33.423 Zone Descriptor Change Notices: Not Supported 00:15:33.423 Discovery Log Change Notices: Not Supported 00:15:33.423 Controller Attributes 00:15:33.423 128-bit Host Identifier: Supported 00:15:33.423 Non-Operational Permissive Mode: Not Supported 00:15:33.423 NVM Sets: Not Supported 00:15:33.423 Read Recovery Levels: Not Supported 00:15:33.423 Endurance Groups: Not Supported 00:15:33.423 Predictable Latency Mode: Not Supported 00:15:33.423 Traffic Based Keep ALive: Not Supported 00:15:33.423 Namespace Granularity: Not Supported 00:15:33.423 SQ Associations: Not Supported 00:15:33.423 UUID List: Not Supported 00:15:33.423 Multi-Domain Subsystem: Not Supported 00:15:33.423 Fixed Capacity Management: Not Supported 00:15:33.423 Variable Capacity Management: Not Supported 00:15:33.423 Delete Endurance Group: Not Supported 00:15:33.423 Delete NVM Set: Not Supported 00:15:33.423 Extended LBA Formats Supported: Not Supported 00:15:33.423 Flexible Data Placement Supported: Not Supported 00:15:33.423 00:15:33.423 Controller Memory Buffer Support 00:15:33.423 ================================ 00:15:33.423 Supported: No 00:15:33.423 00:15:33.423 Persistent Memory Region Support 00:15:33.423 ================================ 00:15:33.423 Supported: No 00:15:33.423 00:15:33.423 Admin Command Set Attributes 00:15:33.423 ============================ 00:15:33.423 Security Send/Receive: Not Supported 00:15:33.423 Format NVM: Not Supported 00:15:33.423 Firmware Activate/Download: Not Supported 00:15:33.423 Namespace Management: Not Supported 00:15:33.423 Device Self-Test: Not Supported 00:15:33.423 Directives: Not Supported 00:15:33.423 NVMe-MI: Not Supported 00:15:33.423 Virtualization Management: Not Supported 00:15:33.423 Doorbell Buffer Config: Not Supported 00:15:33.423 Get LBA Status Capability: Not Supported 00:15:33.423 Command & Feature Lockdown Capability: Not Supported 00:15:33.423 Abort Command Limit: 4 00:15:33.423 Async Event Request Limit: 4 00:15:33.423 Number of Firmware Slots: N/A 00:15:33.423 Firmware Slot 1 Read-Only: N/A 00:15:33.423 Firmware Activation Without Reset: N/A 00:15:33.423 Multiple Update Detection Support: N/A 00:15:33.423 Firmware Update Granularity: No Information Provided 00:15:33.423 Per-Namespace SMART Log: No 00:15:33.423 Asymmetric Namespace Access Log Page: Not Supported 00:15:33.423 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:33.423 Command Effects Log Page: Supported 00:15:33.423 Get Log Page Extended Data: Supported 00:15:33.423 Telemetry Log Pages: Not Supported 00:15:33.423 Persistent Event Log Pages: Not Supported 00:15:33.423 Supported Log Pages Log Page: May Support 00:15:33.423 Commands Supported & Effects Log Page: Not Supported 00:15:33.423 Feature Identifiers & Effects Log Page:May Support 00:15:33.423 NVMe-MI Commands & Effects Log Page: May Support 00:15:33.423 Data Area 4 for Telemetry Log: Not Supported 00:15:33.423 Error Log Page Entries Supported: 128 00:15:33.423 Keep Alive: Supported 00:15:33.423 Keep Alive Granularity: 10000 ms 00:15:33.423 00:15:33.423 NVM Command Set Attributes 00:15:33.423 ========================== 00:15:33.423 Submission Queue Entry Size 00:15:33.423 Max: 64 00:15:33.423 Min: 64 00:15:33.423 Completion Queue Entry Size 00:15:33.423 Max: 16 00:15:33.423 Min: 16 00:15:33.423 Number of Namespaces: 32 00:15:33.423 Compare Command: Supported 00:15:33.423 Write Uncorrectable Command: Not Supported 00:15:33.423 Dataset Management Command: Supported 00:15:33.423 Write Zeroes Command: Supported 00:15:33.423 Set Features Save Field: Not Supported 00:15:33.423 Reservations: Not Supported 00:15:33.423 Timestamp: Not Supported 00:15:33.423 Copy: Supported 00:15:33.423 Volatile Write Cache: Present 00:15:33.423 Atomic Write Unit (Normal): 1 00:15:33.423 Atomic Write Unit (PFail): 1 00:15:33.423 Atomic Compare & Write Unit: 1 00:15:33.423 Fused Compare & Write: Supported 00:15:33.423 Scatter-Gather List 00:15:33.423 SGL Command Set: Supported (Dword aligned) 00:15:33.423 SGL Keyed: Not Supported 00:15:33.423 SGL Bit Bucket Descriptor: Not Supported 00:15:33.423 SGL Metadata Pointer: Not Supported 00:15:33.423 Oversized SGL: Not Supported 00:15:33.423 SGL Metadata Address: Not Supported 00:15:33.423 SGL Offset: Not Supported 00:15:33.423 Transport SGL Data Block: Not Supported 00:15:33.423 Replay Protected Memory Block: Not Supported 00:15:33.423 00:15:33.423 Firmware Slot Information 00:15:33.423 ========================= 00:15:33.423 Active slot: 1 00:15:33.423 Slot 1 Firmware Revision: 24.01.1 00:15:33.423 00:15:33.423 00:15:33.423 Commands Supported and Effects 00:15:33.423 ============================== 00:15:33.423 Admin Commands 00:15:33.423 -------------- 00:15:33.423 Get Log Page (02h): Supported 00:15:33.423 Identify (06h): Supported 00:15:33.423 Abort (08h): Supported 00:15:33.423 Set Features (09h): Supported 00:15:33.423 Get Features (0Ah): Supported 00:15:33.423 Asynchronous Event Request (0Ch): Supported 00:15:33.423 Keep Alive (18h): Supported 00:15:33.423 I/O Commands 00:15:33.423 ------------ 00:15:33.423 Flush (00h): Supported LBA-Change 00:15:33.423 Write (01h): Supported LBA-Change 00:15:33.423 Read (02h): Supported 00:15:33.423 Compare (05h): Supported 00:15:33.423 Write Zeroes (08h): Supported LBA-Change 00:15:33.423 Dataset Management (09h): Supported LBA-Change 00:15:33.423 Copy (19h): Supported LBA-Change 00:15:33.423 Unknown (79h): Supported LBA-Change 00:15:33.423 Unknown (7Ah): Supported 00:15:33.423 00:15:33.423 Error Log 00:15:33.423 ========= 00:15:33.423 00:15:33.423 Arbitration 00:15:33.423 =========== 00:15:33.423 Arbitration Burst: 1 00:15:33.423 00:15:33.423 Power Management 00:15:33.423 ================ 00:15:33.423 Number of Power States: 1 00:15:33.423 Current Power State: Power State #0 00:15:33.423 Power State #0: 00:15:33.423 Max Power: 0.00 W 00:15:33.423 Non-Operational State: Operational 00:15:33.423 Entry Latency: Not Reported 00:15:33.423 Exit Latency: Not Reported 00:15:33.423 Relative Read Throughput: 0 00:15:33.424 Relative Read Latency: 0 00:15:33.424 Relative Write Throughput: 0 00:15:33.424 Relative Write Latency: 0 00:15:33.424 Idle Power: Not Reported 00:15:33.424 Active Power: Not Reported 00:15:33.424 Non-Operational Permissive Mode: Not Supported 00:15:33.424 00:15:33.424 Health Information 00:15:33.424 ================== 00:15:33.424 Critical Warnings: 00:15:33.424 Available Spare Space: OK 00:15:33.424 Temperature: OK 00:15:33.424 Device Reliability: OK 00:15:33.424 Read Only: No 00:15:33.424 Volatile Memory Backup: OK 00:15:33.424 Current Temperature: 0 Kelvin[2024-11-16 16:51:18.950524] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:33.424 [2024-11-16 16:51:18.950540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:33.424 [2024-11-16 16:51:18.950576] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:33.424 [2024-11-16 16:51:18.950593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:33.424 [2024-11-16 16:51:18.950604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:33.424 [2024-11-16 16:51:18.950613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:33.424 [2024-11-16 16:51:18.950652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:33.424 [2024-11-16 16:51:18.954629] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:33.424 [2024-11-16 16:51:18.954651] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:33.424 [2024-11-16 16:51:18.955234] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:33.424 [2024-11-16 16:51:18.955248] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:33.424 [2024-11-16 16:51:18.956200] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:33.424 [2024-11-16 16:51:18.956223] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:33.424 [2024-11-16 16:51:18.956277] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:33.424 [2024-11-16 16:51:18.958242] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:33.424 (-273 Celsius) 00:15:33.424 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:33.424 Available Spare: 0% 00:15:33.424 Available Spare Threshold: 0% 00:15:33.424 Life Percentage Used: 0% 00:15:33.424 Data Units Read: 0 00:15:33.424 Data Units Written: 0 00:15:33.424 Host Read Commands: 0 00:15:33.424 Host Write Commands: 0 00:15:33.424 Controller Busy Time: 0 minutes 00:15:33.424 Power Cycles: 0 00:15:33.424 Power On Hours: 0 hours 00:15:33.424 Unsafe Shutdowns: 0 00:15:33.424 Unrecoverable Media Errors: 0 00:15:33.424 Lifetime Error Log Entries: 0 00:15:33.424 Warning Temperature Time: 0 minutes 00:15:33.424 Critical Temperature Time: 0 minutes 00:15:33.424 00:15:33.424 Number of Queues 00:15:33.424 ================ 00:15:33.424 Number of I/O Submission Queues: 127 00:15:33.424 Number of I/O Completion Queues: 127 00:15:33.424 00:15:33.424 Active Namespaces 00:15:33.424 ================= 00:15:33.424 Namespace ID:1 00:15:33.424 Error Recovery Timeout: Unlimited 00:15:33.424 Command Set Identifier: NVM (00h) 00:15:33.424 Deallocate: Supported 00:15:33.424 Deallocated/Unwritten Error: Not Supported 00:15:33.424 Deallocated Read Value: Unknown 00:15:33.424 Deallocate in Write Zeroes: Not Supported 00:15:33.424 Deallocated Guard Field: 0xFFFF 00:15:33.424 Flush: Supported 00:15:33.424 Reservation: Supported 00:15:33.424 Namespace Sharing Capabilities: Multiple Controllers 00:15:33.424 Size (in LBAs): 131072 (0GiB) 00:15:33.424 Capacity (in LBAs): 131072 (0GiB) 00:15:33.424 Utilization (in LBAs): 131072 (0GiB) 00:15:33.424 NGUID: 7E2483294D0B45F892BA09BA06388A74 00:15:33.424 UUID: 7e248329-4d0b-45f8-92ba-09ba06388a74 00:15:33.424 Thin Provisioning: Not Supported 00:15:33.424 Per-NS Atomic Units: Yes 00:15:33.424 Atomic Boundary Size (Normal): 0 00:15:33.424 Atomic Boundary Size (PFail): 0 00:15:33.424 Atomic Boundary Offset: 0 00:15:33.424 Maximum Single Source Range Length: 65535 00:15:33.424 Maximum Copy Length: 65535 00:15:33.424 Maximum Source Range Count: 1 00:15:33.424 NGUID/EUI64 Never Reused: No 00:15:33.424 Namespace Write Protected: No 00:15:33.424 Number of LBA Formats: 1 00:15:33.424 Current LBA Format: LBA Format #00 00:15:33.424 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:33.424 00:15:33.424 16:51:18 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:33.424 EAL: No free 2048 kB hugepages reported on node 1 00:15:38.691 Initializing NVMe Controllers 00:15:38.691 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:38.691 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:38.691 Initialization complete. Launching workers. 00:15:38.691 ======================================================== 00:15:38.691 Latency(us) 00:15:38.691 Device Information : IOPS MiB/s Average min max 00:15:38.691 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 37367.19 145.97 3425.79 1151.66 7950.52 00:15:38.691 ======================================================== 00:15:38.691 Total : 37367.19 145.97 3425.79 1151.66 7950.52 00:15:38.691 00:15:38.691 16:51:24 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:38.691 EAL: No free 2048 kB hugepages reported on node 1 00:15:43.953 Initializing NVMe Controllers 00:15:43.953 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:43.953 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:43.953 Initialization complete. Launching workers. 00:15:43.953 ======================================================== 00:15:43.953 Latency(us) 00:15:43.953 Device Information : IOPS MiB/s Average min max 00:15:43.953 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16025.68 62.60 7992.47 6631.14 11971.68 00:15:43.953 ======================================================== 00:15:43.953 Total : 16025.68 62.60 7992.47 6631.14 11971.68 00:15:43.953 00:15:43.954 16:51:29 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:43.954 EAL: No free 2048 kB hugepages reported on node 1 00:15:49.218 Initializing NVMe Controllers 00:15:49.218 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:49.218 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:49.218 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:49.218 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:49.218 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:49.218 Initialization complete. Launching workers. 00:15:49.218 Starting thread on core 2 00:15:49.218 Starting thread on core 3 00:15:49.218 Starting thread on core 1 00:15:49.218 16:51:34 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:49.218 EAL: No free 2048 kB hugepages reported on node 1 00:15:52.502 Initializing NVMe Controllers 00:15:52.502 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:52.502 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:52.502 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:52.502 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:52.502 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:52.502 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:52.502 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:52.502 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:52.502 Initialization complete. Launching workers. 00:15:52.502 Starting thread on core 1 with urgent priority queue 00:15:52.502 Starting thread on core 2 with urgent priority queue 00:15:52.502 Starting thread on core 3 with urgent priority queue 00:15:52.502 Starting thread on core 0 with urgent priority queue 00:15:52.502 SPDK bdev Controller (SPDK1 ) core 0: 4491.67 IO/s 22.26 secs/100000 ios 00:15:52.502 SPDK bdev Controller (SPDK1 ) core 1: 4911.00 IO/s 20.36 secs/100000 ios 00:15:52.502 SPDK bdev Controller (SPDK1 ) core 2: 5358.33 IO/s 18.66 secs/100000 ios 00:15:52.502 SPDK bdev Controller (SPDK1 ) core 3: 5345.67 IO/s 18.71 secs/100000 ios 00:15:52.502 ======================================================== 00:15:52.502 00:15:52.502 16:51:38 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:52.759 EAL: No free 2048 kB hugepages reported on node 1 00:15:53.018 Initializing NVMe Controllers 00:15:53.018 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:53.018 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:53.018 Namespace ID: 1 size: 0GB 00:15:53.018 Initialization complete. 00:15:53.018 INFO: using host memory buffer for IO 00:15:53.018 Hello world! 00:15:53.018 16:51:38 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:53.018 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.391 Initializing NVMe Controllers 00:15:54.391 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:54.391 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:54.391 Initialization complete. Launching workers. 00:15:54.391 submit (in ns) avg, min, max = 7878.6, 3446.7, 4016253.3 00:15:54.391 complete (in ns) avg, min, max = 23745.0, 2033.3, 5997778.9 00:15:54.391 00:15:54.391 Submit histogram 00:15:54.391 ================ 00:15:54.391 Range in us Cumulative Count 00:15:54.391 3.437 - 3.461: 0.0644% ( 9) 00:15:54.391 3.461 - 3.484: 0.6006% ( 75) 00:15:54.391 3.484 - 3.508: 2.9244% ( 325) 00:15:54.391 3.508 - 3.532: 6.9498% ( 563) 00:15:54.391 3.532 - 3.556: 16.3592% ( 1316) 00:15:54.391 3.556 - 3.579: 27.1343% ( 1507) 00:15:54.391 3.579 - 3.603: 38.6100% ( 1605) 00:15:54.391 3.603 - 3.627: 46.9040% ( 1160) 00:15:54.391 3.627 - 3.650: 54.0755% ( 1003) 00:15:54.391 3.650 - 3.674: 59.0376% ( 694) 00:15:54.391 3.674 - 3.698: 63.5421% ( 630) 00:15:54.391 3.698 - 3.721: 67.9537% ( 617) 00:15:54.391 3.721 - 3.745: 70.9424% ( 418) 00:15:54.391 3.745 - 3.769: 73.7023% ( 386) 00:15:54.391 3.769 - 3.793: 76.8697% ( 443) 00:15:54.391 3.793 - 3.816: 80.7665% ( 545) 00:15:54.391 3.816 - 3.840: 84.2700% ( 490) 00:15:54.391 3.840 - 3.864: 86.7796% ( 351) 00:15:54.391 3.864 - 3.887: 88.4313% ( 231) 00:15:54.391 3.887 - 3.911: 90.0615% ( 228) 00:15:54.391 3.911 - 3.935: 91.8061% ( 244) 00:15:54.392 3.935 - 3.959: 92.8643% ( 148) 00:15:54.392 3.959 - 3.982: 93.8438% ( 137) 00:15:54.392 3.982 - 4.006: 94.6160% ( 108) 00:15:54.392 4.006 - 4.030: 95.2452% ( 88) 00:15:54.392 4.030 - 4.053: 95.7457% ( 70) 00:15:54.392 4.053 - 4.077: 96.1318% ( 54) 00:15:54.392 4.077 - 4.101: 96.3964% ( 37) 00:15:54.392 4.101 - 4.124: 96.5751% ( 25) 00:15:54.392 4.124 - 4.148: 96.7181% ( 20) 00:15:54.392 4.148 - 4.172: 96.8325% ( 16) 00:15:54.392 4.172 - 4.196: 96.9326% ( 14) 00:15:54.392 4.196 - 4.219: 97.0041% ( 10) 00:15:54.392 4.219 - 4.243: 97.1400% ( 19) 00:15:54.392 4.243 - 4.267: 97.2115% ( 10) 00:15:54.392 4.267 - 4.290: 97.2901% ( 11) 00:15:54.392 4.290 - 4.314: 97.3759% ( 12) 00:15:54.392 4.314 - 4.338: 97.4117% ( 5) 00:15:54.392 4.338 - 4.361: 97.4474% ( 5) 00:15:54.392 4.361 - 4.385: 97.4689% ( 3) 00:15:54.392 4.433 - 4.456: 97.4832% ( 2) 00:15:54.392 4.456 - 4.480: 97.4903% ( 1) 00:15:54.392 4.480 - 4.504: 97.4975% ( 1) 00:15:54.392 4.504 - 4.527: 97.5046% ( 1) 00:15:54.392 4.527 - 4.551: 97.5118% ( 1) 00:15:54.392 4.551 - 4.575: 97.5189% ( 1) 00:15:54.392 4.575 - 4.599: 97.5404% ( 3) 00:15:54.392 4.599 - 4.622: 97.5475% ( 1) 00:15:54.392 4.622 - 4.646: 97.5833% ( 5) 00:15:54.392 4.646 - 4.670: 97.5904% ( 1) 00:15:54.392 4.670 - 4.693: 97.6119% ( 3) 00:15:54.392 4.693 - 4.717: 97.6333% ( 3) 00:15:54.392 4.717 - 4.741: 97.6691% ( 5) 00:15:54.392 4.764 - 4.788: 97.6977% ( 4) 00:15:54.392 4.788 - 4.812: 97.7334% ( 5) 00:15:54.392 4.812 - 4.836: 97.7620% ( 4) 00:15:54.392 4.836 - 4.859: 97.7835% ( 3) 00:15:54.392 4.859 - 4.883: 97.8049% ( 3) 00:15:54.392 4.883 - 4.907: 97.8264% ( 3) 00:15:54.392 4.907 - 4.930: 97.8693% ( 6) 00:15:54.392 4.930 - 4.954: 97.9122% ( 6) 00:15:54.392 4.954 - 4.978: 97.9479% ( 5) 00:15:54.392 4.978 - 5.001: 97.9908% ( 6) 00:15:54.392 5.001 - 5.025: 98.0194% ( 4) 00:15:54.392 5.025 - 5.049: 98.0695% ( 7) 00:15:54.392 5.049 - 5.073: 98.0838% ( 2) 00:15:54.392 5.073 - 5.096: 98.0909% ( 1) 00:15:54.392 5.096 - 5.120: 98.1195% ( 4) 00:15:54.392 5.120 - 5.144: 98.1481% ( 4) 00:15:54.392 5.144 - 5.167: 98.1624% ( 2) 00:15:54.392 5.167 - 5.191: 98.1839% ( 3) 00:15:54.392 5.191 - 5.215: 98.1982% ( 2) 00:15:54.392 5.215 - 5.239: 98.2125% ( 2) 00:15:54.392 5.286 - 5.310: 98.2268% ( 2) 00:15:54.392 5.381 - 5.404: 98.2339% ( 1) 00:15:54.392 5.452 - 5.476: 98.2482% ( 2) 00:15:54.392 5.760 - 5.784: 98.2554% ( 1) 00:15:54.392 5.855 - 5.879: 98.2697% ( 2) 00:15:54.392 5.879 - 5.902: 98.2768% ( 1) 00:15:54.392 5.902 - 5.926: 98.2840% ( 1) 00:15:54.392 5.997 - 6.021: 98.2911% ( 1) 00:15:54.392 6.400 - 6.447: 98.2983% ( 1) 00:15:54.392 6.874 - 6.921: 98.3126% ( 2) 00:15:54.392 7.016 - 7.064: 98.3197% ( 1) 00:15:54.392 7.064 - 7.111: 98.3269% ( 1) 00:15:54.392 7.159 - 7.206: 98.3340% ( 1) 00:15:54.392 7.253 - 7.301: 98.3483% ( 2) 00:15:54.392 7.301 - 7.348: 98.3626% ( 2) 00:15:54.392 7.396 - 7.443: 98.3698% ( 1) 00:15:54.392 7.585 - 7.633: 98.3841% ( 2) 00:15:54.392 7.633 - 7.680: 98.3912% ( 1) 00:15:54.392 7.964 - 8.012: 98.3984% ( 1) 00:15:54.392 8.059 - 8.107: 98.4055% ( 1) 00:15:54.392 8.107 - 8.154: 98.4198% ( 2) 00:15:54.392 8.154 - 8.201: 98.4270% ( 1) 00:15:54.392 8.201 - 8.249: 98.4484% ( 3) 00:15:54.392 8.296 - 8.344: 98.4556% ( 1) 00:15:54.392 8.439 - 8.486: 98.4627% ( 1) 00:15:54.392 8.486 - 8.533: 98.4699% ( 1) 00:15:54.392 8.628 - 8.676: 98.4913% ( 3) 00:15:54.392 8.676 - 8.723: 98.5056% ( 2) 00:15:54.392 8.723 - 8.770: 98.5128% ( 1) 00:15:54.392 8.960 - 9.007: 98.5199% ( 1) 00:15:54.392 9.102 - 9.150: 98.5271% ( 1) 00:15:54.392 9.197 - 9.244: 98.5342% ( 1) 00:15:54.392 9.244 - 9.292: 98.5485% ( 2) 00:15:54.392 9.339 - 9.387: 98.5557% ( 1) 00:15:54.392 9.434 - 9.481: 98.5771% ( 3) 00:15:54.392 9.481 - 9.529: 98.5843% ( 1) 00:15:54.392 9.529 - 9.576: 98.6057% ( 3) 00:15:54.392 9.576 - 9.624: 98.6129% ( 1) 00:15:54.392 9.719 - 9.766: 98.6200% ( 1) 00:15:54.392 9.813 - 9.861: 98.6343% ( 2) 00:15:54.392 10.050 - 10.098: 98.6415% ( 1) 00:15:54.392 10.145 - 10.193: 98.6486% ( 1) 00:15:54.392 10.287 - 10.335: 98.6558% ( 1) 00:15:54.392 10.430 - 10.477: 98.6701% ( 2) 00:15:54.392 10.477 - 10.524: 98.6844% ( 2) 00:15:54.392 10.524 - 10.572: 98.6987% ( 2) 00:15:54.392 10.619 - 10.667: 98.7058% ( 1) 00:15:54.392 10.714 - 10.761: 98.7130% ( 1) 00:15:54.392 10.809 - 10.856: 98.7201% ( 1) 00:15:54.392 10.856 - 10.904: 98.7344% ( 2) 00:15:54.392 10.904 - 10.951: 98.7416% ( 1) 00:15:54.392 11.804 - 11.852: 98.7487% ( 1) 00:15:54.392 11.994 - 12.041: 98.7630% ( 2) 00:15:54.392 12.136 - 12.231: 98.7845% ( 3) 00:15:54.392 12.231 - 12.326: 98.7916% ( 1) 00:15:54.392 12.326 - 12.421: 98.7988% ( 1) 00:15:54.392 12.421 - 12.516: 98.8059% ( 1) 00:15:54.392 12.610 - 12.705: 98.8131% ( 1) 00:15:54.392 12.705 - 12.800: 98.8202% ( 1) 00:15:54.392 12.895 - 12.990: 98.8274% ( 1) 00:15:54.392 13.179 - 13.274: 98.8345% ( 1) 00:15:54.392 13.369 - 13.464: 98.8488% ( 2) 00:15:54.392 13.559 - 13.653: 98.8560% ( 1) 00:15:54.392 13.653 - 13.748: 98.8631% ( 1) 00:15:54.392 13.748 - 13.843: 98.8774% ( 2) 00:15:54.392 14.033 - 14.127: 98.8846% ( 1) 00:15:54.392 14.222 - 14.317: 98.8917% ( 1) 00:15:54.392 14.317 - 14.412: 98.8989% ( 1) 00:15:54.392 15.076 - 15.170: 98.9060% ( 1) 00:15:54.392 15.455 - 15.550: 98.9132% ( 1) 00:15:54.392 16.972 - 17.067: 98.9275% ( 2) 00:15:54.392 17.161 - 17.256: 98.9346% ( 1) 00:15:54.392 17.351 - 17.446: 98.9775% ( 6) 00:15:54.392 17.446 - 17.541: 98.9918% ( 2) 00:15:54.392 17.541 - 17.636: 99.0633% ( 10) 00:15:54.392 17.636 - 17.730: 99.1062% ( 6) 00:15:54.392 17.730 - 17.825: 99.1563% ( 7) 00:15:54.392 17.825 - 17.920: 99.1992% ( 6) 00:15:54.392 17.920 - 18.015: 99.2778% ( 11) 00:15:54.392 18.015 - 18.110: 99.3136% ( 5) 00:15:54.392 18.110 - 18.204: 99.3565% ( 6) 00:15:54.392 18.204 - 18.299: 99.4709% ( 16) 00:15:54.392 18.299 - 18.394: 99.5424% ( 10) 00:15:54.392 18.394 - 18.489: 99.5996% ( 8) 00:15:54.392 18.489 - 18.584: 99.6425% ( 6) 00:15:54.392 18.584 - 18.679: 99.6997% ( 8) 00:15:54.392 18.679 - 18.773: 99.7283% ( 4) 00:15:54.392 18.773 - 18.868: 99.7354% ( 1) 00:15:54.392 18.868 - 18.963: 99.7497% ( 2) 00:15:54.392 18.963 - 19.058: 99.7569% ( 1) 00:15:54.392 19.058 - 19.153: 99.7855% ( 4) 00:15:54.392 19.153 - 19.247: 99.8212% ( 5) 00:15:54.392 19.437 - 19.532: 99.8284% ( 1) 00:15:54.392 19.532 - 19.627: 99.8427% ( 2) 00:15:54.392 19.911 - 20.006: 99.8498% ( 1) 00:15:54.392 20.196 - 20.290: 99.8641% ( 2) 00:15:54.392 20.954 - 21.049: 99.8713% ( 1) 00:15:54.392 22.092 - 22.187: 99.8784% ( 1) 00:15:54.392 23.514 - 23.609: 99.8856% ( 1) 00:15:54.392 24.273 - 24.462: 99.8927% ( 1) 00:15:54.392 28.444 - 28.634: 99.8999% ( 1) 00:15:54.392 3980.705 - 4004.978: 99.9785% ( 11) 00:15:54.392 4004.978 - 4029.250: 100.0000% ( 3) 00:15:54.392 00:15:54.392 Complete histogram 00:15:54.392 ================== 00:15:54.392 Range in us Cumulative Count 00:15:54.392 2.027 - 2.039: 0.2646% ( 37) 00:15:54.392 2.039 - 2.050: 10.7894% ( 1472) 00:15:54.392 2.050 - 2.062: 16.1018% ( 743) 00:15:54.392 2.062 - 2.074: 22.4510% ( 888) 00:15:54.392 2.074 - 2.086: 54.1113% ( 4428) 00:15:54.392 2.086 - 2.098: 62.8915% ( 1228) 00:15:54.392 2.098 - 2.110: 65.3082% ( 338) 00:15:54.392 2.110 - 2.121: 70.0057% ( 657) 00:15:54.392 2.121 - 2.133: 70.7279% ( 101) 00:15:54.392 2.133 - 2.145: 76.2977% ( 779) 00:15:54.392 2.145 - 2.157: 86.4650% ( 1422) 00:15:54.392 2.157 - 2.169: 88.4527% ( 278) 00:15:54.392 2.169 - 2.181: 90.0901% ( 229) 00:15:54.392 2.181 - 2.193: 91.6273% ( 215) 00:15:54.392 2.193 - 2.204: 92.0349% ( 57) 00:15:54.392 2.204 - 2.216: 93.5721% ( 215) 00:15:54.392 2.216 - 2.228: 95.1451% ( 220) 00:15:54.392 2.228 - 2.240: 95.4383% ( 41) 00:15:54.392 2.240 - 2.252: 95.7529% ( 44) 00:15:54.392 2.252 - 2.264: 96.0246% ( 38) 00:15:54.392 2.264 - 2.276: 96.0889% ( 9) 00:15:54.392 2.276 - 2.287: 96.2462% ( 22) 00:15:54.392 2.287 - 2.299: 96.3249% ( 11) 00:15:54.392 2.299 - 2.311: 96.3678% ( 6) 00:15:54.392 2.311 - 2.323: 96.5465% ( 25) 00:15:54.392 2.323 - 2.335: 96.6967% ( 21) 00:15:54.392 2.335 - 2.347: 96.8468% ( 21) 00:15:54.392 2.347 - 2.359: 97.0899% ( 34) 00:15:54.392 2.359 - 2.370: 97.4188% ( 46) 00:15:54.392 2.370 - 2.382: 97.5976% ( 25) 00:15:54.392 2.382 - 2.394: 97.8407% ( 34) 00:15:54.392 2.394 - 2.406: 98.0480% ( 29) 00:15:54.392 2.406 - 2.418: 98.1910% ( 20) 00:15:54.392 2.418 - 2.430: 98.3483% ( 22) 00:15:54.392 2.430 - 2.441: 98.4699% ( 17) 00:15:54.392 2.441 - 2.453: 98.5199% ( 7) 00:15:54.392 2.453 - 2.465: 98.5485% ( 4) 00:15:54.392 2.465 - 2.477: 98.5628% ( 2) 00:15:54.392 2.477 - 2.489: 98.5771% ( 2) 00:15:54.392 2.489 - 2.501: 98.5986% ( 3) 00:15:54.392 2.501 - 2.513: 98.6057% ( 1) 00:15:54.392 2.513 - 2.524: 98.6200% ( 2) 00:15:54.392 2.524 - 2.536: 98.6272% ( 1) 00:15:54.392 2.536 - 2.548: 98.6343% ( 1) 00:15:54.392 2.548 - 2.560: 98.6486% ( 2) 00:15:54.392 2.560 - 2.572: 98.6558% ( 1) 00:15:54.392 2.572 - 2.584: 98.6629% ( 1) 00:15:54.392 2.584 - 2.596: 98.6844% ( 3) 00:15:54.392 2.596 - 2.607: 98.6987% ( 2) 00:15:54.392 2.607 - 2.619: 98.7058% ( 1) 00:15:54.392 2.631 - 2.643: 98.7130% ( 1) 00:15:54.392 2.690 - 2.702: 98.7201% ( 1) 00:15:54.392 2.714 - 2.726: 98.7273% ( 1) 00:15:54.393 2.738 - 2.750: 98.7344% ( 1) 00:15:54.393 3.224 - 3.247: 98.7416% ( 1) 00:15:54.393 3.271 - 3.295: 98.7559% ( 2) 00:15:54.393 3.295 - 3.319: 98.7630% ( 1) 00:15:54.393 3.319 - 3.342: 98.7702% ( 1) 00:15:54.393 3.437 - 3.461: 98.7773% ( 1) 00:15:54.393 3.461 - 3.484: 98.7988% ( 3) 00:15:54.393 3.484 - 3.508: 98.8131% ( 2) 00:15:54.393 3.508 - 3.532: 98.8274% ( 2) 00:15:54.393 3.532 - 3.556: 98.8417% ( 2) 00:15:54.393 3.556 - 3.579: 98.8488% ( 1) 00:15:54.393 3.579 - 3.603: 98.8560% ( 1) 00:15:54.393 3.603 - 3.627: 98.8631% ( 1) 00:15:54.393 3.698 - 3.721: 98.8774% ( 2) 00:15:54.393 3.745 - 3.769: 98.8846% ( 1) 00:15:54.393 3.769 - 3.793: 98.8917% ( 1) 00:15:54.393 3.840 - 3.864: 98.8989% ( 1) 00:15:54.393 4.361 - 4.385: 98.9060% ( 1) 00:15:54.393 5.784 - 5.807: 98.9132% ( 1) 00:15:54.393 5.973 - 5.997: 98.9203% ( 1) 00:15:54.393 6.116 - 6.163: 98.9275% ( 1) 00:15:54.393 6.210 - 6.258: 98.9346% ( 1) 00:15:54.393 6.400 - 6.447: 98.9418% ( 1) 00:15:54.393 6.447 - 6.495: 98.9489% ( 1) 00:15:54.393 6.495 - 6.542: 98.9561% ( 1) 00:15:54.393 6.921 - 6.969: 98.9632% ( 1) 00:15:54.393 7.159 - 7.206: 98.9704% ( 1) 00:15:54.393 7.443 - 7.490: 98.9775% ( 1) 00:15:54.393 7.490 - 7.538: 98.9847% ( 1) 00:15:54.393 7.633 - 7.680: 98.9918% ( 1) 00:15:54.393 7.870 - 7.917: 98.9990% ( 1) 00:15:54.393 8.249 - 8.296: 99.0061% ( 1) 00:15:54.393 9.102 - 9.150: 99.0133% ( 1) 00:15:54.393 10.098 - 10.145: 99.0204% ( 1) 00:15:54.393 11.567 - 11.615: 99.0276% ( 1) 00:15:54.393 13.748 - 13.843: 99.0347% ( 1) 00:15:54.393 15.644 - 15.739: 99.0562% ( 3) 00:15:54.393 15.739 - 15.834: 99.0633% ( 1) 00:15:54.393 15.929 - 16.024: 99.0848% ( 3) 00:15:54.393 16.024 - 16.119: 99.1062% ( 3) 00:15:54.393 16.119 - 16.213: 99.1277% ( 3) 00:15:54.393 16.213 - 16.308: 99.1420% ( 2) 00:15:54.393 16.308 - 16.403: 99.1634% ( 3) 00:15:54.393 16.403 - 16.498: 99.1920% ( 4) 00:15:54.393 16.498 - 16.593: 99.2278% ( 5) 00:15:54.393 16.593 - 16.687: 99.2564% ( 4) 00:15:54.393 16.687 - 16.782: 99.2707% ( 2) 00:15:54.393 16.782 - 16.877: 99.2993% ( 4) 00:15:54.393 16.877 - 16.972: 99.3207% ( 3) 00:15:54.393 16.972 - 17.067: 99.3279% ( 1) 00:15:54.393 17.256 - 17.351: 99.3422% ( 2) 00:15:54.393 17.351 - 17.446: 99.3493% ( 1) 00:15:54.393 17.541 - 17.636: 99.3708% ( 3) 00:15:54.393 17.636 - 17.730: 99.3851% ( 2) 00:15:54.393 17.730 - 17.825: 99.3994% ( 2) 00:15:54.393 17.825 - 17.920: 99.4065% ( 1) 00:15:54.393 18.015 - 18.110: 99.4208% ( 2) 00:15:54.393 18.110 - 18.204: 99.4280% ( 1) 00:15:54.393 18.299 - 18.394: 99.4351% ( 1) 00:15:54.393 18.489 - 18.584: 99.4423% ( 1) 00:15:54.393 18.679 - 18.773: 99.4494% ( 1) 00:15:54.393 21.902 - 21.997: 99.4566% ( 1) 00:15:54.393 23.230 - 23.324: 99.4637% ( 1) 00:15:54.393 2014.625 - 2026.761: 99.4709% ( 1) 00:15:54.393 2390.850 - 2402.987: 99.4780% ( 1) 00:15:54.393 3980.705 - 4004.978: 99.8069% ( 46) 00:15:54.393 4004.978 - 4029.250: 99.9785% ( 24) 00:15:54.393 4975.881 - 5000.154: 99.9857% ( 1) 00:15:54.393 5995.330 - 6019.603: 100.0000% ( 2) 00:15:54.393 00:15:54.393 16:51:39 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:15:54.393 16:51:39 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:54.393 16:51:39 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:15:54.393 16:51:39 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:15:54.393 16:51:39 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:54.651 [2024-11-16 16:51:40.146295] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:15:54.651 [ 00:15:54.651 { 00:15:54.651 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:54.651 "subtype": "Discovery", 00:15:54.651 "listen_addresses": [], 00:15:54.651 "allow_any_host": true, 00:15:54.651 "hosts": [] 00:15:54.651 }, 00:15:54.651 { 00:15:54.651 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:54.651 "subtype": "NVMe", 00:15:54.651 "listen_addresses": [ 00:15:54.651 { 00:15:54.651 "transport": "VFIOUSER", 00:15:54.651 "trtype": "VFIOUSER", 00:15:54.651 "adrfam": "IPv4", 00:15:54.651 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:54.651 "trsvcid": "0" 00:15:54.651 } 00:15:54.651 ], 00:15:54.651 "allow_any_host": true, 00:15:54.651 "hosts": [], 00:15:54.651 "serial_number": "SPDK1", 00:15:54.651 "model_number": "SPDK bdev Controller", 00:15:54.651 "max_namespaces": 32, 00:15:54.651 "min_cntlid": 1, 00:15:54.651 "max_cntlid": 65519, 00:15:54.651 "namespaces": [ 00:15:54.651 { 00:15:54.651 "nsid": 1, 00:15:54.651 "bdev_name": "Malloc1", 00:15:54.651 "name": "Malloc1", 00:15:54.651 "nguid": "7E2483294D0B45F892BA09BA06388A74", 00:15:54.651 "uuid": "7e248329-4d0b-45f8-92ba-09ba06388a74" 00:15:54.651 } 00:15:54.651 ] 00:15:54.651 }, 00:15:54.651 { 00:15:54.651 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:54.651 "subtype": "NVMe", 00:15:54.651 "listen_addresses": [ 00:15:54.651 { 00:15:54.651 "transport": "VFIOUSER", 00:15:54.651 "trtype": "VFIOUSER", 00:15:54.651 "adrfam": "IPv4", 00:15:54.651 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:54.651 "trsvcid": "0" 00:15:54.651 } 00:15:54.651 ], 00:15:54.651 "allow_any_host": true, 00:15:54.651 "hosts": [], 00:15:54.651 "serial_number": "SPDK2", 00:15:54.651 "model_number": "SPDK bdev Controller", 00:15:54.651 "max_namespaces": 32, 00:15:54.651 "min_cntlid": 1, 00:15:54.651 "max_cntlid": 65519, 00:15:54.651 "namespaces": [ 00:15:54.651 { 00:15:54.651 "nsid": 1, 00:15:54.651 "bdev_name": "Malloc2", 00:15:54.651 "name": "Malloc2", 00:15:54.651 "nguid": "E64AA20331AF4471880CA996DC1DDB0C", 00:15:54.651 "uuid": "e64aa203-31af-4471-880c-a996dc1ddb0c" 00:15:54.651 } 00:15:54.651 ] 00:15:54.651 } 00:15:54.651 ] 00:15:54.651 16:51:40 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:54.651 16:51:40 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1174906 00:15:54.651 16:51:40 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:15:54.651 16:51:40 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:54.651 16:51:40 -- common/autotest_common.sh@1254 -- # local i=0 00:15:54.651 16:51:40 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:54.651 16:51:40 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:54.651 16:51:40 -- common/autotest_common.sh@1265 -- # return 0 00:15:54.651 16:51:40 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:54.651 16:51:40 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:15:54.651 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.909 Malloc3 00:15:54.909 16:51:40 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:15:55.166 16:51:40 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:55.166 Asynchronous Event Request test 00:15:55.166 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:55.166 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:55.166 Registering asynchronous event callbacks... 00:15:55.166 Starting namespace attribute notice tests for all controllers... 00:15:55.166 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:55.166 aer_cb - Changed Namespace 00:15:55.166 Cleaning up... 00:15:55.426 [ 00:15:55.426 { 00:15:55.426 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:55.426 "subtype": "Discovery", 00:15:55.426 "listen_addresses": [], 00:15:55.426 "allow_any_host": true, 00:15:55.426 "hosts": [] 00:15:55.426 }, 00:15:55.426 { 00:15:55.426 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:55.426 "subtype": "NVMe", 00:15:55.426 "listen_addresses": [ 00:15:55.426 { 00:15:55.426 "transport": "VFIOUSER", 00:15:55.426 "trtype": "VFIOUSER", 00:15:55.426 "adrfam": "IPv4", 00:15:55.426 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:55.426 "trsvcid": "0" 00:15:55.426 } 00:15:55.426 ], 00:15:55.426 "allow_any_host": true, 00:15:55.426 "hosts": [], 00:15:55.426 "serial_number": "SPDK1", 00:15:55.426 "model_number": "SPDK bdev Controller", 00:15:55.426 "max_namespaces": 32, 00:15:55.426 "min_cntlid": 1, 00:15:55.426 "max_cntlid": 65519, 00:15:55.426 "namespaces": [ 00:15:55.426 { 00:15:55.426 "nsid": 1, 00:15:55.426 "bdev_name": "Malloc1", 00:15:55.426 "name": "Malloc1", 00:15:55.426 "nguid": "7E2483294D0B45F892BA09BA06388A74", 00:15:55.426 "uuid": "7e248329-4d0b-45f8-92ba-09ba06388a74" 00:15:55.426 }, 00:15:55.426 { 00:15:55.426 "nsid": 2, 00:15:55.426 "bdev_name": "Malloc3", 00:15:55.426 "name": "Malloc3", 00:15:55.426 "nguid": "46BC88615A0F45D1BEB1644E0D093ECA", 00:15:55.426 "uuid": "46bc8861-5a0f-45d1-beb1-644e0d093eca" 00:15:55.426 } 00:15:55.426 ] 00:15:55.426 }, 00:15:55.426 { 00:15:55.426 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:55.426 "subtype": "NVMe", 00:15:55.426 "listen_addresses": [ 00:15:55.426 { 00:15:55.426 "transport": "VFIOUSER", 00:15:55.426 "trtype": "VFIOUSER", 00:15:55.426 "adrfam": "IPv4", 00:15:55.426 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:55.426 "trsvcid": "0" 00:15:55.426 } 00:15:55.426 ], 00:15:55.426 "allow_any_host": true, 00:15:55.426 "hosts": [], 00:15:55.426 "serial_number": "SPDK2", 00:15:55.426 "model_number": "SPDK bdev Controller", 00:15:55.426 "max_namespaces": 32, 00:15:55.426 "min_cntlid": 1, 00:15:55.426 "max_cntlid": 65519, 00:15:55.426 "namespaces": [ 00:15:55.426 { 00:15:55.426 "nsid": 1, 00:15:55.426 "bdev_name": "Malloc2", 00:15:55.426 "name": "Malloc2", 00:15:55.426 "nguid": "E64AA20331AF4471880CA996DC1DDB0C", 00:15:55.426 "uuid": "e64aa203-31af-4471-880c-a996dc1ddb0c" 00:15:55.426 } 00:15:55.426 ] 00:15:55.426 } 00:15:55.426 ] 00:15:55.426 16:51:40 -- target/nvmf_vfio_user.sh@44 -- # wait 1174906 00:15:55.426 16:51:40 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:55.426 16:51:40 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:55.426 16:51:40 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:15:55.426 16:51:40 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:55.426 [2024-11-16 16:51:41.005945] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:55.426 [2024-11-16 16:51:41.005988] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1175048 ] 00:15:55.426 EAL: No free 2048 kB hugepages reported on node 1 00:15:55.426 [2024-11-16 16:51:41.037136] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:15:55.426 [2024-11-16 16:51:41.049912] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:55.426 [2024-11-16 16:51:41.049958] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f516b2e6000 00:15:55.426 [2024-11-16 16:51:41.050925] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:55.426 [2024-11-16 16:51:41.051936] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:55.426 [2024-11-16 16:51:41.052947] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:55.426 [2024-11-16 16:51:41.053956] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:55.426 [2024-11-16 16:51:41.054960] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:55.426 [2024-11-16 16:51:41.055969] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:55.426 [2024-11-16 16:51:41.056992] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:55.426 [2024-11-16 16:51:41.057984] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:55.427 [2024-11-16 16:51:41.058991] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:55.427 [2024-11-16 16:51:41.059013] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f5169fe0000 00:15:55.427 [2024-11-16 16:51:41.060145] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:55.427 [2024-11-16 16:51:41.074938] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:15:55.427 [2024-11-16 16:51:41.074976] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:15:55.427 [2024-11-16 16:51:41.077081] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:55.427 [2024-11-16 16:51:41.077134] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:55.427 [2024-11-16 16:51:41.077224] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:15:55.427 [2024-11-16 16:51:41.077253] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:15:55.427 [2024-11-16 16:51:41.077263] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:15:55.427 [2024-11-16 16:51:41.078073] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:15:55.427 [2024-11-16 16:51:41.078094] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:15:55.427 [2024-11-16 16:51:41.078106] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:15:55.427 [2024-11-16 16:51:41.079081] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:55.427 [2024-11-16 16:51:41.079101] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:15:55.427 [2024-11-16 16:51:41.079116] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:15:55.427 [2024-11-16 16:51:41.080087] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:15:55.427 [2024-11-16 16:51:41.080107] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:55.427 [2024-11-16 16:51:41.081095] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:15:55.427 [2024-11-16 16:51:41.081114] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:15:55.427 [2024-11-16 16:51:41.081124] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:15:55.427 [2024-11-16 16:51:41.081135] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:55.427 [2024-11-16 16:51:41.081244] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:15:55.427 [2024-11-16 16:51:41.081252] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:55.427 [2024-11-16 16:51:41.081260] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:15:55.427 [2024-11-16 16:51:41.082108] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:15:55.427 [2024-11-16 16:51:41.083116] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:15:55.427 [2024-11-16 16:51:41.084121] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:55.427 [2024-11-16 16:51:41.085145] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:55.427 [2024-11-16 16:51:41.086150] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:15:55.427 [2024-11-16 16:51:41.086170] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:55.427 [2024-11-16 16:51:41.086179] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:15:55.427 [2024-11-16 16:51:41.086202] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:15:55.427 [2024-11-16 16:51:41.086215] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:15:55.427 [2024-11-16 16:51:41.086236] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:55.427 [2024-11-16 16:51:41.086246] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:55.427 [2024-11-16 16:51:41.086267] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:55.427 [2024-11-16 16:51:41.092633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:55.427 [2024-11-16 16:51:41.092657] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:15:55.427 [2024-11-16 16:51:41.092666] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:15:55.427 [2024-11-16 16:51:41.092673] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:15:55.427 [2024-11-16 16:51:41.092681] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:55.427 [2024-11-16 16:51:41.092689] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:15:55.427 [2024-11-16 16:51:41.092696] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:15:55.427 [2024-11-16 16:51:41.092705] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:15:55.427 [2024-11-16 16:51:41.092722] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:15:55.427 [2024-11-16 16:51:41.092740] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:55.427 [2024-11-16 16:51:41.100630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:55.427 [2024-11-16 16:51:41.100659] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:55.427 [2024-11-16 16:51:41.100674] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:55.427 [2024-11-16 16:51:41.100686] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:55.427 [2024-11-16 16:51:41.100698] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:55.427 [2024-11-16 16:51:41.100706] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:15:55.427 [2024-11-16 16:51:41.100725] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:55.427 [2024-11-16 16:51:41.100740] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:55.427 [2024-11-16 16:51:41.108628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:55.427 [2024-11-16 16:51:41.108648] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:15:55.427 [2024-11-16 16:51:41.108656] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:55.427 [2024-11-16 16:51:41.108668] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:15:55.427 [2024-11-16 16:51:41.108682] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:15:55.427 [2024-11-16 16:51:41.108697] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:55.427 [2024-11-16 16:51:41.116627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:55.428 [2024-11-16 16:51:41.116698] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:15:55.428 [2024-11-16 16:51:41.116713] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:15:55.428 [2024-11-16 16:51:41.116726] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:55.428 [2024-11-16 16:51:41.116734] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:55.428 [2024-11-16 16:51:41.116744] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:55.428 [2024-11-16 16:51:41.124628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:55.428 [2024-11-16 16:51:41.124656] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:15:55.428 [2024-11-16 16:51:41.124675] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:15:55.428 [2024-11-16 16:51:41.124690] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:15:55.428 [2024-11-16 16:51:41.124703] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:55.428 [2024-11-16 16:51:41.124711] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:55.428 [2024-11-16 16:51:41.124721] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:55.428 [2024-11-16 16:51:41.132629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:55.428 [2024-11-16 16:51:41.132657] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:55.428 [2024-11-16 16:51:41.132673] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:55.428 [2024-11-16 16:51:41.132687] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:55.428 [2024-11-16 16:51:41.132698] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:55.428 [2024-11-16 16:51:41.132709] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:55.428 [2024-11-16 16:51:41.140628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:55.428 [2024-11-16 16:51:41.140649] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:55.428 [2024-11-16 16:51:41.140661] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:15:55.428 [2024-11-16 16:51:41.140676] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:15:55.428 [2024-11-16 16:51:41.140688] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:55.428 [2024-11-16 16:51:41.140696] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:15:55.428 [2024-11-16 16:51:41.140705] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:15:55.428 [2024-11-16 16:51:41.140712] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:15:55.428 [2024-11-16 16:51:41.140721] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:15:55.428 [2024-11-16 16:51:41.140745] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:55.428 [2024-11-16 16:51:41.148628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:55.428 [2024-11-16 16:51:41.148654] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:55.428 [2024-11-16 16:51:41.156641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:55.428 [2024-11-16 16:51:41.156667] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:55.428 [2024-11-16 16:51:41.164626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:55.428 [2024-11-16 16:51:41.164650] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:55.428 [2024-11-16 16:51:41.172628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:55.428 [2024-11-16 16:51:41.172656] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:55.428 [2024-11-16 16:51:41.172667] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:55.428 [2024-11-16 16:51:41.172673] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:55.428 [2024-11-16 16:51:41.172679] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:55.428 [2024-11-16 16:51:41.172689] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:55.428 [2024-11-16 16:51:41.172701] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:55.428 [2024-11-16 16:51:41.172709] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:55.428 [2024-11-16 16:51:41.172718] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:55.428 [2024-11-16 16:51:41.172734] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:55.428 [2024-11-16 16:51:41.172742] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:55.428 [2024-11-16 16:51:41.172751] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:55.428 [2024-11-16 16:51:41.172763] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:55.428 [2024-11-16 16:51:41.172772] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:55.428 [2024-11-16 16:51:41.172781] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:55.687 [2024-11-16 16:51:41.180629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:55.687 [2024-11-16 16:51:41.180658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:55.687 [2024-11-16 16:51:41.180675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:55.687 [2024-11-16 16:51:41.180687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:55.687 ===================================================== 00:15:55.687 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:55.687 ===================================================== 00:15:55.687 Controller Capabilities/Features 00:15:55.687 ================================ 00:15:55.687 Vendor ID: 4e58 00:15:55.687 Subsystem Vendor ID: 4e58 00:15:55.687 Serial Number: SPDK2 00:15:55.687 Model Number: SPDK bdev Controller 00:15:55.687 Firmware Version: 24.01.1 00:15:55.687 Recommended Arb Burst: 6 00:15:55.687 IEEE OUI Identifier: 8d 6b 50 00:15:55.687 Multi-path I/O 00:15:55.687 May have multiple subsystem ports: Yes 00:15:55.687 May have multiple controllers: Yes 00:15:55.687 Associated with SR-IOV VF: No 00:15:55.687 Max Data Transfer Size: 131072 00:15:55.687 Max Number of Namespaces: 32 00:15:55.687 Max Number of I/O Queues: 127 00:15:55.687 NVMe Specification Version (VS): 1.3 00:15:55.688 NVMe Specification Version (Identify): 1.3 00:15:55.688 Maximum Queue Entries: 256 00:15:55.688 Contiguous Queues Required: Yes 00:15:55.688 Arbitration Mechanisms Supported 00:15:55.688 Weighted Round Robin: Not Supported 00:15:55.688 Vendor Specific: Not Supported 00:15:55.688 Reset Timeout: 15000 ms 00:15:55.688 Doorbell Stride: 4 bytes 00:15:55.688 NVM Subsystem Reset: Not Supported 00:15:55.688 Command Sets Supported 00:15:55.688 NVM Command Set: Supported 00:15:55.688 Boot Partition: Not Supported 00:15:55.688 Memory Page Size Minimum: 4096 bytes 00:15:55.688 Memory Page Size Maximum: 4096 bytes 00:15:55.688 Persistent Memory Region: Not Supported 00:15:55.688 Optional Asynchronous Events Supported 00:15:55.688 Namespace Attribute Notices: Supported 00:15:55.688 Firmware Activation Notices: Not Supported 00:15:55.688 ANA Change Notices: Not Supported 00:15:55.688 PLE Aggregate Log Change Notices: Not Supported 00:15:55.688 LBA Status Info Alert Notices: Not Supported 00:15:55.688 EGE Aggregate Log Change Notices: Not Supported 00:15:55.688 Normal NVM Subsystem Shutdown event: Not Supported 00:15:55.688 Zone Descriptor Change Notices: Not Supported 00:15:55.688 Discovery Log Change Notices: Not Supported 00:15:55.688 Controller Attributes 00:15:55.688 128-bit Host Identifier: Supported 00:15:55.688 Non-Operational Permissive Mode: Not Supported 00:15:55.688 NVM Sets: Not Supported 00:15:55.688 Read Recovery Levels: Not Supported 00:15:55.688 Endurance Groups: Not Supported 00:15:55.688 Predictable Latency Mode: Not Supported 00:15:55.688 Traffic Based Keep ALive: Not Supported 00:15:55.688 Namespace Granularity: Not Supported 00:15:55.688 SQ Associations: Not Supported 00:15:55.688 UUID List: Not Supported 00:15:55.688 Multi-Domain Subsystem: Not Supported 00:15:55.688 Fixed Capacity Management: Not Supported 00:15:55.688 Variable Capacity Management: Not Supported 00:15:55.688 Delete Endurance Group: Not Supported 00:15:55.688 Delete NVM Set: Not Supported 00:15:55.688 Extended LBA Formats Supported: Not Supported 00:15:55.688 Flexible Data Placement Supported: Not Supported 00:15:55.688 00:15:55.688 Controller Memory Buffer Support 00:15:55.688 ================================ 00:15:55.688 Supported: No 00:15:55.688 00:15:55.688 Persistent Memory Region Support 00:15:55.688 ================================ 00:15:55.688 Supported: No 00:15:55.688 00:15:55.688 Admin Command Set Attributes 00:15:55.688 ============================ 00:15:55.688 Security Send/Receive: Not Supported 00:15:55.688 Format NVM: Not Supported 00:15:55.688 Firmware Activate/Download: Not Supported 00:15:55.688 Namespace Management: Not Supported 00:15:55.688 Device Self-Test: Not Supported 00:15:55.688 Directives: Not Supported 00:15:55.688 NVMe-MI: Not Supported 00:15:55.688 Virtualization Management: Not Supported 00:15:55.688 Doorbell Buffer Config: Not Supported 00:15:55.688 Get LBA Status Capability: Not Supported 00:15:55.688 Command & Feature Lockdown Capability: Not Supported 00:15:55.688 Abort Command Limit: 4 00:15:55.688 Async Event Request Limit: 4 00:15:55.688 Number of Firmware Slots: N/A 00:15:55.688 Firmware Slot 1 Read-Only: N/A 00:15:55.688 Firmware Activation Without Reset: N/A 00:15:55.688 Multiple Update Detection Support: N/A 00:15:55.688 Firmware Update Granularity: No Information Provided 00:15:55.688 Per-Namespace SMART Log: No 00:15:55.688 Asymmetric Namespace Access Log Page: Not Supported 00:15:55.688 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:15:55.688 Command Effects Log Page: Supported 00:15:55.688 Get Log Page Extended Data: Supported 00:15:55.688 Telemetry Log Pages: Not Supported 00:15:55.688 Persistent Event Log Pages: Not Supported 00:15:55.688 Supported Log Pages Log Page: May Support 00:15:55.688 Commands Supported & Effects Log Page: Not Supported 00:15:55.688 Feature Identifiers & Effects Log Page:May Support 00:15:55.688 NVMe-MI Commands & Effects Log Page: May Support 00:15:55.688 Data Area 4 for Telemetry Log: Not Supported 00:15:55.688 Error Log Page Entries Supported: 128 00:15:55.688 Keep Alive: Supported 00:15:55.688 Keep Alive Granularity: 10000 ms 00:15:55.688 00:15:55.688 NVM Command Set Attributes 00:15:55.688 ========================== 00:15:55.688 Submission Queue Entry Size 00:15:55.688 Max: 64 00:15:55.688 Min: 64 00:15:55.688 Completion Queue Entry Size 00:15:55.688 Max: 16 00:15:55.688 Min: 16 00:15:55.688 Number of Namespaces: 32 00:15:55.688 Compare Command: Supported 00:15:55.688 Write Uncorrectable Command: Not Supported 00:15:55.688 Dataset Management Command: Supported 00:15:55.688 Write Zeroes Command: Supported 00:15:55.688 Set Features Save Field: Not Supported 00:15:55.688 Reservations: Not Supported 00:15:55.688 Timestamp: Not Supported 00:15:55.688 Copy: Supported 00:15:55.688 Volatile Write Cache: Present 00:15:55.688 Atomic Write Unit (Normal): 1 00:15:55.688 Atomic Write Unit (PFail): 1 00:15:55.688 Atomic Compare & Write Unit: 1 00:15:55.688 Fused Compare & Write: Supported 00:15:55.688 Scatter-Gather List 00:15:55.688 SGL Command Set: Supported (Dword aligned) 00:15:55.688 SGL Keyed: Not Supported 00:15:55.688 SGL Bit Bucket Descriptor: Not Supported 00:15:55.688 SGL Metadata Pointer: Not Supported 00:15:55.688 Oversized SGL: Not Supported 00:15:55.688 SGL Metadata Address: Not Supported 00:15:55.688 SGL Offset: Not Supported 00:15:55.688 Transport SGL Data Block: Not Supported 00:15:55.688 Replay Protected Memory Block: Not Supported 00:15:55.688 00:15:55.688 Firmware Slot Information 00:15:55.688 ========================= 00:15:55.688 Active slot: 1 00:15:55.688 Slot 1 Firmware Revision: 24.01.1 00:15:55.688 00:15:55.688 00:15:55.688 Commands Supported and Effects 00:15:55.688 ============================== 00:15:55.688 Admin Commands 00:15:55.688 -------------- 00:15:55.688 Get Log Page (02h): Supported 00:15:55.688 Identify (06h): Supported 00:15:55.688 Abort (08h): Supported 00:15:55.688 Set Features (09h): Supported 00:15:55.688 Get Features (0Ah): Supported 00:15:55.688 Asynchronous Event Request (0Ch): Supported 00:15:55.688 Keep Alive (18h): Supported 00:15:55.688 I/O Commands 00:15:55.688 ------------ 00:15:55.688 Flush (00h): Supported LBA-Change 00:15:55.688 Write (01h): Supported LBA-Change 00:15:55.688 Read (02h): Supported 00:15:55.688 Compare (05h): Supported 00:15:55.688 Write Zeroes (08h): Supported LBA-Change 00:15:55.688 Dataset Management (09h): Supported LBA-Change 00:15:55.688 Copy (19h): Supported LBA-Change 00:15:55.688 Unknown (79h): Supported LBA-Change 00:15:55.688 Unknown (7Ah): Supported 00:15:55.688 00:15:55.688 Error Log 00:15:55.688 ========= 00:15:55.688 00:15:55.688 Arbitration 00:15:55.688 =========== 00:15:55.688 Arbitration Burst: 1 00:15:55.688 00:15:55.688 Power Management 00:15:55.688 ================ 00:15:55.688 Number of Power States: 1 00:15:55.688 Current Power State: Power State #0 00:15:55.688 Power State #0: 00:15:55.688 Max Power: 0.00 W 00:15:55.688 Non-Operational State: Operational 00:15:55.688 Entry Latency: Not Reported 00:15:55.688 Exit Latency: Not Reported 00:15:55.688 Relative Read Throughput: 0 00:15:55.688 Relative Read Latency: 0 00:15:55.688 Relative Write Throughput: 0 00:15:55.688 Relative Write Latency: 0 00:15:55.688 Idle Power: Not Reported 00:15:55.688 Active Power: Not Reported 00:15:55.688 Non-Operational Permissive Mode: Not Supported 00:15:55.688 00:15:55.688 Health Information 00:15:55.688 ================== 00:15:55.688 Critical Warnings: 00:15:55.688 Available Spare Space: OK 00:15:55.688 Temperature: OK 00:15:55.688 Device Reliability: OK 00:15:55.688 Read Only: No 00:15:55.688 Volatile Memory Backup: OK 00:15:55.688 Current Temperature: 0 Kelvin[2024-11-16 16:51:41.180809] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:55.688 [2024-11-16 16:51:41.188628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:55.688 [2024-11-16 16:51:41.188675] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:15:55.688 [2024-11-16 16:51:41.188693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:55.688 [2024-11-16 16:51:41.188704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:55.689 [2024-11-16 16:51:41.188714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:55.689 [2024-11-16 16:51:41.188723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:55.689 [2024-11-16 16:51:41.192642] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:55.689 [2024-11-16 16:51:41.192672] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:15:55.689 [2024-11-16 16:51:41.192876] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:15:55.689 [2024-11-16 16:51:41.192891] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:15:55.689 [2024-11-16 16:51:41.193841] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:15:55.689 [2024-11-16 16:51:41.193866] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:15:55.689 [2024-11-16 16:51:41.193917] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:15:55.689 [2024-11-16 16:51:41.195105] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:55.689 (-273 Celsius) 00:15:55.689 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:55.689 Available Spare: 0% 00:15:55.689 Available Spare Threshold: 0% 00:15:55.689 Life Percentage Used: 0% 00:15:55.689 Data Units Read: 0 00:15:55.689 Data Units Written: 0 00:15:55.689 Host Read Commands: 0 00:15:55.689 Host Write Commands: 0 00:15:55.689 Controller Busy Time: 0 minutes 00:15:55.689 Power Cycles: 0 00:15:55.689 Power On Hours: 0 hours 00:15:55.689 Unsafe Shutdowns: 0 00:15:55.689 Unrecoverable Media Errors: 0 00:15:55.689 Lifetime Error Log Entries: 0 00:15:55.689 Warning Temperature Time: 0 minutes 00:15:55.689 Critical Temperature Time: 0 minutes 00:15:55.689 00:15:55.689 Number of Queues 00:15:55.689 ================ 00:15:55.689 Number of I/O Submission Queues: 127 00:15:55.689 Number of I/O Completion Queues: 127 00:15:55.689 00:15:55.689 Active Namespaces 00:15:55.689 ================= 00:15:55.689 Namespace ID:1 00:15:55.689 Error Recovery Timeout: Unlimited 00:15:55.689 Command Set Identifier: NVM (00h) 00:15:55.689 Deallocate: Supported 00:15:55.689 Deallocated/Unwritten Error: Not Supported 00:15:55.689 Deallocated Read Value: Unknown 00:15:55.689 Deallocate in Write Zeroes: Not Supported 00:15:55.689 Deallocated Guard Field: 0xFFFF 00:15:55.689 Flush: Supported 00:15:55.689 Reservation: Supported 00:15:55.689 Namespace Sharing Capabilities: Multiple Controllers 00:15:55.689 Size (in LBAs): 131072 (0GiB) 00:15:55.689 Capacity (in LBAs): 131072 (0GiB) 00:15:55.689 Utilization (in LBAs): 131072 (0GiB) 00:15:55.689 NGUID: E64AA20331AF4471880CA996DC1DDB0C 00:15:55.689 UUID: e64aa203-31af-4471-880c-a996dc1ddb0c 00:15:55.689 Thin Provisioning: Not Supported 00:15:55.689 Per-NS Atomic Units: Yes 00:15:55.689 Atomic Boundary Size (Normal): 0 00:15:55.689 Atomic Boundary Size (PFail): 0 00:15:55.689 Atomic Boundary Offset: 0 00:15:55.689 Maximum Single Source Range Length: 65535 00:15:55.689 Maximum Copy Length: 65535 00:15:55.689 Maximum Source Range Count: 1 00:15:55.689 NGUID/EUI64 Never Reused: No 00:15:55.689 Namespace Write Protected: No 00:15:55.689 Number of LBA Formats: 1 00:15:55.689 Current LBA Format: LBA Format #00 00:15:55.689 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:55.689 00:15:55.689 16:51:41 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:55.689 EAL: No free 2048 kB hugepages reported on node 1 00:16:00.954 Initializing NVMe Controllers 00:16:00.954 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:00.954 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:00.954 Initialization complete. Launching workers. 00:16:00.954 ======================================================== 00:16:00.954 Latency(us) 00:16:00.954 Device Information : IOPS MiB/s Average min max 00:16:00.954 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 38249.11 149.41 3345.64 1112.24 9001.17 00:16:00.954 ======================================================== 00:16:00.954 Total : 38249.11 149.41 3345.64 1112.24 9001.17 00:16:00.954 00:16:00.954 16:51:46 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:16:00.954 EAL: No free 2048 kB hugepages reported on node 1 00:16:06.309 Initializing NVMe Controllers 00:16:06.310 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:06.310 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:06.310 Initialization complete. Launching workers. 00:16:06.310 ======================================================== 00:16:06.310 Latency(us) 00:16:06.310 Device Information : IOPS MiB/s Average min max 00:16:06.310 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36138.28 141.17 3541.18 1130.70 8000.87 00:16:06.310 ======================================================== 00:16:06.310 Total : 36138.28 141.17 3541.18 1130.70 8000.87 00:16:06.310 00:16:06.310 16:51:51 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:06.310 EAL: No free 2048 kB hugepages reported on node 1 00:16:11.600 Initializing NVMe Controllers 00:16:11.600 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:11.600 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:11.600 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:16:11.600 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:16:11.600 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:16:11.600 Initialization complete. Launching workers. 00:16:11.600 Starting thread on core 2 00:16:11.600 Starting thread on core 3 00:16:11.600 Starting thread on core 1 00:16:11.600 16:51:57 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:16:11.600 EAL: No free 2048 kB hugepages reported on node 1 00:16:14.882 Initializing NVMe Controllers 00:16:14.882 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:14.882 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:14.882 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:16:14.882 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:16:14.882 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:16:14.882 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:16:14.882 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:14.882 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:14.882 Initialization complete. Launching workers. 00:16:14.882 Starting thread on core 1 with urgent priority queue 00:16:14.882 Starting thread on core 2 with urgent priority queue 00:16:14.882 Starting thread on core 3 with urgent priority queue 00:16:14.882 Starting thread on core 0 with urgent priority queue 00:16:14.882 SPDK bdev Controller (SPDK2 ) core 0: 5305.33 IO/s 18.85 secs/100000 ios 00:16:14.882 SPDK bdev Controller (SPDK2 ) core 1: 5688.67 IO/s 17.58 secs/100000 ios 00:16:14.882 SPDK bdev Controller (SPDK2 ) core 2: 5115.67 IO/s 19.55 secs/100000 ios 00:16:14.882 SPDK bdev Controller (SPDK2 ) core 3: 5846.67 IO/s 17.10 secs/100000 ios 00:16:14.882 ======================================================== 00:16:14.882 00:16:14.882 16:52:00 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:14.882 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.140 Initializing NVMe Controllers 00:16:15.141 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:15.141 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:15.141 Namespace ID: 1 size: 0GB 00:16:15.141 Initialization complete. 00:16:15.141 INFO: using host memory buffer for IO 00:16:15.141 Hello world! 00:16:15.141 16:52:00 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:15.398 EAL: No free 2048 kB hugepages reported on node 1 00:16:16.769 Initializing NVMe Controllers 00:16:16.769 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:16.769 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:16.769 Initialization complete. Launching workers. 00:16:16.769 submit (in ns) avg, min, max = 7663.8, 3465.6, 4017500.0 00:16:16.769 complete (in ns) avg, min, max = 25289.8, 2034.4, 7990952.2 00:16:16.769 00:16:16.769 Submit histogram 00:16:16.769 ================ 00:16:16.769 Range in us Cumulative Count 00:16:16.769 3.461 - 3.484: 0.3104% ( 43) 00:16:16.769 3.484 - 3.508: 0.8880% ( 80) 00:16:16.769 3.508 - 3.532: 2.9817% ( 290) 00:16:16.769 3.532 - 3.556: 6.4977% ( 487) 00:16:16.769 3.556 - 3.579: 13.5008% ( 970) 00:16:16.769 3.579 - 3.603: 21.8251% ( 1153) 00:16:16.769 3.603 - 3.627: 32.0049% ( 1410) 00:16:16.769 3.627 - 3.650: 40.1704% ( 1131) 00:16:16.769 3.650 - 3.674: 48.4225% ( 1143) 00:16:16.769 3.674 - 3.698: 54.2055% ( 801) 00:16:16.769 3.698 - 3.721: 59.5336% ( 738) 00:16:16.769 3.721 - 3.745: 63.3889% ( 534) 00:16:16.769 3.745 - 3.769: 67.1504% ( 521) 00:16:16.769 3.769 - 3.793: 70.7097% ( 493) 00:16:16.769 3.793 - 3.816: 74.2546% ( 491) 00:16:16.769 3.816 - 3.840: 78.1315% ( 537) 00:16:16.769 3.840 - 3.864: 81.9219% ( 525) 00:16:16.769 3.864 - 3.887: 84.8675% ( 408) 00:16:16.769 3.887 - 3.911: 87.2645% ( 332) 00:16:16.769 3.911 - 3.935: 89.2499% ( 275) 00:16:16.769 3.935 - 3.959: 90.8021% ( 215) 00:16:16.769 3.959 - 3.982: 92.0656% ( 175) 00:16:16.769 3.982 - 4.006: 93.0330% ( 134) 00:16:16.769 4.006 - 4.030: 93.9643% ( 129) 00:16:16.769 4.030 - 4.053: 94.6719% ( 98) 00:16:16.769 4.053 - 4.077: 95.2783% ( 84) 00:16:16.769 4.077 - 4.101: 95.8054% ( 73) 00:16:16.769 4.101 - 4.124: 96.1014% ( 41) 00:16:16.769 4.124 - 4.148: 96.4407% ( 47) 00:16:16.769 4.148 - 4.172: 96.6428% ( 28) 00:16:16.769 4.172 - 4.196: 96.7295% ( 12) 00:16:16.769 4.196 - 4.219: 96.8089% ( 11) 00:16:16.769 4.219 - 4.243: 96.9244% ( 16) 00:16:16.769 4.243 - 4.267: 97.0110% ( 12) 00:16:16.769 4.267 - 4.290: 97.1049% ( 13) 00:16:16.769 4.290 - 4.314: 97.1627% ( 8) 00:16:16.769 4.314 - 4.338: 97.2204% ( 8) 00:16:16.769 4.338 - 4.361: 97.2854% ( 9) 00:16:16.769 4.361 - 4.385: 97.3576% ( 10) 00:16:16.769 4.385 - 4.409: 97.3793% ( 3) 00:16:16.769 4.409 - 4.433: 97.3937% ( 2) 00:16:16.769 4.433 - 4.456: 97.4009% ( 1) 00:16:16.769 4.456 - 4.480: 97.4153% ( 2) 00:16:16.769 4.480 - 4.504: 97.4370% ( 3) 00:16:16.769 4.504 - 4.527: 97.4514% ( 2) 00:16:16.769 4.551 - 4.575: 97.4659% ( 2) 00:16:16.769 4.575 - 4.599: 97.4803% ( 2) 00:16:16.769 4.599 - 4.622: 97.5020% ( 3) 00:16:16.769 4.622 - 4.646: 97.5236% ( 3) 00:16:16.769 4.646 - 4.670: 97.5597% ( 5) 00:16:16.769 4.670 - 4.693: 97.5886% ( 4) 00:16:16.769 4.693 - 4.717: 97.6392% ( 7) 00:16:16.769 4.717 - 4.741: 97.6680% ( 4) 00:16:16.769 4.741 - 4.764: 97.7186% ( 7) 00:16:16.769 4.764 - 4.788: 97.7619% ( 6) 00:16:16.769 4.788 - 4.812: 97.8052% ( 6) 00:16:16.769 4.812 - 4.836: 97.8341% ( 4) 00:16:16.769 4.836 - 4.859: 97.8630% ( 4) 00:16:16.769 4.859 - 4.883: 97.8846% ( 3) 00:16:16.769 4.883 - 4.907: 97.9135% ( 4) 00:16:16.769 4.907 - 4.930: 97.9352% ( 3) 00:16:16.769 4.930 - 4.954: 97.9857% ( 7) 00:16:16.769 4.954 - 4.978: 98.0362% ( 7) 00:16:16.769 4.978 - 5.001: 98.0651% ( 4) 00:16:16.769 5.001 - 5.025: 98.0723% ( 1) 00:16:16.769 5.025 - 5.049: 98.1373% ( 9) 00:16:16.769 5.049 - 5.073: 98.1662% ( 4) 00:16:16.769 5.073 - 5.096: 98.1734% ( 1) 00:16:16.769 5.096 - 5.120: 98.1951% ( 3) 00:16:16.769 5.120 - 5.144: 98.2023% ( 1) 00:16:16.769 5.167 - 5.191: 98.2240% ( 3) 00:16:16.769 5.191 - 5.215: 98.2384% ( 2) 00:16:16.769 5.215 - 5.239: 98.2528% ( 2) 00:16:16.769 5.239 - 5.262: 98.2601% ( 1) 00:16:16.769 5.310 - 5.333: 98.2817% ( 3) 00:16:16.769 5.357 - 5.381: 98.2889% ( 1) 00:16:16.769 5.381 - 5.404: 98.2962% ( 1) 00:16:16.769 5.428 - 5.452: 98.3034% ( 1) 00:16:16.769 5.452 - 5.476: 98.3178% ( 2) 00:16:16.769 5.665 - 5.689: 98.3250% ( 1) 00:16:16.769 5.736 - 5.760: 98.3323% ( 1) 00:16:16.769 5.997 - 6.021: 98.3395% ( 1) 00:16:16.769 6.258 - 6.305: 98.3467% ( 1) 00:16:16.769 6.353 - 6.400: 98.3611% ( 2) 00:16:16.769 6.637 - 6.684: 98.3683% ( 1) 00:16:16.769 7.016 - 7.064: 98.3756% ( 1) 00:16:16.769 7.111 - 7.159: 98.3828% ( 1) 00:16:16.769 7.253 - 7.301: 98.3900% ( 1) 00:16:16.769 7.348 - 7.396: 98.4044% ( 2) 00:16:16.769 7.443 - 7.490: 98.4117% ( 1) 00:16:16.769 7.538 - 7.585: 98.4189% ( 1) 00:16:16.769 7.585 - 7.633: 98.4333% ( 2) 00:16:16.769 7.727 - 7.775: 98.4622% ( 4) 00:16:16.769 7.775 - 7.822: 98.4766% ( 2) 00:16:16.769 7.822 - 7.870: 98.4839% ( 1) 00:16:16.769 7.870 - 7.917: 98.4911% ( 1) 00:16:16.769 7.917 - 7.964: 98.5055% ( 2) 00:16:16.769 8.012 - 8.059: 98.5127% ( 1) 00:16:16.769 8.296 - 8.344: 98.5200% ( 1) 00:16:16.769 8.344 - 8.391: 98.5344% ( 2) 00:16:16.769 8.391 - 8.439: 98.5416% ( 1) 00:16:16.769 8.439 - 8.486: 98.5488% ( 1) 00:16:16.769 8.486 - 8.533: 98.5561% ( 1) 00:16:16.769 8.533 - 8.581: 98.5633% ( 1) 00:16:16.769 8.676 - 8.723: 98.5705% ( 1) 00:16:16.769 8.770 - 8.818: 98.5777% ( 1) 00:16:16.769 8.818 - 8.865: 98.5922% ( 2) 00:16:16.769 8.913 - 8.960: 98.5994% ( 1) 00:16:16.769 8.960 - 9.007: 98.6138% ( 2) 00:16:16.769 9.102 - 9.150: 98.6210% ( 1) 00:16:16.769 9.150 - 9.197: 98.6283% ( 1) 00:16:16.769 9.292 - 9.339: 98.6499% ( 3) 00:16:16.769 9.387 - 9.434: 98.6571% ( 1) 00:16:16.769 9.481 - 9.529: 98.6716% ( 2) 00:16:16.769 9.624 - 9.671: 98.6788% ( 1) 00:16:16.769 9.956 - 10.003: 98.6860% ( 1) 00:16:16.769 10.145 - 10.193: 98.6932% ( 1) 00:16:16.769 10.335 - 10.382: 98.7149% ( 3) 00:16:16.769 10.382 - 10.430: 98.7293% ( 2) 00:16:16.769 10.714 - 10.761: 98.7366% ( 1) 00:16:16.769 10.809 - 10.856: 98.7438% ( 1) 00:16:16.769 10.856 - 10.904: 98.7510% ( 1) 00:16:16.769 11.046 - 11.093: 98.7582% ( 1) 00:16:16.769 11.141 - 11.188: 98.7654% ( 1) 00:16:16.769 11.188 - 11.236: 98.7799% ( 2) 00:16:16.769 11.236 - 11.283: 98.7943% ( 2) 00:16:16.769 11.378 - 11.425: 98.8015% ( 1) 00:16:16.769 11.567 - 11.615: 98.8088% ( 1) 00:16:16.769 11.662 - 11.710: 98.8160% ( 1) 00:16:16.769 11.710 - 11.757: 98.8232% ( 1) 00:16:16.769 11.947 - 11.994: 98.8376% ( 2) 00:16:16.769 11.994 - 12.041: 98.8448% ( 1) 00:16:16.769 12.136 - 12.231: 98.8521% ( 1) 00:16:16.769 12.231 - 12.326: 98.8593% ( 1) 00:16:16.769 12.326 - 12.421: 98.8737% ( 2) 00:16:16.769 12.421 - 12.516: 98.8809% ( 1) 00:16:16.769 12.516 - 12.610: 98.8882% ( 1) 00:16:16.769 12.990 - 13.084: 98.8954% ( 1) 00:16:16.769 13.179 - 13.274: 98.9098% ( 2) 00:16:16.769 13.274 - 13.369: 98.9170% ( 1) 00:16:16.769 13.369 - 13.464: 98.9243% ( 1) 00:16:16.769 13.464 - 13.559: 98.9315% ( 1) 00:16:16.769 13.843 - 13.938: 98.9387% ( 1) 00:16:16.769 14.317 - 14.412: 98.9459% ( 1) 00:16:16.769 14.507 - 14.601: 98.9531% ( 1) 00:16:16.769 17.067 - 17.161: 98.9604% ( 1) 00:16:16.769 17.256 - 17.351: 98.9748% ( 2) 00:16:16.769 17.351 - 17.446: 98.9965% ( 3) 00:16:16.769 17.446 - 17.541: 99.0470% ( 7) 00:16:16.769 17.541 - 17.636: 99.0831% ( 5) 00:16:16.769 17.636 - 17.730: 99.1625% ( 11) 00:16:16.769 17.730 - 17.825: 99.2275% ( 9) 00:16:16.769 17.825 - 17.920: 99.2780% ( 7) 00:16:16.769 17.920 - 18.015: 99.3430% ( 9) 00:16:16.769 18.015 - 18.110: 99.3647% ( 3) 00:16:16.769 18.110 - 18.204: 99.4152% ( 7) 00:16:16.769 18.204 - 18.299: 99.4802% ( 9) 00:16:16.769 18.299 - 18.394: 99.5452% ( 9) 00:16:16.769 18.394 - 18.489: 99.5813% ( 5) 00:16:16.769 18.489 - 18.584: 99.6318% ( 7) 00:16:16.769 18.584 - 18.679: 99.6679% ( 5) 00:16:16.769 18.679 - 18.773: 99.6968% ( 4) 00:16:16.769 18.773 - 18.868: 99.7329% ( 5) 00:16:16.769 18.868 - 18.963: 99.7401% ( 1) 00:16:16.769 18.963 - 19.058: 99.7618% ( 3) 00:16:16.769 19.058 - 19.153: 99.7690% ( 1) 00:16:16.769 19.153 - 19.247: 99.7834% ( 2) 00:16:16.770 19.247 - 19.342: 99.7906% ( 1) 00:16:16.770 19.437 - 19.532: 99.7978% ( 1) 00:16:16.770 19.627 - 19.721: 99.8051% ( 1) 00:16:16.770 19.721 - 19.816: 99.8123% ( 1) 00:16:16.770 20.006 - 20.101: 99.8195% ( 1) 00:16:16.770 20.575 - 20.670: 99.8267% ( 1) 00:16:16.770 20.670 - 20.764: 99.8339% ( 1) 00:16:16.770 21.713 - 21.807: 99.8484% ( 2) 00:16:16.770 22.281 - 22.376: 99.8556% ( 1) 00:16:16.770 22.661 - 22.756: 99.8628% ( 1) 00:16:16.770 23.135 - 23.230: 99.8700% ( 1) 00:16:16.770 23.419 - 23.514: 99.8773% ( 1) 00:16:16.770 24.652 - 24.841: 99.8845% ( 1) 00:16:16.770 28.255 - 28.444: 99.8917% ( 1) 00:16:16.770 29.393 - 29.582: 99.8989% ( 1) 00:16:16.770 29.961 - 30.151: 99.9061% ( 1) 00:16:16.770 3980.705 - 4004.978: 99.9711% ( 9) 00:16:16.770 4004.978 - 4029.250: 100.0000% ( 4) 00:16:16.770 00:16:16.770 Complete histogram 00:16:16.770 ================== 00:16:16.770 Range in us Cumulative Count 00:16:16.770 2.027 - 2.039: 0.2022% ( 28) 00:16:16.770 2.039 - 2.050: 12.2951% ( 1675) 00:16:16.770 2.050 - 2.062: 16.6342% ( 601) 00:16:16.770 2.062 - 2.074: 23.9405% ( 1012) 00:16:16.770 2.074 - 2.086: 56.1115% ( 4456) 00:16:16.770 2.086 - 2.098: 61.7862% ( 786) 00:16:16.770 2.098 - 2.110: 64.2553% ( 342) 00:16:16.770 2.110 - 2.121: 68.1395% ( 538) 00:16:16.770 2.121 - 2.133: 68.7026% ( 78) 00:16:16.770 2.133 - 2.145: 75.1570% ( 894) 00:16:16.770 2.145 - 2.157: 84.4488% ( 1287) 00:16:16.770 2.157 - 2.169: 85.7267% ( 177) 00:16:16.770 2.169 - 2.181: 87.1778% ( 201) 00:16:16.770 2.181 - 2.193: 88.9611% ( 247) 00:16:16.770 2.193 - 2.204: 89.3943% ( 60) 00:16:16.770 2.204 - 2.216: 91.7551% ( 327) 00:16:16.770 2.216 - 2.228: 94.5852% ( 392) 00:16:16.770 2.228 - 2.240: 94.9679% ( 53) 00:16:16.770 2.240 - 2.252: 95.4660% ( 69) 00:16:16.770 2.252 - 2.264: 95.7765% ( 43) 00:16:16.770 2.264 - 2.276: 95.8703% ( 13) 00:16:16.770 2.276 - 2.287: 96.1375% ( 37) 00:16:16.770 2.287 - 2.299: 96.2169% ( 11) 00:16:16.770 2.299 - 2.311: 96.2530% ( 5) 00:16:16.770 2.311 - 2.323: 96.3541% ( 14) 00:16:16.770 2.323 - 2.335: 96.5129% ( 22) 00:16:16.770 2.335 - 2.347: 96.6428% ( 18) 00:16:16.770 2.347 - 2.359: 96.8955% ( 35) 00:16:16.770 2.359 - 2.370: 97.1699% ( 38) 00:16:16.770 2.370 - 2.382: 97.4226% ( 35) 00:16:16.770 2.382 - 2.394: 97.6608% ( 33) 00:16:16.770 2.394 - 2.406: 97.8413% ( 25) 00:16:16.770 2.406 - 2.418: 97.9568% ( 16) 00:16:16.770 2.418 - 2.430: 98.0796% ( 17) 00:16:16.770 2.430 - 2.441: 98.1445% ( 9) 00:16:16.770 2.441 - 2.453: 98.2528% ( 15) 00:16:16.770 2.453 - 2.465: 98.2889% ( 5) 00:16:16.770 2.465 - 2.477: 98.3683% ( 11) 00:16:16.770 2.477 - 2.489: 98.3828% ( 2) 00:16:16.770 2.489 - 2.501: 98.4117% ( 4) 00:16:16.770 2.501 - 2.513: 98.4261% ( 2) 00:16:16.770 2.524 - 2.536: 98.4478% ( 3) 00:16:16.770 2.548 - 2.560: 98.4550% ( 1) 00:16:16.770 2.560 - 2.572: 98.4622% ( 1) 00:16:16.770 2.572 - 2.584: 98.4694% ( 1) 00:16:16.770 2.584 - 2.596: 98.4766% ( 1) 00:16:16.770 2.643 - 2.655: 98.4983% ( 3) 00:16:16.770 2.655 - 2.667: 98.5127% ( 2) 00:16:16.770 2.667 - 2.679: 98.5200% ( 1) 00:16:16.770 2.714 - 2.726: 98.5272% ( 1) 00:16:16.770 2.726 - 2.738: 98.5344% ( 1) 00:16:16.770 2.738 - 2.750: 98.5416% ( 1) 00:16:16.770 3.058 - 3.081: 98.5488% ( 1) 00:16:16.770 3.271 - 3.295: 98.5561% ( 1) 00:16:16.770 3.366 - 3.390: 98.5705% ( 2) 00:16:16.770 3.390 - 3.413: 98.5849% ( 2) 00:16:16.770 3.413 - 3.437: 98.6138% ( 4) 00:16:16.770 3.437 - 3.461: 98.6210% ( 1) 00:16:16.770 3.484 - 3.508: 98.6283% ( 1) 00:16:16.770 3.556 - 3.579: 98.6355% ( 1) 00:16:16.770 3.650 - 3.674: 98.6427% ( 1) 00:16:16.770 3.674 - 3.698: 98.6499% ( 1) 00:16:16.770 3.698 - 3.721: 98.6571% ( 1) 00:16:16.770 3.721 - 3.745: 98.6644% ( 1) 00:16:16.770 3.745 - 3.769: 98.6716% ( 1) 00:16:16.770 3.769 - 3.793: 98.6860% ( 2) 00:16:16.770 3.793 - 3.816: 98.6932% ( 1) 00:16:16.770 3.816 - 3.840: 98.7005% ( 1) 00:16:16.770 3.864 - 3.887: 98.7077% ( 1) 00:16:16.770 3.887 - 3.911: 98.7149% ( 1) 00:16:16.770 3.911 - 3.935: 98.7221% ( 1) 00:16:16.770 4.101 - 4.124: 98.7293% ( 1) 00:16:16.770 5.428 - 5.452: 98.7366% ( 1) 00:16:16.770 5.547 - 5.570: 98.7438% ( 1) 00:16:16.770 6.068 - 6.116: 98.7510% ( 1) 00:16:16.770 6.116 - 6.163: 98.7582% ( 1) 00:16:16.770 6.163 - 6.210: 98.7654% ( 1) 00:16:16.770 6.210 - 6.258: 98.7727% ( 1) 00:16:16.770 6.353 - 6.400: 98.7799% ( 1) 00:16:16.770 6.400 - 6.447: 98.7871% ( 1) 00:16:16.770 6.447 - 6.495: 98.8015% ( 2) 00:16:16.770 6.827 - 6.874: 98.8088% ( 1) 00:16:16.770 6.874 - 6.921: 98.8232% ( 2) 00:16:16.770 7.111 - 7.159: 98.8304% ( 1) 00:16:16.770 7.159 - 7.206: 98.8376% ( 1) 00:16:16.770 7.301 - 7.348: 98.8448% ( 1) 00:16:16.770 7.348 - 7.396: 98.8521% ( 1) 00:16:16.770 7.396 - 7.443: 98.8593% ( 1) 00:16:16.770 8.059 - 8.107: 98.8665% ( 1) 00:16:16.770 8.344 - 8.391: 98.8737% ( 1) 00:16:16.770 8.439 - 8.486: 98.8809% ( 1) 00:16:16.770 8.676 - 8.723: 98.8882% ( 1) 00:16:16.770 9.055 - 9.102: 98.8954% ( 1) 00:16:16.770 15.360 - 15.455: 98.9026% ( 1) 00:16:16.770 15.550 - 15.644: 98.9098% ( 1) 00:16:16.770 15.644 - 15.739: 98.9459% ( 5) 00:16:16.770 15.739 - 15.834: 98.9604% ( 2) 00:16:16.770 15.834 - 15.929: 99.0037% ( 6) 00:16:16.770 15.929 - 16.024: 99.0326% ( 4) 00:16:16.770 16.024 - 16.119: 99.0398% ( 1) 00:16:16.770 16.119 - 16.213: 99.0975% ( 8) 00:16:16.770 16.213 - 16.308: 99.1264% ( 4) 00:16:16.770 16.308 - 16.403: 99.1336% ( 1) 00:16:16.770 16.403 - 16.498: 99.1481% ( 2) 00:16:16.770 16.498 - 16.593: 99.1625% ( 2) 00:16:16.770 16.593 - 16.687: 99.1986% ( 5) 00:16:16.770 16.687 - 16.782: 99.2708% ( 10) 00:16:16.770 16.782 - 16.877: 99.3141% ( 6) 00:16:16.770 16.877 - 16.972: 99.3213% ( 1) 00:16:16.770 16.972 - 17.067: 99.3430% ( 3) 00:16:16.770 17.067 - 17.161: 99.3502% ( 1) 00:16:16.770 17.256 - 17.351: 99.3719% ( 3) 00:16:16.770 17.730 - 17.825: 99.3863% ( 2) 00:16:16.770 18.015 - 18.110: 99.3935% ( 1) 00:16:16.770 18.299 - 18.394: 99.4008% ( 1) 00:16:16.770 18.394 - 18.489: 99.4080% ( 1) 00:16:16.770 18.489 - 18.584: 99.4152% ( 1) 00:16:16.770 18.584 - 18.679: 99.4224% ( 1) 00:16:16.770 20.859 - 20.954: 99.4296% ( 1) 00:16:16.770 3592.344 - 3616.616: 99.4369% ( 1) 00:16:16.770 3980.705 - 4004.978: 99.7834% ( 48) 00:16:16.770 4004.978 - 4029.250: 99.9928% ( 29) 00:16:16.770 7961.410 - 8009.956: 100.0000% ( 1) 00:16:16.770 00:16:16.770 16:52:02 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:16:16.770 16:52:02 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:16.770 16:52:02 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:16:16.770 16:52:02 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:16:16.770 16:52:02 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:16.770 [ 00:16:16.770 { 00:16:16.770 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:16.770 "subtype": "Discovery", 00:16:16.770 "listen_addresses": [], 00:16:16.770 "allow_any_host": true, 00:16:16.770 "hosts": [] 00:16:16.770 }, 00:16:16.770 { 00:16:16.770 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:16.770 "subtype": "NVMe", 00:16:16.770 "listen_addresses": [ 00:16:16.770 { 00:16:16.770 "transport": "VFIOUSER", 00:16:16.770 "trtype": "VFIOUSER", 00:16:16.770 "adrfam": "IPv4", 00:16:16.770 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:16.770 "trsvcid": "0" 00:16:16.770 } 00:16:16.770 ], 00:16:16.770 "allow_any_host": true, 00:16:16.770 "hosts": [], 00:16:16.770 "serial_number": "SPDK1", 00:16:16.770 "model_number": "SPDK bdev Controller", 00:16:16.770 "max_namespaces": 32, 00:16:16.770 "min_cntlid": 1, 00:16:16.770 "max_cntlid": 65519, 00:16:16.770 "namespaces": [ 00:16:16.770 { 00:16:16.770 "nsid": 1, 00:16:16.770 "bdev_name": "Malloc1", 00:16:16.770 "name": "Malloc1", 00:16:16.770 "nguid": "7E2483294D0B45F892BA09BA06388A74", 00:16:16.770 "uuid": "7e248329-4d0b-45f8-92ba-09ba06388a74" 00:16:16.770 }, 00:16:16.770 { 00:16:16.770 "nsid": 2, 00:16:16.770 "bdev_name": "Malloc3", 00:16:16.770 "name": "Malloc3", 00:16:16.770 "nguid": "46BC88615A0F45D1BEB1644E0D093ECA", 00:16:16.770 "uuid": "46bc8861-5a0f-45d1-beb1-644e0d093eca" 00:16:16.770 } 00:16:16.770 ] 00:16:16.770 }, 00:16:16.770 { 00:16:16.770 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:16.770 "subtype": "NVMe", 00:16:16.771 "listen_addresses": [ 00:16:16.771 { 00:16:16.771 "transport": "VFIOUSER", 00:16:16.771 "trtype": "VFIOUSER", 00:16:16.771 "adrfam": "IPv4", 00:16:16.771 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:16.771 "trsvcid": "0" 00:16:16.771 } 00:16:16.771 ], 00:16:16.771 "allow_any_host": true, 00:16:16.771 "hosts": [], 00:16:16.771 "serial_number": "SPDK2", 00:16:16.771 "model_number": "SPDK bdev Controller", 00:16:16.771 "max_namespaces": 32, 00:16:16.771 "min_cntlid": 1, 00:16:16.771 "max_cntlid": 65519, 00:16:16.771 "namespaces": [ 00:16:16.771 { 00:16:16.771 "nsid": 1, 00:16:16.771 "bdev_name": "Malloc2", 00:16:16.771 "name": "Malloc2", 00:16:16.771 "nguid": "E64AA20331AF4471880CA996DC1DDB0C", 00:16:16.771 "uuid": "e64aa203-31af-4471-880c-a996dc1ddb0c" 00:16:16.771 } 00:16:16.771 ] 00:16:16.771 } 00:16:16.771 ] 00:16:16.771 16:52:02 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:16.771 16:52:02 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1177646 00:16:16.771 16:52:02 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:16:16.771 16:52:02 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:16.771 16:52:02 -- common/autotest_common.sh@1254 -- # local i=0 00:16:16.771 16:52:02 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:16.771 16:52:02 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:16.771 16:52:02 -- common/autotest_common.sh@1265 -- # return 0 00:16:16.771 16:52:02 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:16.771 16:52:02 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:16:17.029 EAL: No free 2048 kB hugepages reported on node 1 00:16:17.286 Malloc4 00:16:17.286 16:52:02 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:16:17.286 16:52:03 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:17.543 Asynchronous Event Request test 00:16:17.543 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:17.543 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:17.543 Registering asynchronous event callbacks... 00:16:17.543 Starting namespace attribute notice tests for all controllers... 00:16:17.543 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:17.543 aer_cb - Changed Namespace 00:16:17.543 Cleaning up... 00:16:17.543 [ 00:16:17.543 { 00:16:17.543 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:17.543 "subtype": "Discovery", 00:16:17.543 "listen_addresses": [], 00:16:17.543 "allow_any_host": true, 00:16:17.543 "hosts": [] 00:16:17.543 }, 00:16:17.543 { 00:16:17.543 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:17.543 "subtype": "NVMe", 00:16:17.543 "listen_addresses": [ 00:16:17.543 { 00:16:17.543 "transport": "VFIOUSER", 00:16:17.543 "trtype": "VFIOUSER", 00:16:17.543 "adrfam": "IPv4", 00:16:17.543 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:17.543 "trsvcid": "0" 00:16:17.543 } 00:16:17.543 ], 00:16:17.543 "allow_any_host": true, 00:16:17.543 "hosts": [], 00:16:17.543 "serial_number": "SPDK1", 00:16:17.543 "model_number": "SPDK bdev Controller", 00:16:17.543 "max_namespaces": 32, 00:16:17.543 "min_cntlid": 1, 00:16:17.543 "max_cntlid": 65519, 00:16:17.543 "namespaces": [ 00:16:17.543 { 00:16:17.543 "nsid": 1, 00:16:17.543 "bdev_name": "Malloc1", 00:16:17.543 "name": "Malloc1", 00:16:17.543 "nguid": "7E2483294D0B45F892BA09BA06388A74", 00:16:17.543 "uuid": "7e248329-4d0b-45f8-92ba-09ba06388a74" 00:16:17.543 }, 00:16:17.543 { 00:16:17.543 "nsid": 2, 00:16:17.543 "bdev_name": "Malloc3", 00:16:17.543 "name": "Malloc3", 00:16:17.543 "nguid": "46BC88615A0F45D1BEB1644E0D093ECA", 00:16:17.543 "uuid": "46bc8861-5a0f-45d1-beb1-644e0d093eca" 00:16:17.543 } 00:16:17.543 ] 00:16:17.543 }, 00:16:17.543 { 00:16:17.543 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:17.543 "subtype": "NVMe", 00:16:17.543 "listen_addresses": [ 00:16:17.543 { 00:16:17.543 "transport": "VFIOUSER", 00:16:17.543 "trtype": "VFIOUSER", 00:16:17.543 "adrfam": "IPv4", 00:16:17.543 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:17.543 "trsvcid": "0" 00:16:17.543 } 00:16:17.543 ], 00:16:17.543 "allow_any_host": true, 00:16:17.543 "hosts": [], 00:16:17.543 "serial_number": "SPDK2", 00:16:17.543 "model_number": "SPDK bdev Controller", 00:16:17.543 "max_namespaces": 32, 00:16:17.543 "min_cntlid": 1, 00:16:17.543 "max_cntlid": 65519, 00:16:17.543 "namespaces": [ 00:16:17.543 { 00:16:17.543 "nsid": 1, 00:16:17.543 "bdev_name": "Malloc2", 00:16:17.543 "name": "Malloc2", 00:16:17.543 "nguid": "E64AA20331AF4471880CA996DC1DDB0C", 00:16:17.543 "uuid": "e64aa203-31af-4471-880c-a996dc1ddb0c" 00:16:17.543 }, 00:16:17.543 { 00:16:17.543 "nsid": 2, 00:16:17.543 "bdev_name": "Malloc4", 00:16:17.543 "name": "Malloc4", 00:16:17.543 "nguid": "766E0EC66F1A421DBACCDFCCCF68E855", 00:16:17.543 "uuid": "766e0ec6-6f1a-421d-bacc-dfcccf68e855" 00:16:17.543 } 00:16:17.543 ] 00:16:17.543 } 00:16:17.543 ] 00:16:17.801 16:52:03 -- target/nvmf_vfio_user.sh@44 -- # wait 1177646 00:16:17.801 16:52:03 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:16:17.801 16:52:03 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1171753 00:16:17.801 16:52:03 -- common/autotest_common.sh@936 -- # '[' -z 1171753 ']' 00:16:17.801 16:52:03 -- common/autotest_common.sh@940 -- # kill -0 1171753 00:16:17.801 16:52:03 -- common/autotest_common.sh@941 -- # uname 00:16:17.801 16:52:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:17.801 16:52:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1171753 00:16:17.801 16:52:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:17.801 16:52:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:17.801 16:52:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1171753' 00:16:17.801 killing process with pid 1171753 00:16:17.801 16:52:03 -- common/autotest_common.sh@955 -- # kill 1171753 00:16:17.801 [2024-11-16 16:52:03.339017] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:16:17.801 16:52:03 -- common/autotest_common.sh@960 -- # wait 1171753 00:16:18.059 16:52:03 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:18.059 16:52:03 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:18.059 16:52:03 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:16:18.059 16:52:03 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:16:18.059 16:52:03 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:16:18.059 16:52:03 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1177795 00:16:18.059 16:52:03 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1177795' 00:16:18.059 Process pid: 1177795 00:16:18.059 16:52:03 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:18.059 16:52:03 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:16:18.059 16:52:03 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1177795 00:16:18.059 16:52:03 -- common/autotest_common.sh@829 -- # '[' -z 1177795 ']' 00:16:18.059 16:52:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:18.059 16:52:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:18.059 16:52:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:18.059 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:18.059 16:52:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:18.059 16:52:03 -- common/autotest_common.sh@10 -- # set +x 00:16:18.059 [2024-11-16 16:52:03.717028] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:16:18.059 [2024-11-16 16:52:03.718146] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:18.059 [2024-11-16 16:52:03.718209] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:18.059 EAL: No free 2048 kB hugepages reported on node 1 00:16:18.059 [2024-11-16 16:52:03.780254] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:18.318 [2024-11-16 16:52:03.869218] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:18.318 [2024-11-16 16:52:03.869394] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:18.318 [2024-11-16 16:52:03.869416] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:18.318 [2024-11-16 16:52:03.869432] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:18.318 [2024-11-16 16:52:03.869493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:18.318 [2024-11-16 16:52:03.869563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:18.318 [2024-11-16 16:52:03.869654] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:18.318 [2024-11-16 16:52:03.869657] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:18.318 [2024-11-16 16:52:03.965987] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:16:18.318 [2024-11-16 16:52:03.966236] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:16:18.318 [2024-11-16 16:52:03.966499] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:16:18.318 [2024-11-16 16:52:03.967247] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:16:18.318 [2024-11-16 16:52:03.967340] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:16:19.250 16:52:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:19.250 16:52:04 -- common/autotest_common.sh@862 -- # return 0 00:16:19.250 16:52:04 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:20.182 16:52:05 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:16:20.440 16:52:05 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:20.440 16:52:05 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:20.440 16:52:05 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:20.440 16:52:05 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:20.440 16:52:05 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:20.699 Malloc1 00:16:20.699 16:52:06 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:20.957 16:52:06 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:21.215 16:52:06 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:21.472 16:52:07 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:21.472 16:52:07 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:21.472 16:52:07 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:21.730 Malloc2 00:16:21.730 16:52:07 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:21.987 16:52:07 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:22.244 16:52:07 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:22.502 16:52:08 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:22.502 16:52:08 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1177795 00:16:22.502 16:52:08 -- common/autotest_common.sh@936 -- # '[' -z 1177795 ']' 00:16:22.502 16:52:08 -- common/autotest_common.sh@940 -- # kill -0 1177795 00:16:22.502 16:52:08 -- common/autotest_common.sh@941 -- # uname 00:16:22.502 16:52:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:22.502 16:52:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1177795 00:16:22.502 16:52:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:22.502 16:52:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:22.502 16:52:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1177795' 00:16:22.502 killing process with pid 1177795 00:16:22.502 16:52:08 -- common/autotest_common.sh@955 -- # kill 1177795 00:16:22.502 16:52:08 -- common/autotest_common.sh@960 -- # wait 1177795 00:16:22.760 16:52:08 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:22.760 16:52:08 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:22.760 00:16:22.760 real 0m54.163s 00:16:22.760 user 3m34.151s 00:16:22.760 sys 0m4.507s 00:16:22.760 16:52:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:22.760 16:52:08 -- common/autotest_common.sh@10 -- # set +x 00:16:22.760 ************************************ 00:16:22.760 END TEST nvmf_vfio_user 00:16:22.760 ************************************ 00:16:22.760 16:52:08 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:22.760 16:52:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:22.760 16:52:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:22.760 16:52:08 -- common/autotest_common.sh@10 -- # set +x 00:16:22.760 ************************************ 00:16:22.760 START TEST nvmf_vfio_user_nvme_compliance 00:16:22.760 ************************************ 00:16:22.760 16:52:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:22.760 * Looking for test storage... 00:16:22.760 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:22.760 16:52:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:22.760 16:52:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:22.760 16:52:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:23.019 16:52:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:23.019 16:52:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:23.019 16:52:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:23.019 16:52:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:23.019 16:52:08 -- scripts/common.sh@335 -- # IFS=.-: 00:16:23.019 16:52:08 -- scripts/common.sh@335 -- # read -ra ver1 00:16:23.019 16:52:08 -- scripts/common.sh@336 -- # IFS=.-: 00:16:23.019 16:52:08 -- scripts/common.sh@336 -- # read -ra ver2 00:16:23.019 16:52:08 -- scripts/common.sh@337 -- # local 'op=<' 00:16:23.019 16:52:08 -- scripts/common.sh@339 -- # ver1_l=2 00:16:23.019 16:52:08 -- scripts/common.sh@340 -- # ver2_l=1 00:16:23.019 16:52:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:23.019 16:52:08 -- scripts/common.sh@343 -- # case "$op" in 00:16:23.019 16:52:08 -- scripts/common.sh@344 -- # : 1 00:16:23.019 16:52:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:23.019 16:52:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:23.019 16:52:08 -- scripts/common.sh@364 -- # decimal 1 00:16:23.019 16:52:08 -- scripts/common.sh@352 -- # local d=1 00:16:23.019 16:52:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:23.019 16:52:08 -- scripts/common.sh@354 -- # echo 1 00:16:23.019 16:52:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:23.019 16:52:08 -- scripts/common.sh@365 -- # decimal 2 00:16:23.019 16:52:08 -- scripts/common.sh@352 -- # local d=2 00:16:23.019 16:52:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:23.019 16:52:08 -- scripts/common.sh@354 -- # echo 2 00:16:23.019 16:52:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:23.019 16:52:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:23.019 16:52:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:23.019 16:52:08 -- scripts/common.sh@367 -- # return 0 00:16:23.019 16:52:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:23.019 16:52:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:23.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:23.019 --rc genhtml_branch_coverage=1 00:16:23.019 --rc genhtml_function_coverage=1 00:16:23.019 --rc genhtml_legend=1 00:16:23.019 --rc geninfo_all_blocks=1 00:16:23.019 --rc geninfo_unexecuted_blocks=1 00:16:23.019 00:16:23.019 ' 00:16:23.019 16:52:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:23.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:23.019 --rc genhtml_branch_coverage=1 00:16:23.019 --rc genhtml_function_coverage=1 00:16:23.019 --rc genhtml_legend=1 00:16:23.019 --rc geninfo_all_blocks=1 00:16:23.019 --rc geninfo_unexecuted_blocks=1 00:16:23.019 00:16:23.019 ' 00:16:23.019 16:52:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:23.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:23.019 --rc genhtml_branch_coverage=1 00:16:23.019 --rc genhtml_function_coverage=1 00:16:23.019 --rc genhtml_legend=1 00:16:23.019 --rc geninfo_all_blocks=1 00:16:23.019 --rc geninfo_unexecuted_blocks=1 00:16:23.019 00:16:23.019 ' 00:16:23.019 16:52:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:23.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:23.019 --rc genhtml_branch_coverage=1 00:16:23.019 --rc genhtml_function_coverage=1 00:16:23.019 --rc genhtml_legend=1 00:16:23.019 --rc geninfo_all_blocks=1 00:16:23.019 --rc geninfo_unexecuted_blocks=1 00:16:23.019 00:16:23.019 ' 00:16:23.019 16:52:08 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:23.019 16:52:08 -- nvmf/common.sh@7 -- # uname -s 00:16:23.019 16:52:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:23.019 16:52:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:23.019 16:52:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:23.019 16:52:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:23.019 16:52:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:23.019 16:52:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:23.019 16:52:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:23.019 16:52:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:23.019 16:52:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:23.019 16:52:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:23.019 16:52:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:23.019 16:52:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:23.019 16:52:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:23.019 16:52:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:23.019 16:52:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:23.019 16:52:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:23.019 16:52:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:23.019 16:52:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:23.019 16:52:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:23.019 16:52:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:23.019 16:52:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:23.019 16:52:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:23.019 16:52:08 -- paths/export.sh@5 -- # export PATH 00:16:23.019 16:52:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:23.019 16:52:08 -- nvmf/common.sh@46 -- # : 0 00:16:23.019 16:52:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:23.019 16:52:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:23.019 16:52:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:23.019 16:52:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:23.019 16:52:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:23.019 16:52:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:23.019 16:52:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:23.019 16:52:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:23.019 16:52:08 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:23.019 16:52:08 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:23.019 16:52:08 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:23.019 16:52:08 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:23.019 16:52:08 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:23.019 16:52:08 -- compliance/compliance.sh@20 -- # nvmfpid=1178422 00:16:23.019 16:52:08 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:23.019 16:52:08 -- compliance/compliance.sh@21 -- # echo 'Process pid: 1178422' 00:16:23.019 Process pid: 1178422 00:16:23.019 16:52:08 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:23.019 16:52:08 -- compliance/compliance.sh@24 -- # waitforlisten 1178422 00:16:23.019 16:52:08 -- common/autotest_common.sh@829 -- # '[' -z 1178422 ']' 00:16:23.019 16:52:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:23.019 16:52:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:23.019 16:52:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:23.019 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:23.019 16:52:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:23.019 16:52:08 -- common/autotest_common.sh@10 -- # set +x 00:16:23.019 [2024-11-16 16:52:08.628815] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:23.019 [2024-11-16 16:52:08.628905] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:23.019 EAL: No free 2048 kB hugepages reported on node 1 00:16:23.019 [2024-11-16 16:52:08.695170] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:23.278 [2024-11-16 16:52:08.785874] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:23.278 [2024-11-16 16:52:08.786055] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:23.278 [2024-11-16 16:52:08.786086] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:23.278 [2024-11-16 16:52:08.786100] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:23.278 [2024-11-16 16:52:08.786281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:23.278 [2024-11-16 16:52:08.786342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:23.278 [2024-11-16 16:52:08.786345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:24.207 16:52:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:24.207 16:52:09 -- common/autotest_common.sh@862 -- # return 0 00:16:24.207 16:52:09 -- compliance/compliance.sh@26 -- # sleep 1 00:16:25.145 16:52:10 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:25.145 16:52:10 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:25.145 16:52:10 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:25.145 16:52:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:25.145 16:52:10 -- common/autotest_common.sh@10 -- # set +x 00:16:25.145 16:52:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:25.145 16:52:10 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:25.145 16:52:10 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:25.145 16:52:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:25.145 16:52:10 -- common/autotest_common.sh@10 -- # set +x 00:16:25.145 malloc0 00:16:25.145 16:52:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:25.145 16:52:10 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:25.145 16:52:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:25.145 16:52:10 -- common/autotest_common.sh@10 -- # set +x 00:16:25.145 16:52:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:25.145 16:52:10 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:25.145 16:52:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:25.145 16:52:10 -- common/autotest_common.sh@10 -- # set +x 00:16:25.145 16:52:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:25.145 16:52:10 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:25.145 16:52:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:25.145 16:52:10 -- common/autotest_common.sh@10 -- # set +x 00:16:25.145 16:52:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:25.145 16:52:10 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:25.145 EAL: No free 2048 kB hugepages reported on node 1 00:16:25.145 00:16:25.145 00:16:25.145 CUnit - A unit testing framework for C - Version 2.1-3 00:16:25.145 http://cunit.sourceforge.net/ 00:16:25.145 00:16:25.145 00:16:25.145 Suite: nvme_compliance 00:16:25.145 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-16 16:52:10.830578] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:25.145 [2024-11-16 16:52:10.830675] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:25.145 [2024-11-16 16:52:10.830689] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:25.145 passed 00:16:25.404 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:25.404 Test: admin_identify_ns ...[2024-11-16 16:52:11.067658] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:25.404 [2024-11-16 16:52:11.075646] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:25.404 passed 00:16:25.664 Test: admin_get_features_mandatory_features ...passed 00:16:25.664 Test: admin_get_features_optional_features ...passed 00:16:25.923 Test: admin_set_features_number_of_queues ...passed 00:16:25.923 Test: admin_get_log_page_mandatory_logs ...passed 00:16:26.183 Test: admin_get_log_page_with_lpo ...[2024-11-16 16:52:11.697632] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:26.183 passed 00:16:26.183 Test: fabric_property_get ...passed 00:16:26.183 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-16 16:52:11.882380] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:26.183 passed 00:16:26.441 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-16 16:52:12.048643] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:26.441 [2024-11-16 16:52:12.064644] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:26.441 passed 00:16:26.441 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-16 16:52:12.155250] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:26.441 passed 00:16:26.699 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-16 16:52:12.317627] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:26.699 [2024-11-16 16:52:12.341646] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:26.699 passed 00:16:26.699 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-16 16:52:12.431739] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:26.699 [2024-11-16 16:52:12.431781] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:26.957 passed 00:16:26.957 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-16 16:52:12.607640] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:26.957 [2024-11-16 16:52:12.615649] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:26.957 [2024-11-16 16:52:12.623639] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:26.957 [2024-11-16 16:52:12.631641] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:26.957 passed 00:16:27.217 Test: admin_create_io_sq_verify_pc ...[2024-11-16 16:52:12.759665] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:27.217 passed 00:16:28.596 Test: admin_create_io_qp_max_qps ...[2024-11-16 16:52:13.957632] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:28.856 passed 00:16:28.856 Test: admin_create_io_sq_shared_cq ...[2024-11-16 16:52:14.553627] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:29.116 passed 00:16:29.116 00:16:29.116 Run Summary: Type Total Ran Passed Failed Inactive 00:16:29.116 suites 1 1 n/a 0 0 00:16:29.116 tests 18 18 18 0 0 00:16:29.116 asserts 360 360 360 0 n/a 00:16:29.116 00:16:29.116 Elapsed time = 1.559 seconds 00:16:29.116 16:52:14 -- compliance/compliance.sh@42 -- # killprocess 1178422 00:16:29.116 16:52:14 -- common/autotest_common.sh@936 -- # '[' -z 1178422 ']' 00:16:29.116 16:52:14 -- common/autotest_common.sh@940 -- # kill -0 1178422 00:16:29.116 16:52:14 -- common/autotest_common.sh@941 -- # uname 00:16:29.116 16:52:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:29.116 16:52:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1178422 00:16:29.116 16:52:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:29.116 16:52:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:29.116 16:52:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1178422' 00:16:29.116 killing process with pid 1178422 00:16:29.116 16:52:14 -- common/autotest_common.sh@955 -- # kill 1178422 00:16:29.116 16:52:14 -- common/autotest_common.sh@960 -- # wait 1178422 00:16:29.375 16:52:14 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:29.375 16:52:14 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:29.375 00:16:29.375 real 0m6.514s 00:16:29.375 user 0m18.538s 00:16:29.375 sys 0m0.590s 00:16:29.375 16:52:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:29.375 16:52:14 -- common/autotest_common.sh@10 -- # set +x 00:16:29.375 ************************************ 00:16:29.375 END TEST nvmf_vfio_user_nvme_compliance 00:16:29.375 ************************************ 00:16:29.375 16:52:14 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:29.375 16:52:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:29.375 16:52:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:29.375 16:52:14 -- common/autotest_common.sh@10 -- # set +x 00:16:29.375 ************************************ 00:16:29.376 START TEST nvmf_vfio_user_fuzz 00:16:29.376 ************************************ 00:16:29.376 16:52:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:29.376 * Looking for test storage... 00:16:29.376 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:29.376 16:52:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:29.376 16:52:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:29.376 16:52:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:29.376 16:52:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:29.376 16:52:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:29.376 16:52:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:29.376 16:52:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:29.376 16:52:15 -- scripts/common.sh@335 -- # IFS=.-: 00:16:29.376 16:52:15 -- scripts/common.sh@335 -- # read -ra ver1 00:16:29.376 16:52:15 -- scripts/common.sh@336 -- # IFS=.-: 00:16:29.376 16:52:15 -- scripts/common.sh@336 -- # read -ra ver2 00:16:29.376 16:52:15 -- scripts/common.sh@337 -- # local 'op=<' 00:16:29.376 16:52:15 -- scripts/common.sh@339 -- # ver1_l=2 00:16:29.376 16:52:15 -- scripts/common.sh@340 -- # ver2_l=1 00:16:29.376 16:52:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:29.376 16:52:15 -- scripts/common.sh@343 -- # case "$op" in 00:16:29.376 16:52:15 -- scripts/common.sh@344 -- # : 1 00:16:29.376 16:52:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:29.376 16:52:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:29.376 16:52:15 -- scripts/common.sh@364 -- # decimal 1 00:16:29.376 16:52:15 -- scripts/common.sh@352 -- # local d=1 00:16:29.376 16:52:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:29.376 16:52:15 -- scripts/common.sh@354 -- # echo 1 00:16:29.376 16:52:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:29.376 16:52:15 -- scripts/common.sh@365 -- # decimal 2 00:16:29.376 16:52:15 -- scripts/common.sh@352 -- # local d=2 00:16:29.376 16:52:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:29.376 16:52:15 -- scripts/common.sh@354 -- # echo 2 00:16:29.376 16:52:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:29.376 16:52:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:29.376 16:52:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:29.376 16:52:15 -- scripts/common.sh@367 -- # return 0 00:16:29.376 16:52:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:29.376 16:52:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:29.376 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.376 --rc genhtml_branch_coverage=1 00:16:29.376 --rc genhtml_function_coverage=1 00:16:29.376 --rc genhtml_legend=1 00:16:29.376 --rc geninfo_all_blocks=1 00:16:29.376 --rc geninfo_unexecuted_blocks=1 00:16:29.376 00:16:29.376 ' 00:16:29.376 16:52:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:29.376 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.376 --rc genhtml_branch_coverage=1 00:16:29.376 --rc genhtml_function_coverage=1 00:16:29.376 --rc genhtml_legend=1 00:16:29.376 --rc geninfo_all_blocks=1 00:16:29.376 --rc geninfo_unexecuted_blocks=1 00:16:29.376 00:16:29.376 ' 00:16:29.376 16:52:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:29.376 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.376 --rc genhtml_branch_coverage=1 00:16:29.376 --rc genhtml_function_coverage=1 00:16:29.376 --rc genhtml_legend=1 00:16:29.376 --rc geninfo_all_blocks=1 00:16:29.376 --rc geninfo_unexecuted_blocks=1 00:16:29.376 00:16:29.376 ' 00:16:29.376 16:52:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:29.376 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.376 --rc genhtml_branch_coverage=1 00:16:29.376 --rc genhtml_function_coverage=1 00:16:29.376 --rc genhtml_legend=1 00:16:29.376 --rc geninfo_all_blocks=1 00:16:29.376 --rc geninfo_unexecuted_blocks=1 00:16:29.376 00:16:29.376 ' 00:16:29.376 16:52:15 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:29.376 16:52:15 -- nvmf/common.sh@7 -- # uname -s 00:16:29.376 16:52:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:29.376 16:52:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:29.376 16:52:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:29.376 16:52:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:29.376 16:52:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:29.376 16:52:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:29.376 16:52:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:29.376 16:52:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:29.376 16:52:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:29.376 16:52:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:29.376 16:52:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:29.376 16:52:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:29.376 16:52:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:29.376 16:52:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:29.376 16:52:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:29.376 16:52:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:29.376 16:52:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:29.376 16:52:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:29.376 16:52:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:29.376 16:52:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.376 16:52:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.376 16:52:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.376 16:52:15 -- paths/export.sh@5 -- # export PATH 00:16:29.376 16:52:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.376 16:52:15 -- nvmf/common.sh@46 -- # : 0 00:16:29.376 16:52:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:29.376 16:52:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:29.376 16:52:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:29.636 16:52:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:29.636 16:52:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:29.636 16:52:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:29.636 16:52:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:29.636 16:52:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:29.636 16:52:15 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:29.636 16:52:15 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:29.636 16:52:15 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:29.636 16:52:15 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:29.636 16:52:15 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:29.636 16:52:15 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:29.636 16:52:15 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:29.636 16:52:15 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=1179307 00:16:29.636 16:52:15 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:29.636 16:52:15 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 1179307' 00:16:29.636 Process pid: 1179307 00:16:29.636 16:52:15 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:29.636 16:52:15 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 1179307 00:16:29.636 16:52:15 -- common/autotest_common.sh@829 -- # '[' -z 1179307 ']' 00:16:29.636 16:52:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:29.636 16:52:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:29.636 16:52:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:29.636 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:29.636 16:52:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:29.636 16:52:15 -- common/autotest_common.sh@10 -- # set +x 00:16:30.572 16:52:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:30.572 16:52:16 -- common/autotest_common.sh@862 -- # return 0 00:16:30.572 16:52:16 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:31.512 16:52:17 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:31.512 16:52:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.512 16:52:17 -- common/autotest_common.sh@10 -- # set +x 00:16:31.512 16:52:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.512 16:52:17 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:31.512 16:52:17 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:31.512 16:52:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.512 16:52:17 -- common/autotest_common.sh@10 -- # set +x 00:16:31.512 malloc0 00:16:31.512 16:52:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.512 16:52:17 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:31.512 16:52:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.512 16:52:17 -- common/autotest_common.sh@10 -- # set +x 00:16:31.512 16:52:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.512 16:52:17 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:31.512 16:52:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.512 16:52:17 -- common/autotest_common.sh@10 -- # set +x 00:16:31.512 16:52:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.512 16:52:17 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:31.512 16:52:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.512 16:52:17 -- common/autotest_common.sh@10 -- # set +x 00:16:31.512 16:52:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.512 16:52:17 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:31.512 16:52:17 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:17:03.578 Fuzzing completed. Shutting down the fuzz application 00:17:03.578 00:17:03.578 Dumping successful admin opcodes: 00:17:03.578 8, 9, 10, 24, 00:17:03.578 Dumping successful io opcodes: 00:17:03.578 0, 00:17:03.578 NS: 0x200003a1ef00 I/O qp, Total commands completed: 555320, total successful commands: 2134, random_seed: 1286242368 00:17:03.578 NS: 0x200003a1ef00 admin qp, Total commands completed: 137817, total successful commands: 1117, random_seed: 3943917888 00:17:03.578 16:52:47 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:17:03.578 16:52:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.578 16:52:47 -- common/autotest_common.sh@10 -- # set +x 00:17:03.578 16:52:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.578 16:52:47 -- target/vfio_user_fuzz.sh@46 -- # killprocess 1179307 00:17:03.578 16:52:47 -- common/autotest_common.sh@936 -- # '[' -z 1179307 ']' 00:17:03.578 16:52:47 -- common/autotest_common.sh@940 -- # kill -0 1179307 00:17:03.578 16:52:47 -- common/autotest_common.sh@941 -- # uname 00:17:03.578 16:52:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:03.578 16:52:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1179307 00:17:03.578 16:52:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:03.578 16:52:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:03.578 16:52:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1179307' 00:17:03.578 killing process with pid 1179307 00:17:03.578 16:52:47 -- common/autotest_common.sh@955 -- # kill 1179307 00:17:03.578 16:52:47 -- common/autotest_common.sh@960 -- # wait 1179307 00:17:03.578 16:52:47 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:17:03.578 16:52:48 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:17:03.578 00:17:03.578 real 0m33.055s 00:17:03.578 user 0m33.498s 00:17:03.578 sys 0m25.285s 00:17:03.578 16:52:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:03.578 16:52:48 -- common/autotest_common.sh@10 -- # set +x 00:17:03.578 ************************************ 00:17:03.578 END TEST nvmf_vfio_user_fuzz 00:17:03.578 ************************************ 00:17:03.578 16:52:48 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:03.578 16:52:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:03.578 16:52:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:03.578 16:52:48 -- common/autotest_common.sh@10 -- # set +x 00:17:03.578 ************************************ 00:17:03.578 START TEST nvmf_host_management 00:17:03.578 ************************************ 00:17:03.578 16:52:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:03.578 * Looking for test storage... 00:17:03.578 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:03.578 16:52:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:03.578 16:52:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:03.578 16:52:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:03.578 16:52:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:03.578 16:52:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:03.578 16:52:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:03.578 16:52:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:03.578 16:52:48 -- scripts/common.sh@335 -- # IFS=.-: 00:17:03.578 16:52:48 -- scripts/common.sh@335 -- # read -ra ver1 00:17:03.578 16:52:48 -- scripts/common.sh@336 -- # IFS=.-: 00:17:03.578 16:52:48 -- scripts/common.sh@336 -- # read -ra ver2 00:17:03.578 16:52:48 -- scripts/common.sh@337 -- # local 'op=<' 00:17:03.578 16:52:48 -- scripts/common.sh@339 -- # ver1_l=2 00:17:03.578 16:52:48 -- scripts/common.sh@340 -- # ver2_l=1 00:17:03.578 16:52:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:03.578 16:52:48 -- scripts/common.sh@343 -- # case "$op" in 00:17:03.578 16:52:48 -- scripts/common.sh@344 -- # : 1 00:17:03.578 16:52:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:03.578 16:52:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:03.578 16:52:48 -- scripts/common.sh@364 -- # decimal 1 00:17:03.578 16:52:48 -- scripts/common.sh@352 -- # local d=1 00:17:03.578 16:52:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:03.578 16:52:48 -- scripts/common.sh@354 -- # echo 1 00:17:03.578 16:52:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:03.578 16:52:48 -- scripts/common.sh@365 -- # decimal 2 00:17:03.578 16:52:48 -- scripts/common.sh@352 -- # local d=2 00:17:03.578 16:52:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:03.578 16:52:48 -- scripts/common.sh@354 -- # echo 2 00:17:03.579 16:52:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:03.579 16:52:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:03.579 16:52:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:03.579 16:52:48 -- scripts/common.sh@367 -- # return 0 00:17:03.579 16:52:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:03.579 16:52:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:03.579 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:03.579 --rc genhtml_branch_coverage=1 00:17:03.579 --rc genhtml_function_coverage=1 00:17:03.579 --rc genhtml_legend=1 00:17:03.579 --rc geninfo_all_blocks=1 00:17:03.579 --rc geninfo_unexecuted_blocks=1 00:17:03.579 00:17:03.579 ' 00:17:03.579 16:52:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:03.579 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:03.579 --rc genhtml_branch_coverage=1 00:17:03.579 --rc genhtml_function_coverage=1 00:17:03.579 --rc genhtml_legend=1 00:17:03.579 --rc geninfo_all_blocks=1 00:17:03.579 --rc geninfo_unexecuted_blocks=1 00:17:03.579 00:17:03.579 ' 00:17:03.579 16:52:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:03.579 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:03.579 --rc genhtml_branch_coverage=1 00:17:03.579 --rc genhtml_function_coverage=1 00:17:03.579 --rc genhtml_legend=1 00:17:03.579 --rc geninfo_all_blocks=1 00:17:03.579 --rc geninfo_unexecuted_blocks=1 00:17:03.579 00:17:03.579 ' 00:17:03.579 16:52:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:03.579 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:03.579 --rc genhtml_branch_coverage=1 00:17:03.579 --rc genhtml_function_coverage=1 00:17:03.579 --rc genhtml_legend=1 00:17:03.579 --rc geninfo_all_blocks=1 00:17:03.579 --rc geninfo_unexecuted_blocks=1 00:17:03.579 00:17:03.579 ' 00:17:03.579 16:52:48 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:03.579 16:52:48 -- nvmf/common.sh@7 -- # uname -s 00:17:03.579 16:52:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:03.579 16:52:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:03.579 16:52:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:03.579 16:52:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:03.579 16:52:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:03.579 16:52:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:03.579 16:52:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:03.579 16:52:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:03.579 16:52:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:03.579 16:52:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:03.579 16:52:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:03.579 16:52:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:03.579 16:52:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:03.579 16:52:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:03.579 16:52:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:03.579 16:52:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:03.579 16:52:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:03.579 16:52:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:03.579 16:52:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:03.579 16:52:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:03.579 16:52:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:03.579 16:52:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:03.579 16:52:48 -- paths/export.sh@5 -- # export PATH 00:17:03.579 16:52:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:03.579 16:52:48 -- nvmf/common.sh@46 -- # : 0 00:17:03.579 16:52:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:03.579 16:52:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:03.579 16:52:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:03.579 16:52:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:03.579 16:52:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:03.579 16:52:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:03.579 16:52:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:03.579 16:52:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:03.579 16:52:48 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:03.579 16:52:48 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:03.579 16:52:48 -- target/host_management.sh@104 -- # nvmftestinit 00:17:03.579 16:52:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:03.579 16:52:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:03.579 16:52:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:03.579 16:52:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:03.579 16:52:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:03.579 16:52:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:03.579 16:52:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:03.579 16:52:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:03.579 16:52:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:03.579 16:52:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:03.579 16:52:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:03.579 16:52:48 -- common/autotest_common.sh@10 -- # set +x 00:17:04.514 16:52:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:04.514 16:52:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:04.514 16:52:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:04.514 16:52:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:04.514 16:52:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:04.514 16:52:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:04.514 16:52:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:04.514 16:52:50 -- nvmf/common.sh@294 -- # net_devs=() 00:17:04.514 16:52:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:04.514 16:52:50 -- nvmf/common.sh@295 -- # e810=() 00:17:04.514 16:52:50 -- nvmf/common.sh@295 -- # local -ga e810 00:17:04.514 16:52:50 -- nvmf/common.sh@296 -- # x722=() 00:17:04.514 16:52:50 -- nvmf/common.sh@296 -- # local -ga x722 00:17:04.514 16:52:50 -- nvmf/common.sh@297 -- # mlx=() 00:17:04.514 16:52:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:04.514 16:52:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:04.514 16:52:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:04.514 16:52:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:04.514 16:52:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:04.514 16:52:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:04.514 16:52:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:04.514 16:52:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:04.514 16:52:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:04.514 16:52:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:04.514 16:52:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:04.514 16:52:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:04.514 16:52:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:04.514 16:52:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:04.514 16:52:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:04.514 16:52:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:04.514 16:52:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:04.514 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:04.514 16:52:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:04.514 16:52:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:04.514 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:04.514 16:52:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:04.514 16:52:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:04.514 16:52:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:04.514 16:52:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:04.514 16:52:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:04.514 16:52:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:04.514 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:04.514 16:52:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:04.514 16:52:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:04.514 16:52:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:04.514 16:52:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:04.514 16:52:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:04.514 16:52:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:04.514 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:04.514 16:52:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:04.514 16:52:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:04.514 16:52:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:04.514 16:52:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:04.514 16:52:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:04.514 16:52:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:04.514 16:52:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:04.514 16:52:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:04.514 16:52:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:04.514 16:52:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:04.514 16:52:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:04.514 16:52:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:04.514 16:52:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:04.515 16:52:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:04.515 16:52:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:04.515 16:52:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:04.515 16:52:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:04.515 16:52:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:04.515 16:52:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:04.515 16:52:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:04.515 16:52:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:04.515 16:52:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:04.515 16:52:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:04.515 16:52:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:04.515 16:52:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:04.515 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:04.515 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.190 ms 00:17:04.515 00:17:04.515 --- 10.0.0.2 ping statistics --- 00:17:04.515 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:04.515 rtt min/avg/max/mdev = 0.190/0.190/0.190/0.000 ms 00:17:04.515 16:52:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:04.515 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:04.515 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.068 ms 00:17:04.515 00:17:04.515 --- 10.0.0.1 ping statistics --- 00:17:04.515 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:04.515 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:17:04.515 16:52:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:04.515 16:52:50 -- nvmf/common.sh@410 -- # return 0 00:17:04.515 16:52:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:04.515 16:52:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:04.515 16:52:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:04.515 16:52:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:04.515 16:52:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:04.515 16:52:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:04.515 16:52:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:04.515 16:52:50 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:17:04.515 16:52:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:04.515 16:52:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:04.515 16:52:50 -- common/autotest_common.sh@10 -- # set +x 00:17:04.515 ************************************ 00:17:04.515 START TEST nvmf_host_management 00:17:04.515 ************************************ 00:17:04.515 16:52:50 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:17:04.515 16:52:50 -- target/host_management.sh@69 -- # starttarget 00:17:04.515 16:52:50 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:17:04.515 16:52:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:04.515 16:52:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:04.515 16:52:50 -- common/autotest_common.sh@10 -- # set +x 00:17:04.515 16:52:50 -- nvmf/common.sh@469 -- # nvmfpid=1184986 00:17:04.515 16:52:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:04.515 16:52:50 -- nvmf/common.sh@470 -- # waitforlisten 1184986 00:17:04.515 16:52:50 -- common/autotest_common.sh@829 -- # '[' -z 1184986 ']' 00:17:04.515 16:52:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:04.515 16:52:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:04.515 16:52:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:04.515 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:04.515 16:52:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:04.515 16:52:50 -- common/autotest_common.sh@10 -- # set +x 00:17:04.773 [2024-11-16 16:52:50.306627] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:04.773 [2024-11-16 16:52:50.306725] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:04.773 EAL: No free 2048 kB hugepages reported on node 1 00:17:04.773 [2024-11-16 16:52:50.380417] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:04.773 [2024-11-16 16:52:50.471354] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:04.773 [2024-11-16 16:52:50.471522] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:04.773 [2024-11-16 16:52:50.471542] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:04.774 [2024-11-16 16:52:50.471557] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:04.774 [2024-11-16 16:52:50.471652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:04.774 [2024-11-16 16:52:50.471770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:04.774 [2024-11-16 16:52:50.471790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:04.774 [2024-11-16 16:52:50.471793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:05.783 16:52:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:05.783 16:52:51 -- common/autotest_common.sh@862 -- # return 0 00:17:05.783 16:52:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:05.783 16:52:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:05.783 16:52:51 -- common/autotest_common.sh@10 -- # set +x 00:17:05.783 16:52:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:05.783 16:52:51 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:05.783 16:52:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.783 16:52:51 -- common/autotest_common.sh@10 -- # set +x 00:17:05.783 [2024-11-16 16:52:51.285200] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:05.783 16:52:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.783 16:52:51 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:17:05.783 16:52:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:05.783 16:52:51 -- common/autotest_common.sh@10 -- # set +x 00:17:05.783 16:52:51 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:05.784 16:52:51 -- target/host_management.sh@23 -- # cat 00:17:05.784 16:52:51 -- target/host_management.sh@30 -- # rpc_cmd 00:17:05.784 16:52:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.784 16:52:51 -- common/autotest_common.sh@10 -- # set +x 00:17:05.784 Malloc0 00:17:05.784 [2024-11-16 16:52:51.345222] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:05.784 16:52:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.784 16:52:51 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:17:05.784 16:52:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:05.784 16:52:51 -- common/autotest_common.sh@10 -- # set +x 00:17:05.784 16:52:51 -- target/host_management.sh@73 -- # perfpid=1185159 00:17:05.784 16:52:51 -- target/host_management.sh@74 -- # waitforlisten 1185159 /var/tmp/bdevperf.sock 00:17:05.784 16:52:51 -- common/autotest_common.sh@829 -- # '[' -z 1185159 ']' 00:17:05.784 16:52:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:05.784 16:52:51 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:05.784 16:52:51 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:17:05.784 16:52:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:05.784 16:52:51 -- nvmf/common.sh@520 -- # config=() 00:17:05.784 16:52:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:05.784 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:05.784 16:52:51 -- nvmf/common.sh@520 -- # local subsystem config 00:17:05.784 16:52:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:05.784 16:52:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:05.784 16:52:51 -- common/autotest_common.sh@10 -- # set +x 00:17:05.784 16:52:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:05.784 { 00:17:05.784 "params": { 00:17:05.784 "name": "Nvme$subsystem", 00:17:05.784 "trtype": "$TEST_TRANSPORT", 00:17:05.784 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:05.784 "adrfam": "ipv4", 00:17:05.784 "trsvcid": "$NVMF_PORT", 00:17:05.784 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:05.784 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:05.784 "hdgst": ${hdgst:-false}, 00:17:05.784 "ddgst": ${ddgst:-false} 00:17:05.784 }, 00:17:05.784 "method": "bdev_nvme_attach_controller" 00:17:05.784 } 00:17:05.784 EOF 00:17:05.784 )") 00:17:05.784 16:52:51 -- nvmf/common.sh@542 -- # cat 00:17:05.784 16:52:51 -- nvmf/common.sh@544 -- # jq . 00:17:05.784 16:52:51 -- nvmf/common.sh@545 -- # IFS=, 00:17:05.784 16:52:51 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:05.784 "params": { 00:17:05.784 "name": "Nvme0", 00:17:05.784 "trtype": "tcp", 00:17:05.784 "traddr": "10.0.0.2", 00:17:05.784 "adrfam": "ipv4", 00:17:05.784 "trsvcid": "4420", 00:17:05.784 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:05.784 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:05.784 "hdgst": false, 00:17:05.784 "ddgst": false 00:17:05.784 }, 00:17:05.784 "method": "bdev_nvme_attach_controller" 00:17:05.784 }' 00:17:05.784 [2024-11-16 16:52:51.420845] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:05.784 [2024-11-16 16:52:51.420950] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1185159 ] 00:17:05.784 EAL: No free 2048 kB hugepages reported on node 1 00:17:05.784 [2024-11-16 16:52:51.481510] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:06.043 [2024-11-16 16:52:51.567340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:06.043 Running I/O for 10 seconds... 00:17:06.981 16:52:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:06.981 16:52:52 -- common/autotest_common.sh@862 -- # return 0 00:17:06.981 16:52:52 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:06.981 16:52:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:06.981 16:52:52 -- common/autotest_common.sh@10 -- # set +x 00:17:06.981 16:52:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:06.981 16:52:52 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:06.981 16:52:52 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:17:06.982 16:52:52 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:06.982 16:52:52 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:17:06.982 16:52:52 -- target/host_management.sh@52 -- # local ret=1 00:17:06.982 16:52:52 -- target/host_management.sh@53 -- # local i 00:17:06.982 16:52:52 -- target/host_management.sh@54 -- # (( i = 10 )) 00:17:06.982 16:52:52 -- target/host_management.sh@54 -- # (( i != 0 )) 00:17:06.982 16:52:52 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:17:06.982 16:52:52 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:17:06.982 16:52:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:06.982 16:52:52 -- common/autotest_common.sh@10 -- # set +x 00:17:06.982 16:52:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:06.982 16:52:52 -- target/host_management.sh@55 -- # read_io_count=2438 00:17:06.982 16:52:52 -- target/host_management.sh@58 -- # '[' 2438 -ge 100 ']' 00:17:06.982 16:52:52 -- target/host_management.sh@59 -- # ret=0 00:17:06.982 16:52:52 -- target/host_management.sh@60 -- # break 00:17:06.982 16:52:52 -- target/host_management.sh@64 -- # return 0 00:17:06.982 16:52:52 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:06.982 16:52:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:06.982 16:52:52 -- common/autotest_common.sh@10 -- # set +x 00:17:06.982 [2024-11-16 16:52:52.444983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445132] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.445647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc33ad0 is same with the state(5) to be set 00:17:06.982 [2024-11-16 16:52:52.446265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:70912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.982 [2024-11-16 16:52:52.446308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.982 [2024-11-16 16:52:52.446345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:71424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.982 [2024-11-16 16:52:52.446361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.982 [2024-11-16 16:52:52.446378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:71808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.982 [2024-11-16 16:52:52.446393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.982 [2024-11-16 16:52:52.446410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:71936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.982 [2024-11-16 16:52:52.446430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.982 [2024-11-16 16:52:52.446447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:72064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.982 [2024-11-16 16:52:52.446462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.982 [2024-11-16 16:52:52.446478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:72448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.982 [2024-11-16 16:52:52.446492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.982 [2024-11-16 16:52:52.446507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:72704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.982 [2024-11-16 16:52:52.446521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.982 [2024-11-16 16:52:52.446537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:72960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.982 [2024-11-16 16:52:52.446551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.982 [2024-11-16 16:52:52.446567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:73088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.982 [2024-11-16 16:52:52.446581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.982 [2024-11-16 16:52:52.446597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:73216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.982 [2024-11-16 16:52:52.446629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.982 [2024-11-16 16:52:52.446646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:73344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.982 [2024-11-16 16:52:52.446660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.982 [2024-11-16 16:52:52.446677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:65408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.446691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.446708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:73472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.446724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.446740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:73600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.446756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.446773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:73728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.446789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.446806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:65920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.446821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.446842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:66048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.446859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.446876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:73856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.446891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.446907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:73984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.446930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.446947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:74112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.446963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.446979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:74240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.446994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:74368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:66432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:66560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:66816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:67072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:68096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:68224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:68352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:68480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:68608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:68736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:68992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:69120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:69248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:69504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:69760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:74496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:74624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:74752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:74880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:75008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:75136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:75264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:75392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:75520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:75648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:75776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:75904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:76032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.983 [2024-11-16 16:52:52.447981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:76160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.983 [2024-11-16 16:52:52.447996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.984 [2024-11-16 16:52:52.448013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.984 [2024-11-16 16:52:52.448028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.984 [2024-11-16 16:52:52.448044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:76416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.984 [2024-11-16 16:52:52.448060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.984 [2024-11-16 16:52:52.448077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:76544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.984 [2024-11-16 16:52:52.448095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.984 [2024-11-16 16:52:52.448113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:76672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.984 [2024-11-16 16:52:52.448128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.984 [2024-11-16 16:52:52.448145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:76800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.984 [2024-11-16 16:52:52.448160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.984 [2024-11-16 16:52:52.448177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:76928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.984 [2024-11-16 16:52:52.448192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.984 [2024-11-16 16:52:52.448208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:77056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.984 [2024-11-16 16:52:52.448224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.984 [2024-11-16 16:52:52.448241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:77184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.984 [2024-11-16 16:52:52.448256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.984 [2024-11-16 16:52:52.448272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:77312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.984 [2024-11-16 16:52:52.448287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.984 [2024-11-16 16:52:52.448304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:77440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.984 [2024-11-16 16:52:52.448320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.984 [2024-11-16 16:52:52.448337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:77568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.984 [2024-11-16 16:52:52.448352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.984 [2024-11-16 16:52:52.448369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:77696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.984 [2024-11-16 16:52:52.448384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.984 [2024-11-16 16:52:52.448401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:77824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:06.984 [2024-11-16 16:52:52.448416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:06.984 [2024-11-16 16:52:52.448514] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2404630 was disconnected and freed. reset controller. 00:17:06.984 16:52:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:06.984 16:52:52 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:06.984 16:52:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:06.984 [2024-11-16 16:52:52.449708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:06.984 16:52:52 -- common/autotest_common.sh@10 -- # set +x 00:17:06.984 task offset: 70912 on job bdev=Nvme0n1 fails 00:17:06.984 00:17:06.984 Latency(us) 00:17:06.984 [2024-11-16T15:52:52.734Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:06.984 [2024-11-16T15:52:52.734Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:06.984 [2024-11-16T15:52:52.734Z] Job: Nvme0n1 ended in about 0.67 seconds with error 00:17:06.984 Verification LBA range: start 0x0 length 0x400 00:17:06.984 Nvme0n1 : 0.67 3878.25 242.39 95.72 0.00 15869.37 2645.71 22719.15 00:17:06.984 [2024-11-16T15:52:52.734Z] =================================================================================================================== 00:17:06.984 [2024-11-16T15:52:52.734Z] Total : 3878.25 242.39 95.72 0.00 15869.37 2645.71 22719.15 00:17:06.984 [2024-11-16 16:52:52.451665] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:06.984 [2024-11-16 16:52:52.451696] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x240a1d0 (9): Bad file descriptor 00:17:06.984 16:52:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:06.984 16:52:52 -- target/host_management.sh@87 -- # sleep 1 00:17:06.984 [2024-11-16 16:52:52.460756] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:07.923 16:52:53 -- target/host_management.sh@91 -- # kill -9 1185159 00:17:07.923 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (1185159) - No such process 00:17:07.923 16:52:53 -- target/host_management.sh@91 -- # true 00:17:07.923 16:52:53 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:07.923 16:52:53 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:07.923 16:52:53 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:07.923 16:52:53 -- nvmf/common.sh@520 -- # config=() 00:17:07.923 16:52:53 -- nvmf/common.sh@520 -- # local subsystem config 00:17:07.923 16:52:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:07.923 16:52:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:07.923 { 00:17:07.923 "params": { 00:17:07.923 "name": "Nvme$subsystem", 00:17:07.923 "trtype": "$TEST_TRANSPORT", 00:17:07.923 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:07.923 "adrfam": "ipv4", 00:17:07.923 "trsvcid": "$NVMF_PORT", 00:17:07.923 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:07.923 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:07.923 "hdgst": ${hdgst:-false}, 00:17:07.923 "ddgst": ${ddgst:-false} 00:17:07.923 }, 00:17:07.923 "method": "bdev_nvme_attach_controller" 00:17:07.923 } 00:17:07.923 EOF 00:17:07.923 )") 00:17:07.923 16:52:53 -- nvmf/common.sh@542 -- # cat 00:17:07.923 16:52:53 -- nvmf/common.sh@544 -- # jq . 00:17:07.923 16:52:53 -- nvmf/common.sh@545 -- # IFS=, 00:17:07.923 16:52:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:07.923 "params": { 00:17:07.923 "name": "Nvme0", 00:17:07.923 "trtype": "tcp", 00:17:07.923 "traddr": "10.0.0.2", 00:17:07.923 "adrfam": "ipv4", 00:17:07.923 "trsvcid": "4420", 00:17:07.923 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:07.923 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:07.923 "hdgst": false, 00:17:07.923 "ddgst": false 00:17:07.923 }, 00:17:07.923 "method": "bdev_nvme_attach_controller" 00:17:07.923 }' 00:17:07.923 [2024-11-16 16:52:53.502775] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:07.923 [2024-11-16 16:52:53.502857] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1185368 ] 00:17:07.923 EAL: No free 2048 kB hugepages reported on node 1 00:17:07.923 [2024-11-16 16:52:53.562449] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:07.923 [2024-11-16 16:52:53.646848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:08.182 Running I/O for 1 seconds... 00:17:09.560 00:17:09.560 Latency(us) 00:17:09.560 [2024-11-16T15:52:55.310Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:09.560 [2024-11-16T15:52:55.310Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:09.560 Verification LBA range: start 0x0 length 0x400 00:17:09.560 Nvme0n1 : 1.05 3926.63 245.41 0.00 0.00 15442.09 3228.25 43302.31 00:17:09.560 [2024-11-16T15:52:55.310Z] =================================================================================================================== 00:17:09.560 [2024-11-16T15:52:55.310Z] Total : 3926.63 245.41 0.00 0.00 15442.09 3228.25 43302.31 00:17:09.560 16:52:55 -- target/host_management.sh@101 -- # stoptarget 00:17:09.560 16:52:55 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:09.560 16:52:55 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:09.560 16:52:55 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:09.560 16:52:55 -- target/host_management.sh@40 -- # nvmftestfini 00:17:09.560 16:52:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:09.560 16:52:55 -- nvmf/common.sh@116 -- # sync 00:17:09.560 16:52:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:09.560 16:52:55 -- nvmf/common.sh@119 -- # set +e 00:17:09.560 16:52:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:09.560 16:52:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:09.560 rmmod nvme_tcp 00:17:09.560 rmmod nvme_fabrics 00:17:09.560 rmmod nvme_keyring 00:17:09.560 16:52:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:09.560 16:52:55 -- nvmf/common.sh@123 -- # set -e 00:17:09.560 16:52:55 -- nvmf/common.sh@124 -- # return 0 00:17:09.560 16:52:55 -- nvmf/common.sh@477 -- # '[' -n 1184986 ']' 00:17:09.560 16:52:55 -- nvmf/common.sh@478 -- # killprocess 1184986 00:17:09.560 16:52:55 -- common/autotest_common.sh@936 -- # '[' -z 1184986 ']' 00:17:09.560 16:52:55 -- common/autotest_common.sh@940 -- # kill -0 1184986 00:17:09.560 16:52:55 -- common/autotest_common.sh@941 -- # uname 00:17:09.560 16:52:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:09.560 16:52:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1184986 00:17:09.560 16:52:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:09.560 16:52:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:09.560 16:52:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1184986' 00:17:09.560 killing process with pid 1184986 00:17:09.560 16:52:55 -- common/autotest_common.sh@955 -- # kill 1184986 00:17:09.560 16:52:55 -- common/autotest_common.sh@960 -- # wait 1184986 00:17:09.818 [2024-11-16 16:52:55.401656] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:09.818 16:52:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:09.818 16:52:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:09.818 16:52:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:09.818 16:52:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:09.818 16:52:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:09.818 16:52:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:09.818 16:52:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:09.818 16:52:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:11.722 16:52:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:11.722 00:17:11.722 real 0m7.213s 00:17:11.722 user 0m22.126s 00:17:11.722 sys 0m1.479s 00:17:11.722 16:52:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:11.722 16:52:57 -- common/autotest_common.sh@10 -- # set +x 00:17:11.722 ************************************ 00:17:11.722 END TEST nvmf_host_management 00:17:11.722 ************************************ 00:17:11.981 16:52:57 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:17:11.981 00:17:11.981 real 0m9.443s 00:17:11.981 user 0m22.962s 00:17:11.981 sys 0m2.885s 00:17:11.981 16:52:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:11.981 16:52:57 -- common/autotest_common.sh@10 -- # set +x 00:17:11.981 ************************************ 00:17:11.981 END TEST nvmf_host_management 00:17:11.981 ************************************ 00:17:11.981 16:52:57 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:11.981 16:52:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:11.981 16:52:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:11.981 16:52:57 -- common/autotest_common.sh@10 -- # set +x 00:17:11.981 ************************************ 00:17:11.981 START TEST nvmf_lvol 00:17:11.981 ************************************ 00:17:11.981 16:52:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:11.981 * Looking for test storage... 00:17:11.981 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:11.981 16:52:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:11.981 16:52:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:11.981 16:52:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:11.981 16:52:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:11.981 16:52:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:11.981 16:52:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:11.981 16:52:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:11.981 16:52:57 -- scripts/common.sh@335 -- # IFS=.-: 00:17:11.981 16:52:57 -- scripts/common.sh@335 -- # read -ra ver1 00:17:11.981 16:52:57 -- scripts/common.sh@336 -- # IFS=.-: 00:17:11.981 16:52:57 -- scripts/common.sh@336 -- # read -ra ver2 00:17:11.981 16:52:57 -- scripts/common.sh@337 -- # local 'op=<' 00:17:11.981 16:52:57 -- scripts/common.sh@339 -- # ver1_l=2 00:17:11.981 16:52:57 -- scripts/common.sh@340 -- # ver2_l=1 00:17:11.981 16:52:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:11.981 16:52:57 -- scripts/common.sh@343 -- # case "$op" in 00:17:11.981 16:52:57 -- scripts/common.sh@344 -- # : 1 00:17:11.981 16:52:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:11.981 16:52:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:11.981 16:52:57 -- scripts/common.sh@364 -- # decimal 1 00:17:11.981 16:52:57 -- scripts/common.sh@352 -- # local d=1 00:17:11.981 16:52:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:11.981 16:52:57 -- scripts/common.sh@354 -- # echo 1 00:17:11.981 16:52:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:11.981 16:52:57 -- scripts/common.sh@365 -- # decimal 2 00:17:11.981 16:52:57 -- scripts/common.sh@352 -- # local d=2 00:17:11.981 16:52:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:11.981 16:52:57 -- scripts/common.sh@354 -- # echo 2 00:17:11.981 16:52:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:11.981 16:52:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:11.981 16:52:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:11.981 16:52:57 -- scripts/common.sh@367 -- # return 0 00:17:11.981 16:52:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:11.981 16:52:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:11.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.981 --rc genhtml_branch_coverage=1 00:17:11.981 --rc genhtml_function_coverage=1 00:17:11.981 --rc genhtml_legend=1 00:17:11.981 --rc geninfo_all_blocks=1 00:17:11.981 --rc geninfo_unexecuted_blocks=1 00:17:11.981 00:17:11.981 ' 00:17:11.981 16:52:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:11.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.981 --rc genhtml_branch_coverage=1 00:17:11.981 --rc genhtml_function_coverage=1 00:17:11.981 --rc genhtml_legend=1 00:17:11.981 --rc geninfo_all_blocks=1 00:17:11.981 --rc geninfo_unexecuted_blocks=1 00:17:11.981 00:17:11.981 ' 00:17:11.981 16:52:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:11.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.981 --rc genhtml_branch_coverage=1 00:17:11.981 --rc genhtml_function_coverage=1 00:17:11.981 --rc genhtml_legend=1 00:17:11.981 --rc geninfo_all_blocks=1 00:17:11.981 --rc geninfo_unexecuted_blocks=1 00:17:11.981 00:17:11.981 ' 00:17:11.982 16:52:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:11.982 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.982 --rc genhtml_branch_coverage=1 00:17:11.982 --rc genhtml_function_coverage=1 00:17:11.982 --rc genhtml_legend=1 00:17:11.982 --rc geninfo_all_blocks=1 00:17:11.982 --rc geninfo_unexecuted_blocks=1 00:17:11.982 00:17:11.982 ' 00:17:11.982 16:52:57 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:11.982 16:52:57 -- nvmf/common.sh@7 -- # uname -s 00:17:11.982 16:52:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:11.982 16:52:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:11.982 16:52:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:11.982 16:52:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:11.982 16:52:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:11.982 16:52:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:11.982 16:52:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:11.982 16:52:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:11.982 16:52:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:11.982 16:52:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:11.982 16:52:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:11.982 16:52:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:11.982 16:52:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:11.982 16:52:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:11.982 16:52:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:11.982 16:52:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:11.982 16:52:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:11.982 16:52:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:11.982 16:52:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:11.982 16:52:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.982 16:52:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.982 16:52:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.982 16:52:57 -- paths/export.sh@5 -- # export PATH 00:17:11.982 16:52:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.982 16:52:57 -- nvmf/common.sh@46 -- # : 0 00:17:11.982 16:52:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:11.982 16:52:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:11.982 16:52:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:11.982 16:52:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:11.982 16:52:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:11.982 16:52:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:11.982 16:52:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:11.982 16:52:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:11.982 16:52:57 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:11.982 16:52:57 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:11.982 16:52:57 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:11.982 16:52:57 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:11.982 16:52:57 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:11.982 16:52:57 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:11.982 16:52:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:11.982 16:52:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:11.982 16:52:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:11.982 16:52:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:11.982 16:52:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:11.982 16:52:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:11.982 16:52:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:11.982 16:52:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:11.982 16:52:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:11.982 16:52:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:11.982 16:52:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:11.982 16:52:57 -- common/autotest_common.sh@10 -- # set +x 00:17:13.887 16:52:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:13.887 16:52:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:13.887 16:52:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:13.887 16:52:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:13.887 16:52:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:13.887 16:52:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:13.887 16:52:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:13.887 16:52:59 -- nvmf/common.sh@294 -- # net_devs=() 00:17:13.887 16:52:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:13.887 16:52:59 -- nvmf/common.sh@295 -- # e810=() 00:17:13.887 16:52:59 -- nvmf/common.sh@295 -- # local -ga e810 00:17:13.887 16:52:59 -- nvmf/common.sh@296 -- # x722=() 00:17:13.887 16:52:59 -- nvmf/common.sh@296 -- # local -ga x722 00:17:13.887 16:52:59 -- nvmf/common.sh@297 -- # mlx=() 00:17:13.887 16:52:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:13.887 16:52:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:13.887 16:52:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:13.887 16:52:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:13.887 16:52:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:13.887 16:52:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:13.887 16:52:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:13.887 16:52:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:13.887 16:52:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:13.887 16:52:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:13.887 16:52:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:13.887 16:52:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:13.887 16:52:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:13.887 16:52:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:13.887 16:52:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:13.887 16:52:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:13.887 16:52:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:13.887 16:52:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:13.887 16:52:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:13.887 16:52:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:13.887 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:13.887 16:52:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:13.887 16:52:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:13.888 16:52:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:13.888 16:52:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:13.888 16:52:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:13.888 16:52:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:13.888 16:52:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:13.888 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:13.888 16:52:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:13.888 16:52:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:13.888 16:52:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:13.888 16:52:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:13.888 16:52:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:13.888 16:52:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:13.888 16:52:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:13.888 16:52:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:13.888 16:52:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:13.888 16:52:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:13.888 16:52:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:13.888 16:52:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:13.888 16:52:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:13.888 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:13.888 16:52:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:13.888 16:52:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:13.888 16:52:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:13.888 16:52:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:13.888 16:52:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:13.888 16:52:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:13.888 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:13.888 16:52:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:13.888 16:52:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:13.888 16:52:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:13.888 16:52:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:13.888 16:52:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:13.888 16:52:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:13.888 16:52:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:13.888 16:52:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:13.888 16:52:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:13.888 16:52:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:13.888 16:52:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:14.147 16:52:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:14.147 16:52:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:14.147 16:52:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:14.147 16:52:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:14.147 16:52:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:14.147 16:52:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:14.147 16:52:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:14.147 16:52:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:14.147 16:52:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:14.147 16:52:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:14.147 16:52:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:14.147 16:52:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:14.147 16:52:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:14.147 16:52:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:14.147 16:52:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:14.147 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:14.147 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:17:14.147 00:17:14.147 --- 10.0.0.2 ping statistics --- 00:17:14.147 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:14.147 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:17:14.147 16:52:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:14.147 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:14.147 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:17:14.147 00:17:14.148 --- 10.0.0.1 ping statistics --- 00:17:14.148 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:14.148 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:17:14.148 16:52:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:14.148 16:52:59 -- nvmf/common.sh@410 -- # return 0 00:17:14.148 16:52:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:14.148 16:52:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:14.148 16:52:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:14.148 16:52:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:14.148 16:52:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:14.148 16:52:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:14.148 16:52:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:14.407 16:52:59 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:14.407 16:52:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:14.407 16:52:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:14.407 16:52:59 -- common/autotest_common.sh@10 -- # set +x 00:17:14.407 16:52:59 -- nvmf/common.sh@469 -- # nvmfpid=1187608 00:17:14.407 16:52:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:14.407 16:52:59 -- nvmf/common.sh@470 -- # waitforlisten 1187608 00:17:14.407 16:52:59 -- common/autotest_common.sh@829 -- # '[' -z 1187608 ']' 00:17:14.407 16:52:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:14.407 16:52:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:14.408 16:52:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:14.408 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:14.408 16:52:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:14.408 16:52:59 -- common/autotest_common.sh@10 -- # set +x 00:17:14.408 [2024-11-16 16:52:59.972744] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:14.408 [2024-11-16 16:52:59.972819] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:14.408 EAL: No free 2048 kB hugepages reported on node 1 00:17:14.408 [2024-11-16 16:53:00.044459] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:14.408 [2024-11-16 16:53:00.142378] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:14.408 [2024-11-16 16:53:00.142542] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:14.408 [2024-11-16 16:53:00.142562] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:14.408 [2024-11-16 16:53:00.142575] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:14.408 [2024-11-16 16:53:00.142639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:14.408 [2024-11-16 16:53:00.142667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:14.408 [2024-11-16 16:53:00.142670] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:15.341 16:53:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:15.341 16:53:00 -- common/autotest_common.sh@862 -- # return 0 00:17:15.341 16:53:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:15.341 16:53:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:15.341 16:53:01 -- common/autotest_common.sh@10 -- # set +x 00:17:15.341 16:53:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:15.341 16:53:01 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:15.599 [2024-11-16 16:53:01.250278] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:15.599 16:53:01 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:15.857 16:53:01 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:15.857 16:53:01 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:16.114 16:53:01 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:16.114 16:53:01 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:16.372 16:53:02 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:16.630 16:53:02 -- target/nvmf_lvol.sh@29 -- # lvs=92de3d4e-cc69-4a10-a0de-f01667d22843 00:17:16.630 16:53:02 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 92de3d4e-cc69-4a10-a0de-f01667d22843 lvol 20 00:17:16.887 16:53:02 -- target/nvmf_lvol.sh@32 -- # lvol=74230633-1a99-4e21-ad4b-405fee42cdb4 00:17:16.887 16:53:02 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:17.145 16:53:02 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 74230633-1a99-4e21-ad4b-405fee42cdb4 00:17:17.402 16:53:03 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:17.660 [2024-11-16 16:53:03.333687] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:17.660 16:53:03 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:17.917 16:53:03 -- target/nvmf_lvol.sh@42 -- # perf_pid=1188056 00:17:17.917 16:53:03 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:17.917 16:53:03 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:17.917 EAL: No free 2048 kB hugepages reported on node 1 00:17:19.291 16:53:04 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 74230633-1a99-4e21-ad4b-405fee42cdb4 MY_SNAPSHOT 00:17:19.291 16:53:04 -- target/nvmf_lvol.sh@47 -- # snapshot=8952d642-acdd-47b1-8c92-c60050e19b05 00:17:19.291 16:53:04 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 74230633-1a99-4e21-ad4b-405fee42cdb4 30 00:17:19.549 16:53:05 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 8952d642-acdd-47b1-8c92-c60050e19b05 MY_CLONE 00:17:19.807 16:53:05 -- target/nvmf_lvol.sh@49 -- # clone=0426c91d-5567-4545-8bf1-10ca26bfb0f5 00:17:19.807 16:53:05 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 0426c91d-5567-4545-8bf1-10ca26bfb0f5 00:17:20.371 16:53:06 -- target/nvmf_lvol.sh@53 -- # wait 1188056 00:17:28.478 Initializing NVMe Controllers 00:17:28.478 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:28.478 Controller IO queue size 128, less than required. 00:17:28.478 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:28.478 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:28.478 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:28.478 Initialization complete. Launching workers. 00:17:28.478 ======================================================== 00:17:28.478 Latency(us) 00:17:28.478 Device Information : IOPS MiB/s Average min max 00:17:28.478 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10724.50 41.89 11938.69 1784.77 106579.45 00:17:28.478 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10730.00 41.91 11930.51 1935.82 50141.92 00:17:28.478 ======================================================== 00:17:28.478 Total : 21454.50 83.81 11934.60 1784.77 106579.45 00:17:28.478 00:17:28.478 16:53:14 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:28.735 16:53:14 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 74230633-1a99-4e21-ad4b-405fee42cdb4 00:17:28.993 16:53:14 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 92de3d4e-cc69-4a10-a0de-f01667d22843 00:17:29.251 16:53:14 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:29.251 16:53:14 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:29.251 16:53:14 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:29.251 16:53:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:29.251 16:53:14 -- nvmf/common.sh@116 -- # sync 00:17:29.251 16:53:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:29.251 16:53:14 -- nvmf/common.sh@119 -- # set +e 00:17:29.251 16:53:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:29.251 16:53:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:29.251 rmmod nvme_tcp 00:17:29.251 rmmod nvme_fabrics 00:17:29.251 rmmod nvme_keyring 00:17:29.251 16:53:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:29.251 16:53:14 -- nvmf/common.sh@123 -- # set -e 00:17:29.251 16:53:14 -- nvmf/common.sh@124 -- # return 0 00:17:29.251 16:53:14 -- nvmf/common.sh@477 -- # '[' -n 1187608 ']' 00:17:29.251 16:53:14 -- nvmf/common.sh@478 -- # killprocess 1187608 00:17:29.251 16:53:14 -- common/autotest_common.sh@936 -- # '[' -z 1187608 ']' 00:17:29.251 16:53:14 -- common/autotest_common.sh@940 -- # kill -0 1187608 00:17:29.251 16:53:14 -- common/autotest_common.sh@941 -- # uname 00:17:29.251 16:53:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:29.251 16:53:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1187608 00:17:29.251 16:53:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:29.251 16:53:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:29.251 16:53:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1187608' 00:17:29.251 killing process with pid 1187608 00:17:29.251 16:53:14 -- common/autotest_common.sh@955 -- # kill 1187608 00:17:29.251 16:53:14 -- common/autotest_common.sh@960 -- # wait 1187608 00:17:29.817 16:53:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:29.817 16:53:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:29.817 16:53:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:29.817 16:53:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:29.817 16:53:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:29.817 16:53:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:29.817 16:53:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:29.817 16:53:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:31.718 16:53:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:31.718 00:17:31.718 real 0m19.801s 00:17:31.718 user 1m7.304s 00:17:31.718 sys 0m5.368s 00:17:31.718 16:53:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:31.718 16:53:17 -- common/autotest_common.sh@10 -- # set +x 00:17:31.718 ************************************ 00:17:31.718 END TEST nvmf_lvol 00:17:31.718 ************************************ 00:17:31.718 16:53:17 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:31.718 16:53:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:31.718 16:53:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:31.718 16:53:17 -- common/autotest_common.sh@10 -- # set +x 00:17:31.718 ************************************ 00:17:31.718 START TEST nvmf_lvs_grow 00:17:31.718 ************************************ 00:17:31.718 16:53:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:31.718 * Looking for test storage... 00:17:31.718 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:31.718 16:53:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:31.718 16:53:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:31.718 16:53:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:31.977 16:53:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:31.977 16:53:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:31.977 16:53:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:31.977 16:53:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:31.977 16:53:17 -- scripts/common.sh@335 -- # IFS=.-: 00:17:31.977 16:53:17 -- scripts/common.sh@335 -- # read -ra ver1 00:17:31.977 16:53:17 -- scripts/common.sh@336 -- # IFS=.-: 00:17:31.977 16:53:17 -- scripts/common.sh@336 -- # read -ra ver2 00:17:31.977 16:53:17 -- scripts/common.sh@337 -- # local 'op=<' 00:17:31.977 16:53:17 -- scripts/common.sh@339 -- # ver1_l=2 00:17:31.977 16:53:17 -- scripts/common.sh@340 -- # ver2_l=1 00:17:31.977 16:53:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:31.977 16:53:17 -- scripts/common.sh@343 -- # case "$op" in 00:17:31.977 16:53:17 -- scripts/common.sh@344 -- # : 1 00:17:31.977 16:53:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:31.977 16:53:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:31.977 16:53:17 -- scripts/common.sh@364 -- # decimal 1 00:17:31.977 16:53:17 -- scripts/common.sh@352 -- # local d=1 00:17:31.977 16:53:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:31.977 16:53:17 -- scripts/common.sh@354 -- # echo 1 00:17:31.977 16:53:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:31.977 16:53:17 -- scripts/common.sh@365 -- # decimal 2 00:17:31.977 16:53:17 -- scripts/common.sh@352 -- # local d=2 00:17:31.977 16:53:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:31.977 16:53:17 -- scripts/common.sh@354 -- # echo 2 00:17:31.977 16:53:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:31.977 16:53:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:31.977 16:53:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:31.977 16:53:17 -- scripts/common.sh@367 -- # return 0 00:17:31.977 16:53:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:31.977 16:53:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:31.977 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:31.977 --rc genhtml_branch_coverage=1 00:17:31.977 --rc genhtml_function_coverage=1 00:17:31.977 --rc genhtml_legend=1 00:17:31.977 --rc geninfo_all_blocks=1 00:17:31.977 --rc geninfo_unexecuted_blocks=1 00:17:31.977 00:17:31.977 ' 00:17:31.977 16:53:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:31.977 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:31.977 --rc genhtml_branch_coverage=1 00:17:31.977 --rc genhtml_function_coverage=1 00:17:31.977 --rc genhtml_legend=1 00:17:31.977 --rc geninfo_all_blocks=1 00:17:31.977 --rc geninfo_unexecuted_blocks=1 00:17:31.977 00:17:31.977 ' 00:17:31.977 16:53:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:31.977 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:31.977 --rc genhtml_branch_coverage=1 00:17:31.977 --rc genhtml_function_coverage=1 00:17:31.977 --rc genhtml_legend=1 00:17:31.977 --rc geninfo_all_blocks=1 00:17:31.977 --rc geninfo_unexecuted_blocks=1 00:17:31.977 00:17:31.977 ' 00:17:31.977 16:53:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:31.977 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:31.977 --rc genhtml_branch_coverage=1 00:17:31.977 --rc genhtml_function_coverage=1 00:17:31.977 --rc genhtml_legend=1 00:17:31.977 --rc geninfo_all_blocks=1 00:17:31.977 --rc geninfo_unexecuted_blocks=1 00:17:31.977 00:17:31.977 ' 00:17:31.977 16:53:17 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:31.977 16:53:17 -- nvmf/common.sh@7 -- # uname -s 00:17:31.977 16:53:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:31.977 16:53:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:31.977 16:53:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:31.977 16:53:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:31.977 16:53:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:31.977 16:53:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:31.977 16:53:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:31.977 16:53:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:31.977 16:53:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:31.977 16:53:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:31.977 16:53:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:31.977 16:53:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:31.977 16:53:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:31.977 16:53:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:31.977 16:53:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:31.977 16:53:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:31.977 16:53:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:31.977 16:53:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:31.977 16:53:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:31.977 16:53:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.977 16:53:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.977 16:53:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.978 16:53:17 -- paths/export.sh@5 -- # export PATH 00:17:31.978 16:53:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.978 16:53:17 -- nvmf/common.sh@46 -- # : 0 00:17:31.978 16:53:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:31.978 16:53:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:31.978 16:53:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:31.978 16:53:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:31.978 16:53:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:31.978 16:53:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:31.978 16:53:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:31.978 16:53:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:31.978 16:53:17 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:31.978 16:53:17 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:31.978 16:53:17 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:31.978 16:53:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:31.978 16:53:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:31.978 16:53:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:31.978 16:53:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:31.978 16:53:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:31.978 16:53:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:31.978 16:53:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:31.978 16:53:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:31.978 16:53:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:31.978 16:53:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:31.978 16:53:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:31.978 16:53:17 -- common/autotest_common.sh@10 -- # set +x 00:17:33.878 16:53:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:33.879 16:53:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:33.879 16:53:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:33.879 16:53:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:33.879 16:53:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:33.879 16:53:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:33.879 16:53:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:33.879 16:53:19 -- nvmf/common.sh@294 -- # net_devs=() 00:17:33.879 16:53:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:33.879 16:53:19 -- nvmf/common.sh@295 -- # e810=() 00:17:33.879 16:53:19 -- nvmf/common.sh@295 -- # local -ga e810 00:17:33.879 16:53:19 -- nvmf/common.sh@296 -- # x722=() 00:17:33.879 16:53:19 -- nvmf/common.sh@296 -- # local -ga x722 00:17:33.879 16:53:19 -- nvmf/common.sh@297 -- # mlx=() 00:17:33.879 16:53:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:33.879 16:53:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:33.879 16:53:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:33.879 16:53:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:33.879 16:53:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:33.879 16:53:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:33.879 16:53:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:33.879 16:53:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:33.879 16:53:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:33.879 16:53:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:33.879 16:53:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:33.879 16:53:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:33.879 16:53:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:33.879 16:53:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:33.879 16:53:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:33.879 16:53:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:33.879 16:53:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:33.879 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:33.879 16:53:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:33.879 16:53:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:33.879 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:33.879 16:53:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:33.879 16:53:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:33.879 16:53:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:33.879 16:53:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:33.879 16:53:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:33.879 16:53:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:33.879 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:33.879 16:53:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:33.879 16:53:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:33.879 16:53:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:33.879 16:53:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:33.879 16:53:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:33.879 16:53:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:33.879 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:33.879 16:53:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:33.879 16:53:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:33.879 16:53:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:33.879 16:53:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:33.879 16:53:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:33.879 16:53:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:33.879 16:53:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:33.879 16:53:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:33.879 16:53:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:33.879 16:53:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:33.879 16:53:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:33.879 16:53:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:33.879 16:53:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:33.879 16:53:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:33.879 16:53:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:33.879 16:53:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:33.879 16:53:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:33.879 16:53:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:33.879 16:53:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:33.879 16:53:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:33.879 16:53:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:33.879 16:53:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:33.879 16:53:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:33.879 16:53:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:33.879 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:33.879 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:17:33.879 00:17:33.879 --- 10.0.0.2 ping statistics --- 00:17:33.879 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:33.879 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:17:33.879 16:53:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:33.879 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:33.879 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:17:33.879 00:17:33.879 --- 10.0.0.1 ping statistics --- 00:17:33.879 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:33.879 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:17:33.879 16:53:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:33.879 16:53:19 -- nvmf/common.sh@410 -- # return 0 00:17:33.879 16:53:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:33.879 16:53:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:33.879 16:53:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:33.879 16:53:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:33.879 16:53:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:33.879 16:53:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:33.879 16:53:19 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:33.879 16:53:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:33.879 16:53:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:33.879 16:53:19 -- common/autotest_common.sh@10 -- # set +x 00:17:33.879 16:53:19 -- nvmf/common.sh@469 -- # nvmfpid=1191380 00:17:33.879 16:53:19 -- nvmf/common.sh@470 -- # waitforlisten 1191380 00:17:33.879 16:53:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:33.879 16:53:19 -- common/autotest_common.sh@829 -- # '[' -z 1191380 ']' 00:17:33.879 16:53:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:33.879 16:53:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:33.879 16:53:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:33.879 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:33.879 16:53:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:33.879 16:53:19 -- common/autotest_common.sh@10 -- # set +x 00:17:34.137 [2024-11-16 16:53:19.636537] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:34.137 [2024-11-16 16:53:19.636634] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:34.138 EAL: No free 2048 kB hugepages reported on node 1 00:17:34.138 [2024-11-16 16:53:19.705916] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:34.138 [2024-11-16 16:53:19.793678] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:34.138 [2024-11-16 16:53:19.793834] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:34.138 [2024-11-16 16:53:19.793850] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:34.138 [2024-11-16 16:53:19.793863] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:34.138 [2024-11-16 16:53:19.793898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:35.071 16:53:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:35.071 16:53:20 -- common/autotest_common.sh@862 -- # return 0 00:17:35.071 16:53:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:35.071 16:53:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:35.071 16:53:20 -- common/autotest_common.sh@10 -- # set +x 00:17:35.071 16:53:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:35.071 16:53:20 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:35.329 [2024-11-16 16:53:20.880373] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:35.329 16:53:20 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:35.329 16:53:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:35.329 16:53:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:35.329 16:53:20 -- common/autotest_common.sh@10 -- # set +x 00:17:35.329 ************************************ 00:17:35.329 START TEST lvs_grow_clean 00:17:35.329 ************************************ 00:17:35.329 16:53:20 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:35.329 16:53:20 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:35.329 16:53:20 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:35.329 16:53:20 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:35.329 16:53:20 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:35.329 16:53:20 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:35.329 16:53:20 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:35.329 16:53:20 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:35.329 16:53:20 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:35.329 16:53:20 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:35.587 16:53:21 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:35.587 16:53:21 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:35.845 16:53:21 -- target/nvmf_lvs_grow.sh@28 -- # lvs=40239520-fafa-40ec-8795-4b81c03e1ea0 00:17:35.845 16:53:21 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 40239520-fafa-40ec-8795-4b81c03e1ea0 00:17:35.845 16:53:21 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:36.103 16:53:21 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:36.103 16:53:21 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:36.103 16:53:21 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 40239520-fafa-40ec-8795-4b81c03e1ea0 lvol 150 00:17:36.361 16:53:21 -- target/nvmf_lvs_grow.sh@33 -- # lvol=02e8027f-15d2-4d18-9785-898e7894acba 00:17:36.361 16:53:21 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:36.361 16:53:21 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:36.619 [2024-11-16 16:53:22.217043] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:36.619 [2024-11-16 16:53:22.217130] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:36.619 true 00:17:36.619 16:53:22 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 40239520-fafa-40ec-8795-4b81c03e1ea0 00:17:36.619 16:53:22 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:36.877 16:53:22 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:36.877 16:53:22 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:37.134 16:53:22 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 02e8027f-15d2-4d18-9785-898e7894acba 00:17:37.391 16:53:22 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:37.649 [2024-11-16 16:53:23.236253] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:37.649 16:53:23 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:37.908 16:53:23 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1191949 00:17:37.908 16:53:23 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:37.908 16:53:23 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:37.908 16:53:23 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1191949 /var/tmp/bdevperf.sock 00:17:37.908 16:53:23 -- common/autotest_common.sh@829 -- # '[' -z 1191949 ']' 00:17:37.908 16:53:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:37.908 16:53:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:37.908 16:53:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:37.908 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:37.908 16:53:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:37.908 16:53:23 -- common/autotest_common.sh@10 -- # set +x 00:17:37.908 [2024-11-16 16:53:23.540818] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:37.908 [2024-11-16 16:53:23.540907] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1191949 ] 00:17:37.908 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.908 [2024-11-16 16:53:23.598553] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:38.166 [2024-11-16 16:53:23.683317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:39.100 16:53:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:39.100 16:53:24 -- common/autotest_common.sh@862 -- # return 0 00:17:39.100 16:53:24 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:39.358 Nvme0n1 00:17:39.358 16:53:24 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:39.616 [ 00:17:39.616 { 00:17:39.616 "name": "Nvme0n1", 00:17:39.616 "aliases": [ 00:17:39.616 "02e8027f-15d2-4d18-9785-898e7894acba" 00:17:39.616 ], 00:17:39.616 "product_name": "NVMe disk", 00:17:39.616 "block_size": 4096, 00:17:39.616 "num_blocks": 38912, 00:17:39.616 "uuid": "02e8027f-15d2-4d18-9785-898e7894acba", 00:17:39.616 "assigned_rate_limits": { 00:17:39.616 "rw_ios_per_sec": 0, 00:17:39.616 "rw_mbytes_per_sec": 0, 00:17:39.616 "r_mbytes_per_sec": 0, 00:17:39.616 "w_mbytes_per_sec": 0 00:17:39.616 }, 00:17:39.616 "claimed": false, 00:17:39.616 "zoned": false, 00:17:39.616 "supported_io_types": { 00:17:39.616 "read": true, 00:17:39.616 "write": true, 00:17:39.616 "unmap": true, 00:17:39.616 "write_zeroes": true, 00:17:39.616 "flush": true, 00:17:39.616 "reset": true, 00:17:39.616 "compare": true, 00:17:39.616 "compare_and_write": true, 00:17:39.616 "abort": true, 00:17:39.616 "nvme_admin": true, 00:17:39.616 "nvme_io": true 00:17:39.616 }, 00:17:39.616 "driver_specific": { 00:17:39.616 "nvme": [ 00:17:39.616 { 00:17:39.616 "trid": { 00:17:39.617 "trtype": "TCP", 00:17:39.617 "adrfam": "IPv4", 00:17:39.617 "traddr": "10.0.0.2", 00:17:39.617 "trsvcid": "4420", 00:17:39.617 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:39.617 }, 00:17:39.617 "ctrlr_data": { 00:17:39.617 "cntlid": 1, 00:17:39.617 "vendor_id": "0x8086", 00:17:39.617 "model_number": "SPDK bdev Controller", 00:17:39.617 "serial_number": "SPDK0", 00:17:39.617 "firmware_revision": "24.01.1", 00:17:39.617 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:39.617 "oacs": { 00:17:39.617 "security": 0, 00:17:39.617 "format": 0, 00:17:39.617 "firmware": 0, 00:17:39.617 "ns_manage": 0 00:17:39.617 }, 00:17:39.617 "multi_ctrlr": true, 00:17:39.617 "ana_reporting": false 00:17:39.617 }, 00:17:39.617 "vs": { 00:17:39.617 "nvme_version": "1.3" 00:17:39.617 }, 00:17:39.617 "ns_data": { 00:17:39.617 "id": 1, 00:17:39.617 "can_share": true 00:17:39.617 } 00:17:39.617 } 00:17:39.617 ], 00:17:39.617 "mp_policy": "active_passive" 00:17:39.617 } 00:17:39.617 } 00:17:39.617 ] 00:17:39.617 16:53:25 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1192139 00:17:39.617 16:53:25 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:39.617 16:53:25 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:39.876 Running I/O for 10 seconds... 00:17:40.816 Latency(us) 00:17:40.816 [2024-11-16T15:53:26.566Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:40.816 [2024-11-16T15:53:26.566Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.816 Nvme0n1 : 1.00 14644.00 57.20 0.00 0.00 0.00 0.00 0.00 00:17:40.816 [2024-11-16T15:53:26.566Z] =================================================================================================================== 00:17:40.816 [2024-11-16T15:53:26.566Z] Total : 14644.00 57.20 0.00 0.00 0.00 0.00 0.00 00:17:40.816 00:17:41.753 16:53:27 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 40239520-fafa-40ec-8795-4b81c03e1ea0 00:17:41.753 [2024-11-16T15:53:27.503Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:41.753 Nvme0n1 : 2.00 14859.00 58.04 0.00 0.00 0.00 0.00 0.00 00:17:41.753 [2024-11-16T15:53:27.503Z] =================================================================================================================== 00:17:41.753 [2024-11-16T15:53:27.503Z] Total : 14859.00 58.04 0.00 0.00 0.00 0.00 0.00 00:17:41.753 00:17:42.011 true 00:17:42.011 16:53:27 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 40239520-fafa-40ec-8795-4b81c03e1ea0 00:17:42.011 16:53:27 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:42.270 16:53:27 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:42.270 16:53:27 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:42.270 16:53:27 -- target/nvmf_lvs_grow.sh@65 -- # wait 1192139 00:17:42.855 [2024-11-16T15:53:28.605Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:42.855 Nvme0n1 : 3.00 14963.33 58.45 0.00 0.00 0.00 0.00 0.00 00:17:42.855 [2024-11-16T15:53:28.605Z] =================================================================================================================== 00:17:42.855 [2024-11-16T15:53:28.605Z] Total : 14963.33 58.45 0.00 0.00 0.00 0.00 0.00 00:17:42.855 00:17:43.817 [2024-11-16T15:53:29.567Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:43.817 Nvme0n1 : 4.00 15050.00 58.79 0.00 0.00 0.00 0.00 0.00 00:17:43.817 [2024-11-16T15:53:29.567Z] =================================================================================================================== 00:17:43.817 [2024-11-16T15:53:29.567Z] Total : 15050.00 58.79 0.00 0.00 0.00 0.00 0.00 00:17:43.817 00:17:44.755 [2024-11-16T15:53:30.505Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:44.755 Nvme0n1 : 5.00 15007.20 58.62 0.00 0.00 0.00 0.00 0.00 00:17:44.755 [2024-11-16T15:53:30.505Z] =================================================================================================================== 00:17:44.755 [2024-11-16T15:53:30.505Z] Total : 15007.20 58.62 0.00 0.00 0.00 0.00 0.00 00:17:44.755 00:17:45.694 [2024-11-16T15:53:31.444Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.694 Nvme0n1 : 6.00 14851.33 58.01 0.00 0.00 0.00 0.00 0.00 00:17:45.694 [2024-11-16T15:53:31.444Z] =================================================================================================================== 00:17:45.694 [2024-11-16T15:53:31.444Z] Total : 14851.33 58.01 0.00 0.00 0.00 0.00 0.00 00:17:45.694 00:17:47.072 [2024-11-16T15:53:32.822Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:47.072 Nvme0n1 : 7.00 14748.00 57.61 0.00 0.00 0.00 0.00 0.00 00:17:47.072 [2024-11-16T15:53:32.822Z] =================================================================================================================== 00:17:47.072 [2024-11-16T15:53:32.822Z] Total : 14748.00 57.61 0.00 0.00 0.00 0.00 0.00 00:17:47.072 00:17:48.010 [2024-11-16T15:53:33.760Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:48.010 Nvme0n1 : 8.00 14675.50 57.33 0.00 0.00 0.00 0.00 0.00 00:17:48.010 [2024-11-16T15:53:33.760Z] =================================================================================================================== 00:17:48.010 [2024-11-16T15:53:33.760Z] Total : 14675.50 57.33 0.00 0.00 0.00 0.00 0.00 00:17:48.010 00:17:48.945 [2024-11-16T15:53:34.695Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:48.945 Nvme0n1 : 9.00 14621.78 57.12 0.00 0.00 0.00 0.00 0.00 00:17:48.945 [2024-11-16T15:53:34.695Z] =================================================================================================================== 00:17:48.945 [2024-11-16T15:53:34.695Z] Total : 14621.78 57.12 0.00 0.00 0.00 0.00 0.00 00:17:48.945 00:17:49.882 [2024-11-16T15:53:35.632Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:49.882 Nvme0n1 : 10.00 14579.60 56.95 0.00 0.00 0.00 0.00 0.00 00:17:49.882 [2024-11-16T15:53:35.632Z] =================================================================================================================== 00:17:49.882 [2024-11-16T15:53:35.632Z] Total : 14579.60 56.95 0.00 0.00 0.00 0.00 0.00 00:17:49.882 00:17:49.882 00:17:49.882 Latency(us) 00:17:49.882 [2024-11-16T15:53:35.632Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.882 [2024-11-16T15:53:35.632Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:49.882 Nvme0n1 : 10.01 14576.91 56.94 0.00 0.00 8772.88 2852.03 16311.18 00:17:49.882 [2024-11-16T15:53:35.632Z] =================================================================================================================== 00:17:49.882 [2024-11-16T15:53:35.632Z] Total : 14576.91 56.94 0.00 0.00 8772.88 2852.03 16311.18 00:17:49.882 0 00:17:49.882 16:53:35 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1191949 00:17:49.882 16:53:35 -- common/autotest_common.sh@936 -- # '[' -z 1191949 ']' 00:17:49.882 16:53:35 -- common/autotest_common.sh@940 -- # kill -0 1191949 00:17:49.882 16:53:35 -- common/autotest_common.sh@941 -- # uname 00:17:49.882 16:53:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:49.882 16:53:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1191949 00:17:49.882 16:53:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:49.882 16:53:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:49.882 16:53:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1191949' 00:17:49.882 killing process with pid 1191949 00:17:49.882 16:53:35 -- common/autotest_common.sh@955 -- # kill 1191949 00:17:49.882 Received shutdown signal, test time was about 10.000000 seconds 00:17:49.882 00:17:49.882 Latency(us) 00:17:49.882 [2024-11-16T15:53:35.632Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.882 [2024-11-16T15:53:35.632Z] =================================================================================================================== 00:17:49.882 [2024-11-16T15:53:35.632Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:49.882 16:53:35 -- common/autotest_common.sh@960 -- # wait 1191949 00:17:50.140 16:53:35 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:50.398 16:53:35 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 40239520-fafa-40ec-8795-4b81c03e1ea0 00:17:50.398 16:53:35 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:50.657 16:53:36 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:50.657 16:53:36 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:50.657 16:53:36 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:50.917 [2024-11-16 16:53:36.434472] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:50.917 16:53:36 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 40239520-fafa-40ec-8795-4b81c03e1ea0 00:17:50.917 16:53:36 -- common/autotest_common.sh@650 -- # local es=0 00:17:50.917 16:53:36 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 40239520-fafa-40ec-8795-4b81c03e1ea0 00:17:50.917 16:53:36 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:50.917 16:53:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:50.917 16:53:36 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:50.917 16:53:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:50.917 16:53:36 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:50.917 16:53:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:50.917 16:53:36 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:50.917 16:53:36 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:50.917 16:53:36 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 40239520-fafa-40ec-8795-4b81c03e1ea0 00:17:51.175 request: 00:17:51.175 { 00:17:51.175 "uuid": "40239520-fafa-40ec-8795-4b81c03e1ea0", 00:17:51.175 "method": "bdev_lvol_get_lvstores", 00:17:51.175 "req_id": 1 00:17:51.175 } 00:17:51.175 Got JSON-RPC error response 00:17:51.175 response: 00:17:51.175 { 00:17:51.175 "code": -19, 00:17:51.175 "message": "No such device" 00:17:51.175 } 00:17:51.175 16:53:36 -- common/autotest_common.sh@653 -- # es=1 00:17:51.175 16:53:36 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:51.175 16:53:36 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:51.175 16:53:36 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:51.175 16:53:36 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:51.432 aio_bdev 00:17:51.432 16:53:36 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 02e8027f-15d2-4d18-9785-898e7894acba 00:17:51.432 16:53:36 -- common/autotest_common.sh@897 -- # local bdev_name=02e8027f-15d2-4d18-9785-898e7894acba 00:17:51.432 16:53:36 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:51.432 16:53:36 -- common/autotest_common.sh@899 -- # local i 00:17:51.432 16:53:36 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:51.432 16:53:36 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:51.432 16:53:36 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:51.693 16:53:37 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 02e8027f-15d2-4d18-9785-898e7894acba -t 2000 00:17:51.951 [ 00:17:51.951 { 00:17:51.951 "name": "02e8027f-15d2-4d18-9785-898e7894acba", 00:17:51.951 "aliases": [ 00:17:51.951 "lvs/lvol" 00:17:51.951 ], 00:17:51.951 "product_name": "Logical Volume", 00:17:51.951 "block_size": 4096, 00:17:51.951 "num_blocks": 38912, 00:17:51.951 "uuid": "02e8027f-15d2-4d18-9785-898e7894acba", 00:17:51.951 "assigned_rate_limits": { 00:17:51.951 "rw_ios_per_sec": 0, 00:17:51.951 "rw_mbytes_per_sec": 0, 00:17:51.951 "r_mbytes_per_sec": 0, 00:17:51.951 "w_mbytes_per_sec": 0 00:17:51.951 }, 00:17:51.951 "claimed": false, 00:17:51.951 "zoned": false, 00:17:51.951 "supported_io_types": { 00:17:51.951 "read": true, 00:17:51.951 "write": true, 00:17:51.951 "unmap": true, 00:17:51.951 "write_zeroes": true, 00:17:51.951 "flush": false, 00:17:51.951 "reset": true, 00:17:51.951 "compare": false, 00:17:51.951 "compare_and_write": false, 00:17:51.951 "abort": false, 00:17:51.951 "nvme_admin": false, 00:17:51.951 "nvme_io": false 00:17:51.951 }, 00:17:51.951 "driver_specific": { 00:17:51.951 "lvol": { 00:17:51.951 "lvol_store_uuid": "40239520-fafa-40ec-8795-4b81c03e1ea0", 00:17:51.951 "base_bdev": "aio_bdev", 00:17:51.951 "thin_provision": false, 00:17:51.951 "snapshot": false, 00:17:51.951 "clone": false, 00:17:51.951 "esnap_clone": false 00:17:51.951 } 00:17:51.951 } 00:17:51.951 } 00:17:51.951 ] 00:17:51.951 16:53:37 -- common/autotest_common.sh@905 -- # return 0 00:17:51.952 16:53:37 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 40239520-fafa-40ec-8795-4b81c03e1ea0 00:17:51.952 16:53:37 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:52.211 16:53:37 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:52.211 16:53:37 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 40239520-fafa-40ec-8795-4b81c03e1ea0 00:17:52.211 16:53:37 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:52.471 16:53:37 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:52.471 16:53:37 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 02e8027f-15d2-4d18-9785-898e7894acba 00:17:52.731 16:53:38 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 40239520-fafa-40ec-8795-4b81c03e1ea0 00:17:52.990 16:53:38 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:53.248 16:53:38 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:53.248 00:17:53.248 real 0m17.901s 00:17:53.248 user 0m16.685s 00:17:53.248 sys 0m2.366s 00:17:53.248 16:53:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:53.248 16:53:38 -- common/autotest_common.sh@10 -- # set +x 00:17:53.248 ************************************ 00:17:53.248 END TEST lvs_grow_clean 00:17:53.248 ************************************ 00:17:53.248 16:53:38 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:53.248 16:53:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:53.248 16:53:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:53.248 16:53:38 -- common/autotest_common.sh@10 -- # set +x 00:17:53.248 ************************************ 00:17:53.248 START TEST lvs_grow_dirty 00:17:53.248 ************************************ 00:17:53.248 16:53:38 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:17:53.248 16:53:38 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:53.248 16:53:38 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:53.248 16:53:38 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:53.248 16:53:38 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:53.248 16:53:38 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:53.248 16:53:38 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:53.248 16:53:38 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:53.248 16:53:38 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:53.248 16:53:38 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:53.508 16:53:39 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:53.508 16:53:39 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:53.765 16:53:39 -- target/nvmf_lvs_grow.sh@28 -- # lvs=8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 00:17:53.765 16:53:39 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 00:17:53.765 16:53:39 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:54.025 16:53:39 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:54.025 16:53:39 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:54.025 16:53:39 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 lvol 150 00:17:54.284 16:53:39 -- target/nvmf_lvs_grow.sh@33 -- # lvol=fbac6232-cbd0-4812-b1f6-26fb4fb64666 00:17:54.284 16:53:39 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:54.284 16:53:39 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:54.543 [2024-11-16 16:53:40.173013] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:54.543 [2024-11-16 16:53:40.173120] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:54.543 true 00:17:54.543 16:53:40 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 00:17:54.543 16:53:40 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:54.803 16:53:40 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:54.803 16:53:40 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:55.063 16:53:40 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 fbac6232-cbd0-4812-b1f6-26fb4fb64666 00:17:55.322 16:53:41 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:55.580 16:53:41 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:55.838 16:53:41 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1194189 00:17:55.838 16:53:41 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:55.838 16:53:41 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:55.838 16:53:41 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1194189 /var/tmp/bdevperf.sock 00:17:55.838 16:53:41 -- common/autotest_common.sh@829 -- # '[' -z 1194189 ']' 00:17:55.838 16:53:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:55.838 16:53:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:55.838 16:53:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:55.838 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:55.838 16:53:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:55.838 16:53:41 -- common/autotest_common.sh@10 -- # set +x 00:17:55.838 [2024-11-16 16:53:41.578883] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:55.838 [2024-11-16 16:53:41.578978] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1194189 ] 00:17:56.097 EAL: No free 2048 kB hugepages reported on node 1 00:17:56.097 [2024-11-16 16:53:41.637691] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:56.097 [2024-11-16 16:53:41.723779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:57.033 16:53:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:57.033 16:53:42 -- common/autotest_common.sh@862 -- # return 0 00:17:57.033 16:53:42 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:57.291 Nvme0n1 00:17:57.291 16:53:42 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:57.550 [ 00:17:57.550 { 00:17:57.550 "name": "Nvme0n1", 00:17:57.550 "aliases": [ 00:17:57.550 "fbac6232-cbd0-4812-b1f6-26fb4fb64666" 00:17:57.550 ], 00:17:57.550 "product_name": "NVMe disk", 00:17:57.550 "block_size": 4096, 00:17:57.550 "num_blocks": 38912, 00:17:57.550 "uuid": "fbac6232-cbd0-4812-b1f6-26fb4fb64666", 00:17:57.550 "assigned_rate_limits": { 00:17:57.550 "rw_ios_per_sec": 0, 00:17:57.550 "rw_mbytes_per_sec": 0, 00:17:57.550 "r_mbytes_per_sec": 0, 00:17:57.550 "w_mbytes_per_sec": 0 00:17:57.550 }, 00:17:57.550 "claimed": false, 00:17:57.550 "zoned": false, 00:17:57.550 "supported_io_types": { 00:17:57.550 "read": true, 00:17:57.550 "write": true, 00:17:57.550 "unmap": true, 00:17:57.550 "write_zeroes": true, 00:17:57.550 "flush": true, 00:17:57.550 "reset": true, 00:17:57.550 "compare": true, 00:17:57.550 "compare_and_write": true, 00:17:57.550 "abort": true, 00:17:57.550 "nvme_admin": true, 00:17:57.550 "nvme_io": true 00:17:57.550 }, 00:17:57.550 "driver_specific": { 00:17:57.550 "nvme": [ 00:17:57.550 { 00:17:57.550 "trid": { 00:17:57.550 "trtype": "TCP", 00:17:57.550 "adrfam": "IPv4", 00:17:57.550 "traddr": "10.0.0.2", 00:17:57.550 "trsvcid": "4420", 00:17:57.550 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:57.550 }, 00:17:57.550 "ctrlr_data": { 00:17:57.550 "cntlid": 1, 00:17:57.550 "vendor_id": "0x8086", 00:17:57.550 "model_number": "SPDK bdev Controller", 00:17:57.550 "serial_number": "SPDK0", 00:17:57.550 "firmware_revision": "24.01.1", 00:17:57.550 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:57.550 "oacs": { 00:17:57.550 "security": 0, 00:17:57.550 "format": 0, 00:17:57.550 "firmware": 0, 00:17:57.550 "ns_manage": 0 00:17:57.550 }, 00:17:57.550 "multi_ctrlr": true, 00:17:57.550 "ana_reporting": false 00:17:57.550 }, 00:17:57.550 "vs": { 00:17:57.550 "nvme_version": "1.3" 00:17:57.550 }, 00:17:57.550 "ns_data": { 00:17:57.550 "id": 1, 00:17:57.550 "can_share": true 00:17:57.550 } 00:17:57.550 } 00:17:57.550 ], 00:17:57.550 "mp_policy": "active_passive" 00:17:57.550 } 00:17:57.550 } 00:17:57.550 ] 00:17:57.550 16:53:43 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1194344 00:17:57.550 16:53:43 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:57.550 16:53:43 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:57.809 Running I/O for 10 seconds... 00:17:58.748 Latency(us) 00:17:58.748 [2024-11-16T15:53:44.498Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.748 [2024-11-16T15:53:44.498Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:58.748 Nvme0n1 : 1.00 14482.00 56.57 0.00 0.00 0.00 0.00 0.00 00:17:58.748 [2024-11-16T15:53:44.498Z] =================================================================================================================== 00:17:58.748 [2024-11-16T15:53:44.498Z] Total : 14482.00 56.57 0.00 0.00 0.00 0.00 0.00 00:17:58.748 00:17:59.685 16:53:45 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 00:17:59.685 [2024-11-16T15:53:45.435Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:59.685 Nvme0n1 : 2.00 14675.00 57.32 0.00 0.00 0.00 0.00 0.00 00:17:59.685 [2024-11-16T15:53:45.435Z] =================================================================================================================== 00:17:59.685 [2024-11-16T15:53:45.435Z] Total : 14675.00 57.32 0.00 0.00 0.00 0.00 0.00 00:17:59.685 00:17:59.942 true 00:17:59.942 16:53:45 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 00:17:59.942 16:53:45 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:18:00.200 16:53:45 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:18:00.200 16:53:45 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:18:00.200 16:53:45 -- target/nvmf_lvs_grow.sh@65 -- # wait 1194344 00:18:00.768 [2024-11-16T15:53:46.518Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:00.768 Nvme0n1 : 3.00 14757.67 57.65 0.00 0.00 0.00 0.00 0.00 00:18:00.768 [2024-11-16T15:53:46.518Z] =================================================================================================================== 00:18:00.768 [2024-11-16T15:53:46.518Z] Total : 14757.67 57.65 0.00 0.00 0.00 0.00 0.00 00:18:00.768 00:18:01.706 [2024-11-16T15:53:47.456Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:01.706 Nvme0n1 : 4.00 14830.75 57.93 0.00 0.00 0.00 0.00 0.00 00:18:01.706 [2024-11-16T15:53:47.456Z] =================================================================================================================== 00:18:01.706 [2024-11-16T15:53:47.456Z] Total : 14830.75 57.93 0.00 0.00 0.00 0.00 0.00 00:18:01.706 00:18:02.643 [2024-11-16T15:53:48.393Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:02.643 Nvme0n1 : 5.00 14912.60 58.25 0.00 0.00 0.00 0.00 0.00 00:18:02.643 [2024-11-16T15:53:48.393Z] =================================================================================================================== 00:18:02.643 [2024-11-16T15:53:48.393Z] Total : 14912.60 58.25 0.00 0.00 0.00 0.00 0.00 00:18:02.644 00:18:04.023 [2024-11-16T15:53:49.773Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:04.023 Nvme0n1 : 6.00 14967.17 58.47 0.00 0.00 0.00 0.00 0.00 00:18:04.023 [2024-11-16T15:53:49.773Z] =================================================================================================================== 00:18:04.023 [2024-11-16T15:53:49.773Z] Total : 14967.17 58.47 0.00 0.00 0.00 0.00 0.00 00:18:04.023 00:18:04.962 [2024-11-16T15:53:50.712Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:04.962 Nvme0n1 : 7.00 14997.86 58.59 0.00 0.00 0.00 0.00 0.00 00:18:04.962 [2024-11-16T15:53:50.712Z] =================================================================================================================== 00:18:04.962 [2024-11-16T15:53:50.712Z] Total : 14997.86 58.59 0.00 0.00 0.00 0.00 0.00 00:18:04.962 00:18:05.900 [2024-11-16T15:53:51.650Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:05.900 Nvme0n1 : 8.00 15037.00 58.74 0.00 0.00 0.00 0.00 0.00 00:18:05.900 [2024-11-16T15:53:51.650Z] =================================================================================================================== 00:18:05.900 [2024-11-16T15:53:51.650Z] Total : 15037.00 58.74 0.00 0.00 0.00 0.00 0.00 00:18:05.900 00:18:06.839 [2024-11-16T15:53:52.589Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:06.839 Nvme0n1 : 9.00 15066.78 58.85 0.00 0.00 0.00 0.00 0.00 00:18:06.839 [2024-11-16T15:53:52.589Z] =================================================================================================================== 00:18:06.839 [2024-11-16T15:53:52.589Z] Total : 15066.78 58.85 0.00 0.00 0.00 0.00 0.00 00:18:06.839 00:18:07.778 [2024-11-16T15:53:53.528Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:07.778 Nvme0n1 : 10.00 15097.70 58.98 0.00 0.00 0.00 0.00 0.00 00:18:07.778 [2024-11-16T15:53:53.528Z] =================================================================================================================== 00:18:07.778 [2024-11-16T15:53:53.528Z] Total : 15097.70 58.98 0.00 0.00 0.00 0.00 0.00 00:18:07.778 00:18:07.778 00:18:07.778 Latency(us) 00:18:07.778 [2024-11-16T15:53:53.528Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:07.778 [2024-11-16T15:53:53.528Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:07.778 Nvme0n1 : 10.01 15099.32 58.98 0.00 0.00 8472.64 2233.08 16699.54 00:18:07.778 [2024-11-16T15:53:53.528Z] =================================================================================================================== 00:18:07.778 [2024-11-16T15:53:53.528Z] Total : 15099.32 58.98 0.00 0.00 8472.64 2233.08 16699.54 00:18:07.778 0 00:18:07.778 16:53:53 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1194189 00:18:07.778 16:53:53 -- common/autotest_common.sh@936 -- # '[' -z 1194189 ']' 00:18:07.778 16:53:53 -- common/autotest_common.sh@940 -- # kill -0 1194189 00:18:07.778 16:53:53 -- common/autotest_common.sh@941 -- # uname 00:18:07.778 16:53:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:07.778 16:53:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1194189 00:18:07.778 16:53:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:07.778 16:53:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:07.778 16:53:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1194189' 00:18:07.778 killing process with pid 1194189 00:18:07.778 16:53:53 -- common/autotest_common.sh@955 -- # kill 1194189 00:18:07.778 Received shutdown signal, test time was about 10.000000 seconds 00:18:07.778 00:18:07.778 Latency(us) 00:18:07.778 [2024-11-16T15:53:53.528Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:07.778 [2024-11-16T15:53:53.528Z] =================================================================================================================== 00:18:07.778 [2024-11-16T15:53:53.528Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:07.778 16:53:53 -- common/autotest_common.sh@960 -- # wait 1194189 00:18:08.036 16:53:53 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:08.296 16:53:53 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 00:18:08.296 16:53:53 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:08.556 16:53:54 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:08.556 16:53:54 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:08.556 16:53:54 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 1191380 00:18:08.556 16:53:54 -- target/nvmf_lvs_grow.sh@74 -- # wait 1191380 00:18:08.556 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 1191380 Killed "${NVMF_APP[@]}" "$@" 00:18:08.556 16:53:54 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:08.556 16:53:54 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:08.556 16:53:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:08.556 16:53:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:08.556 16:53:54 -- common/autotest_common.sh@10 -- # set +x 00:18:08.556 16:53:54 -- nvmf/common.sh@469 -- # nvmfpid=1195703 00:18:08.556 16:53:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:08.556 16:53:54 -- nvmf/common.sh@470 -- # waitforlisten 1195703 00:18:08.556 16:53:54 -- common/autotest_common.sh@829 -- # '[' -z 1195703 ']' 00:18:08.556 16:53:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:08.556 16:53:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:08.556 16:53:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:08.556 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:08.556 16:53:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:08.556 16:53:54 -- common/autotest_common.sh@10 -- # set +x 00:18:08.556 [2024-11-16 16:53:54.260080] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:08.556 [2024-11-16 16:53:54.260167] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:08.556 EAL: No free 2048 kB hugepages reported on node 1 00:18:08.814 [2024-11-16 16:53:54.326435] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:08.814 [2024-11-16 16:53:54.413592] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:08.814 [2024-11-16 16:53:54.413823] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:08.814 [2024-11-16 16:53:54.413853] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:08.814 [2024-11-16 16:53:54.413866] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:08.814 [2024-11-16 16:53:54.413894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:09.751 16:53:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:09.751 16:53:55 -- common/autotest_common.sh@862 -- # return 0 00:18:09.751 16:53:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:09.751 16:53:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:09.751 16:53:55 -- common/autotest_common.sh@10 -- # set +x 00:18:09.751 16:53:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:09.751 16:53:55 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:09.751 [2024-11-16 16:53:55.473908] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:09.751 [2024-11-16 16:53:55.474081] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:09.751 [2024-11-16 16:53:55.474140] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:09.751 16:53:55 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:09.751 16:53:55 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev fbac6232-cbd0-4812-b1f6-26fb4fb64666 00:18:09.751 16:53:55 -- common/autotest_common.sh@897 -- # local bdev_name=fbac6232-cbd0-4812-b1f6-26fb4fb64666 00:18:09.751 16:53:55 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:09.751 16:53:55 -- common/autotest_common.sh@899 -- # local i 00:18:09.751 16:53:55 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:09.751 16:53:55 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:09.751 16:53:55 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:10.009 16:53:55 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b fbac6232-cbd0-4812-b1f6-26fb4fb64666 -t 2000 00:18:10.578 [ 00:18:10.578 { 00:18:10.578 "name": "fbac6232-cbd0-4812-b1f6-26fb4fb64666", 00:18:10.578 "aliases": [ 00:18:10.578 "lvs/lvol" 00:18:10.578 ], 00:18:10.578 "product_name": "Logical Volume", 00:18:10.578 "block_size": 4096, 00:18:10.578 "num_blocks": 38912, 00:18:10.578 "uuid": "fbac6232-cbd0-4812-b1f6-26fb4fb64666", 00:18:10.578 "assigned_rate_limits": { 00:18:10.578 "rw_ios_per_sec": 0, 00:18:10.578 "rw_mbytes_per_sec": 0, 00:18:10.578 "r_mbytes_per_sec": 0, 00:18:10.578 "w_mbytes_per_sec": 0 00:18:10.578 }, 00:18:10.578 "claimed": false, 00:18:10.578 "zoned": false, 00:18:10.578 "supported_io_types": { 00:18:10.578 "read": true, 00:18:10.578 "write": true, 00:18:10.578 "unmap": true, 00:18:10.578 "write_zeroes": true, 00:18:10.578 "flush": false, 00:18:10.578 "reset": true, 00:18:10.578 "compare": false, 00:18:10.578 "compare_and_write": false, 00:18:10.578 "abort": false, 00:18:10.578 "nvme_admin": false, 00:18:10.579 "nvme_io": false 00:18:10.579 }, 00:18:10.579 "driver_specific": { 00:18:10.579 "lvol": { 00:18:10.579 "lvol_store_uuid": "8ab8087b-68e4-4aa3-a69e-2ff969ed5a58", 00:18:10.579 "base_bdev": "aio_bdev", 00:18:10.579 "thin_provision": false, 00:18:10.579 "snapshot": false, 00:18:10.579 "clone": false, 00:18:10.579 "esnap_clone": false 00:18:10.579 } 00:18:10.579 } 00:18:10.579 } 00:18:10.579 ] 00:18:10.579 16:53:56 -- common/autotest_common.sh@905 -- # return 0 00:18:10.579 16:53:56 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 00:18:10.579 16:53:56 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:10.579 16:53:56 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:10.579 16:53:56 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 00:18:10.837 16:53:56 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:11.095 16:53:56 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:11.095 16:53:56 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:11.355 [2024-11-16 16:53:56.863297] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:11.355 16:53:56 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 00:18:11.355 16:53:56 -- common/autotest_common.sh@650 -- # local es=0 00:18:11.355 16:53:56 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 00:18:11.355 16:53:56 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:11.355 16:53:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:11.355 16:53:56 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:11.355 16:53:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:11.355 16:53:56 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:11.355 16:53:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:11.355 16:53:56 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:11.355 16:53:56 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:11.355 16:53:56 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 00:18:11.615 request: 00:18:11.615 { 00:18:11.615 "uuid": "8ab8087b-68e4-4aa3-a69e-2ff969ed5a58", 00:18:11.615 "method": "bdev_lvol_get_lvstores", 00:18:11.615 "req_id": 1 00:18:11.615 } 00:18:11.615 Got JSON-RPC error response 00:18:11.615 response: 00:18:11.615 { 00:18:11.615 "code": -19, 00:18:11.615 "message": "No such device" 00:18:11.615 } 00:18:11.615 16:53:57 -- common/autotest_common.sh@653 -- # es=1 00:18:11.615 16:53:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:11.615 16:53:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:11.615 16:53:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:11.615 16:53:57 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:11.875 aio_bdev 00:18:11.875 16:53:57 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev fbac6232-cbd0-4812-b1f6-26fb4fb64666 00:18:11.875 16:53:57 -- common/autotest_common.sh@897 -- # local bdev_name=fbac6232-cbd0-4812-b1f6-26fb4fb64666 00:18:11.875 16:53:57 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:11.875 16:53:57 -- common/autotest_common.sh@899 -- # local i 00:18:11.875 16:53:57 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:11.875 16:53:57 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:11.875 16:53:57 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:12.134 16:53:57 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b fbac6232-cbd0-4812-b1f6-26fb4fb64666 -t 2000 00:18:12.134 [ 00:18:12.134 { 00:18:12.134 "name": "fbac6232-cbd0-4812-b1f6-26fb4fb64666", 00:18:12.134 "aliases": [ 00:18:12.134 "lvs/lvol" 00:18:12.134 ], 00:18:12.134 "product_name": "Logical Volume", 00:18:12.134 "block_size": 4096, 00:18:12.134 "num_blocks": 38912, 00:18:12.134 "uuid": "fbac6232-cbd0-4812-b1f6-26fb4fb64666", 00:18:12.134 "assigned_rate_limits": { 00:18:12.134 "rw_ios_per_sec": 0, 00:18:12.134 "rw_mbytes_per_sec": 0, 00:18:12.134 "r_mbytes_per_sec": 0, 00:18:12.134 "w_mbytes_per_sec": 0 00:18:12.134 }, 00:18:12.134 "claimed": false, 00:18:12.134 "zoned": false, 00:18:12.134 "supported_io_types": { 00:18:12.134 "read": true, 00:18:12.134 "write": true, 00:18:12.134 "unmap": true, 00:18:12.134 "write_zeroes": true, 00:18:12.134 "flush": false, 00:18:12.134 "reset": true, 00:18:12.134 "compare": false, 00:18:12.134 "compare_and_write": false, 00:18:12.134 "abort": false, 00:18:12.134 "nvme_admin": false, 00:18:12.134 "nvme_io": false 00:18:12.134 }, 00:18:12.134 "driver_specific": { 00:18:12.134 "lvol": { 00:18:12.134 "lvol_store_uuid": "8ab8087b-68e4-4aa3-a69e-2ff969ed5a58", 00:18:12.134 "base_bdev": "aio_bdev", 00:18:12.134 "thin_provision": false, 00:18:12.134 "snapshot": false, 00:18:12.134 "clone": false, 00:18:12.134 "esnap_clone": false 00:18:12.134 } 00:18:12.134 } 00:18:12.134 } 00:18:12.134 ] 00:18:12.134 16:53:57 -- common/autotest_common.sh@905 -- # return 0 00:18:12.134 16:53:57 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 00:18:12.134 16:53:57 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:12.702 16:53:58 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:12.702 16:53:58 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 00:18:12.702 16:53:58 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:12.962 16:53:58 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:12.962 16:53:58 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete fbac6232-cbd0-4812-b1f6-26fb4fb64666 00:18:13.222 16:53:58 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 8ab8087b-68e4-4aa3-a69e-2ff969ed5a58 00:18:13.525 16:53:58 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:13.525 16:53:59 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:13.851 00:18:13.851 real 0m20.431s 00:18:13.851 user 0m51.149s 00:18:13.851 sys 0m4.654s 00:18:13.851 16:53:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:13.851 16:53:59 -- common/autotest_common.sh@10 -- # set +x 00:18:13.851 ************************************ 00:18:13.851 END TEST lvs_grow_dirty 00:18:13.851 ************************************ 00:18:13.851 16:53:59 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:13.851 16:53:59 -- common/autotest_common.sh@806 -- # type=--id 00:18:13.851 16:53:59 -- common/autotest_common.sh@807 -- # id=0 00:18:13.851 16:53:59 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:13.851 16:53:59 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:13.851 16:53:59 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:13.851 16:53:59 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:13.851 16:53:59 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:13.851 16:53:59 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:13.851 nvmf_trace.0 00:18:13.851 16:53:59 -- common/autotest_common.sh@821 -- # return 0 00:18:13.851 16:53:59 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:13.851 16:53:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:13.851 16:53:59 -- nvmf/common.sh@116 -- # sync 00:18:13.851 16:53:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:13.851 16:53:59 -- nvmf/common.sh@119 -- # set +e 00:18:13.851 16:53:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:13.851 16:53:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:13.851 rmmod nvme_tcp 00:18:13.851 rmmod nvme_fabrics 00:18:13.851 rmmod nvme_keyring 00:18:13.851 16:53:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:13.851 16:53:59 -- nvmf/common.sh@123 -- # set -e 00:18:13.851 16:53:59 -- nvmf/common.sh@124 -- # return 0 00:18:13.851 16:53:59 -- nvmf/common.sh@477 -- # '[' -n 1195703 ']' 00:18:13.851 16:53:59 -- nvmf/common.sh@478 -- # killprocess 1195703 00:18:13.851 16:53:59 -- common/autotest_common.sh@936 -- # '[' -z 1195703 ']' 00:18:13.851 16:53:59 -- common/autotest_common.sh@940 -- # kill -0 1195703 00:18:13.851 16:53:59 -- common/autotest_common.sh@941 -- # uname 00:18:13.851 16:53:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:13.851 16:53:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1195703 00:18:13.851 16:53:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:13.851 16:53:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:13.851 16:53:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1195703' 00:18:13.851 killing process with pid 1195703 00:18:13.851 16:53:59 -- common/autotest_common.sh@955 -- # kill 1195703 00:18:13.851 16:53:59 -- common/autotest_common.sh@960 -- # wait 1195703 00:18:14.110 16:53:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:14.110 16:53:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:14.110 16:53:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:14.110 16:53:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:14.110 16:53:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:14.110 16:53:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:14.110 16:53:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:14.110 16:53:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:16.014 16:54:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:16.014 00:18:16.014 real 0m44.321s 00:18:16.014 user 1m14.504s 00:18:16.014 sys 0m8.943s 00:18:16.014 16:54:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:16.014 16:54:01 -- common/autotest_common.sh@10 -- # set +x 00:18:16.014 ************************************ 00:18:16.014 END TEST nvmf_lvs_grow 00:18:16.014 ************************************ 00:18:16.014 16:54:01 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:16.014 16:54:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:16.014 16:54:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:16.014 16:54:01 -- common/autotest_common.sh@10 -- # set +x 00:18:16.014 ************************************ 00:18:16.014 START TEST nvmf_bdev_io_wait 00:18:16.014 ************************************ 00:18:16.014 16:54:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:16.014 * Looking for test storage... 00:18:16.014 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:16.014 16:54:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:16.014 16:54:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:16.014 16:54:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:16.272 16:54:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:16.272 16:54:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:16.272 16:54:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:16.273 16:54:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:16.273 16:54:01 -- scripts/common.sh@335 -- # IFS=.-: 00:18:16.273 16:54:01 -- scripts/common.sh@335 -- # read -ra ver1 00:18:16.273 16:54:01 -- scripts/common.sh@336 -- # IFS=.-: 00:18:16.273 16:54:01 -- scripts/common.sh@336 -- # read -ra ver2 00:18:16.273 16:54:01 -- scripts/common.sh@337 -- # local 'op=<' 00:18:16.273 16:54:01 -- scripts/common.sh@339 -- # ver1_l=2 00:18:16.273 16:54:01 -- scripts/common.sh@340 -- # ver2_l=1 00:18:16.273 16:54:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:16.273 16:54:01 -- scripts/common.sh@343 -- # case "$op" in 00:18:16.273 16:54:01 -- scripts/common.sh@344 -- # : 1 00:18:16.273 16:54:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:16.273 16:54:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:16.273 16:54:01 -- scripts/common.sh@364 -- # decimal 1 00:18:16.273 16:54:01 -- scripts/common.sh@352 -- # local d=1 00:18:16.273 16:54:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:16.273 16:54:01 -- scripts/common.sh@354 -- # echo 1 00:18:16.273 16:54:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:16.273 16:54:01 -- scripts/common.sh@365 -- # decimal 2 00:18:16.273 16:54:01 -- scripts/common.sh@352 -- # local d=2 00:18:16.273 16:54:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:16.273 16:54:01 -- scripts/common.sh@354 -- # echo 2 00:18:16.273 16:54:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:16.273 16:54:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:16.273 16:54:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:16.273 16:54:01 -- scripts/common.sh@367 -- # return 0 00:18:16.273 16:54:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:16.273 16:54:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:16.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:16.273 --rc genhtml_branch_coverage=1 00:18:16.273 --rc genhtml_function_coverage=1 00:18:16.273 --rc genhtml_legend=1 00:18:16.273 --rc geninfo_all_blocks=1 00:18:16.273 --rc geninfo_unexecuted_blocks=1 00:18:16.273 00:18:16.273 ' 00:18:16.273 16:54:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:16.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:16.273 --rc genhtml_branch_coverage=1 00:18:16.273 --rc genhtml_function_coverage=1 00:18:16.273 --rc genhtml_legend=1 00:18:16.273 --rc geninfo_all_blocks=1 00:18:16.273 --rc geninfo_unexecuted_blocks=1 00:18:16.273 00:18:16.273 ' 00:18:16.273 16:54:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:16.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:16.273 --rc genhtml_branch_coverage=1 00:18:16.273 --rc genhtml_function_coverage=1 00:18:16.273 --rc genhtml_legend=1 00:18:16.273 --rc geninfo_all_blocks=1 00:18:16.273 --rc geninfo_unexecuted_blocks=1 00:18:16.273 00:18:16.273 ' 00:18:16.273 16:54:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:16.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:16.273 --rc genhtml_branch_coverage=1 00:18:16.273 --rc genhtml_function_coverage=1 00:18:16.273 --rc genhtml_legend=1 00:18:16.273 --rc geninfo_all_blocks=1 00:18:16.273 --rc geninfo_unexecuted_blocks=1 00:18:16.273 00:18:16.273 ' 00:18:16.273 16:54:01 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:16.273 16:54:01 -- nvmf/common.sh@7 -- # uname -s 00:18:16.273 16:54:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:16.273 16:54:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:16.273 16:54:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:16.273 16:54:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:16.273 16:54:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:16.273 16:54:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:16.273 16:54:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:16.273 16:54:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:16.273 16:54:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:16.273 16:54:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:16.273 16:54:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:16.273 16:54:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:16.273 16:54:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:16.273 16:54:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:16.273 16:54:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:16.273 16:54:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:16.273 16:54:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:16.273 16:54:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:16.273 16:54:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:16.273 16:54:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.273 16:54:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.273 16:54:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.273 16:54:01 -- paths/export.sh@5 -- # export PATH 00:18:16.273 16:54:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.273 16:54:01 -- nvmf/common.sh@46 -- # : 0 00:18:16.273 16:54:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:16.273 16:54:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:16.273 16:54:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:16.273 16:54:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:16.273 16:54:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:16.273 16:54:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:16.273 16:54:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:16.273 16:54:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:16.273 16:54:01 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:16.273 16:54:01 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:16.273 16:54:01 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:16.273 16:54:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:16.273 16:54:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:16.273 16:54:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:16.273 16:54:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:16.273 16:54:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:16.273 16:54:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:16.273 16:54:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:16.273 16:54:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:16.273 16:54:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:16.273 16:54:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:16.273 16:54:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:16.273 16:54:01 -- common/autotest_common.sh@10 -- # set +x 00:18:18.176 16:54:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:18.176 16:54:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:18.176 16:54:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:18.176 16:54:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:18.176 16:54:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:18.176 16:54:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:18.176 16:54:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:18.176 16:54:03 -- nvmf/common.sh@294 -- # net_devs=() 00:18:18.176 16:54:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:18.176 16:54:03 -- nvmf/common.sh@295 -- # e810=() 00:18:18.176 16:54:03 -- nvmf/common.sh@295 -- # local -ga e810 00:18:18.176 16:54:03 -- nvmf/common.sh@296 -- # x722=() 00:18:18.176 16:54:03 -- nvmf/common.sh@296 -- # local -ga x722 00:18:18.176 16:54:03 -- nvmf/common.sh@297 -- # mlx=() 00:18:18.176 16:54:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:18.176 16:54:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:18.176 16:54:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:18.176 16:54:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:18.176 16:54:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:18.176 16:54:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:18.176 16:54:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:18.176 16:54:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:18.176 16:54:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:18.176 16:54:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:18.176 16:54:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:18.176 16:54:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:18.176 16:54:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:18.176 16:54:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:18.176 16:54:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:18.176 16:54:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:18.176 16:54:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:18.176 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:18.176 16:54:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:18.176 16:54:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:18.176 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:18.176 16:54:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:18.176 16:54:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:18.176 16:54:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:18.176 16:54:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:18.176 16:54:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:18.176 16:54:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:18.176 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:18.176 16:54:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:18.176 16:54:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:18.176 16:54:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:18.176 16:54:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:18.176 16:54:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:18.176 16:54:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:18.176 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:18.176 16:54:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:18.176 16:54:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:18.176 16:54:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:18.176 16:54:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:18.176 16:54:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:18.176 16:54:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:18.176 16:54:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:18.176 16:54:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:18.176 16:54:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:18.176 16:54:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:18.176 16:54:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:18.176 16:54:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:18.176 16:54:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:18.176 16:54:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:18.176 16:54:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:18.176 16:54:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:18.176 16:54:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:18.176 16:54:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:18.435 16:54:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:18.435 16:54:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:18.435 16:54:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:18.435 16:54:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:18.435 16:54:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:18.435 16:54:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:18.435 16:54:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:18.435 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:18.435 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.283 ms 00:18:18.435 00:18:18.435 --- 10.0.0.2 ping statistics --- 00:18:18.435 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:18.435 rtt min/avg/max/mdev = 0.283/0.283/0.283/0.000 ms 00:18:18.435 16:54:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:18.435 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:18.435 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:18:18.435 00:18:18.435 --- 10.0.0.1 ping statistics --- 00:18:18.435 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:18.435 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:18:18.435 16:54:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:18.435 16:54:03 -- nvmf/common.sh@410 -- # return 0 00:18:18.435 16:54:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:18.435 16:54:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:18.435 16:54:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:18.435 16:54:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:18.435 16:54:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:18.435 16:54:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:18.435 16:54:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:18.435 16:54:04 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:18.435 16:54:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:18.435 16:54:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:18.435 16:54:04 -- common/autotest_common.sh@10 -- # set +x 00:18:18.435 16:54:04 -- nvmf/common.sh@469 -- # nvmfpid=1198507 00:18:18.435 16:54:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:18.435 16:54:04 -- nvmf/common.sh@470 -- # waitforlisten 1198507 00:18:18.435 16:54:04 -- common/autotest_common.sh@829 -- # '[' -z 1198507 ']' 00:18:18.435 16:54:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:18.435 16:54:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:18.435 16:54:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:18.435 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:18.435 16:54:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:18.435 16:54:04 -- common/autotest_common.sh@10 -- # set +x 00:18:18.435 [2024-11-16 16:54:04.069314] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:18.436 [2024-11-16 16:54:04.069388] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:18.436 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.436 [2024-11-16 16:54:04.132534] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:18.694 [2024-11-16 16:54:04.219287] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:18.694 [2024-11-16 16:54:04.219441] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:18.694 [2024-11-16 16:54:04.219469] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:18.694 [2024-11-16 16:54:04.219481] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:18.694 [2024-11-16 16:54:04.219532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:18.694 [2024-11-16 16:54:04.219602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:18.694 [2024-11-16 16:54:04.219671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:18.694 [2024-11-16 16:54:04.219674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:18.694 16:54:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:18.694 16:54:04 -- common/autotest_common.sh@862 -- # return 0 00:18:18.694 16:54:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:18.694 16:54:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:18.694 16:54:04 -- common/autotest_common.sh@10 -- # set +x 00:18:18.694 16:54:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:18.694 16:54:04 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:18.694 16:54:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.694 16:54:04 -- common/autotest_common.sh@10 -- # set +x 00:18:18.694 16:54:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.694 16:54:04 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:18.694 16:54:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.694 16:54:04 -- common/autotest_common.sh@10 -- # set +x 00:18:18.694 16:54:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.694 16:54:04 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:18.694 16:54:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.694 16:54:04 -- common/autotest_common.sh@10 -- # set +x 00:18:18.694 [2024-11-16 16:54:04.385276] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:18.694 16:54:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.694 16:54:04 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:18.694 16:54:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.694 16:54:04 -- common/autotest_common.sh@10 -- # set +x 00:18:18.694 Malloc0 00:18:18.694 16:54:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.694 16:54:04 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:18.694 16:54:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.694 16:54:04 -- common/autotest_common.sh@10 -- # set +x 00:18:18.694 16:54:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.694 16:54:04 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:18.694 16:54:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.694 16:54:04 -- common/autotest_common.sh@10 -- # set +x 00:18:18.694 16:54:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.694 16:54:04 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:18.694 16:54:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.694 16:54:04 -- common/autotest_common.sh@10 -- # set +x 00:18:18.694 [2024-11-16 16:54:04.444005] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:18.953 16:54:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.953 16:54:04 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=1198535 00:18:18.953 16:54:04 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:18.953 16:54:04 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:18.953 16:54:04 -- target/bdev_io_wait.sh@30 -- # READ_PID=1198537 00:18:18.953 16:54:04 -- nvmf/common.sh@520 -- # config=() 00:18:18.953 16:54:04 -- nvmf/common.sh@520 -- # local subsystem config 00:18:18.953 16:54:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:18.953 16:54:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:18.953 { 00:18:18.953 "params": { 00:18:18.953 "name": "Nvme$subsystem", 00:18:18.953 "trtype": "$TEST_TRANSPORT", 00:18:18.953 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:18.953 "adrfam": "ipv4", 00:18:18.953 "trsvcid": "$NVMF_PORT", 00:18:18.953 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:18.953 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:18.953 "hdgst": ${hdgst:-false}, 00:18:18.953 "ddgst": ${ddgst:-false} 00:18:18.953 }, 00:18:18.953 "method": "bdev_nvme_attach_controller" 00:18:18.953 } 00:18:18.953 EOF 00:18:18.953 )") 00:18:18.953 16:54:04 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:18.953 16:54:04 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:18.953 16:54:04 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=1198539 00:18:18.953 16:54:04 -- nvmf/common.sh@520 -- # config=() 00:18:18.953 16:54:04 -- nvmf/common.sh@520 -- # local subsystem config 00:18:18.953 16:54:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:18.953 16:54:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:18.953 { 00:18:18.953 "params": { 00:18:18.953 "name": "Nvme$subsystem", 00:18:18.953 "trtype": "$TEST_TRANSPORT", 00:18:18.953 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:18.953 "adrfam": "ipv4", 00:18:18.953 "trsvcid": "$NVMF_PORT", 00:18:18.953 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:18.953 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:18.953 "hdgst": ${hdgst:-false}, 00:18:18.953 "ddgst": ${ddgst:-false} 00:18:18.953 }, 00:18:18.953 "method": "bdev_nvme_attach_controller" 00:18:18.953 } 00:18:18.953 EOF 00:18:18.953 )") 00:18:18.953 16:54:04 -- nvmf/common.sh@542 -- # cat 00:18:18.953 16:54:04 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:18.953 16:54:04 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:18.953 16:54:04 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=1198542 00:18:18.953 16:54:04 -- target/bdev_io_wait.sh@35 -- # sync 00:18:18.953 16:54:04 -- nvmf/common.sh@520 -- # config=() 00:18:18.953 16:54:04 -- nvmf/common.sh@520 -- # local subsystem config 00:18:18.953 16:54:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:18.953 16:54:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:18.953 { 00:18:18.953 "params": { 00:18:18.953 "name": "Nvme$subsystem", 00:18:18.953 "trtype": "$TEST_TRANSPORT", 00:18:18.953 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:18.953 "adrfam": "ipv4", 00:18:18.953 "trsvcid": "$NVMF_PORT", 00:18:18.953 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:18.953 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:18.953 "hdgst": ${hdgst:-false}, 00:18:18.953 "ddgst": ${ddgst:-false} 00:18:18.953 }, 00:18:18.953 "method": "bdev_nvme_attach_controller" 00:18:18.953 } 00:18:18.953 EOF 00:18:18.953 )") 00:18:18.953 16:54:04 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:18.953 16:54:04 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:18.953 16:54:04 -- nvmf/common.sh@542 -- # cat 00:18:18.953 16:54:04 -- nvmf/common.sh@520 -- # config=() 00:18:18.953 16:54:04 -- nvmf/common.sh@520 -- # local subsystem config 00:18:18.953 16:54:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:18.953 16:54:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:18.953 { 00:18:18.953 "params": { 00:18:18.953 "name": "Nvme$subsystem", 00:18:18.953 "trtype": "$TEST_TRANSPORT", 00:18:18.953 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:18.953 "adrfam": "ipv4", 00:18:18.953 "trsvcid": "$NVMF_PORT", 00:18:18.953 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:18.953 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:18.953 "hdgst": ${hdgst:-false}, 00:18:18.953 "ddgst": ${ddgst:-false} 00:18:18.953 }, 00:18:18.953 "method": "bdev_nvme_attach_controller" 00:18:18.953 } 00:18:18.953 EOF 00:18:18.953 )") 00:18:18.953 16:54:04 -- nvmf/common.sh@542 -- # cat 00:18:18.953 16:54:04 -- target/bdev_io_wait.sh@37 -- # wait 1198535 00:18:18.953 16:54:04 -- nvmf/common.sh@542 -- # cat 00:18:18.953 16:54:04 -- nvmf/common.sh@544 -- # jq . 00:18:18.953 16:54:04 -- nvmf/common.sh@544 -- # jq . 00:18:18.953 16:54:04 -- nvmf/common.sh@544 -- # jq . 00:18:18.953 16:54:04 -- nvmf/common.sh@545 -- # IFS=, 00:18:18.953 16:54:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:18.953 "params": { 00:18:18.953 "name": "Nvme1", 00:18:18.953 "trtype": "tcp", 00:18:18.953 "traddr": "10.0.0.2", 00:18:18.953 "adrfam": "ipv4", 00:18:18.953 "trsvcid": "4420", 00:18:18.953 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.953 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.953 "hdgst": false, 00:18:18.953 "ddgst": false 00:18:18.953 }, 00:18:18.953 "method": "bdev_nvme_attach_controller" 00:18:18.953 }' 00:18:18.953 16:54:04 -- nvmf/common.sh@545 -- # IFS=, 00:18:18.953 16:54:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:18.953 "params": { 00:18:18.953 "name": "Nvme1", 00:18:18.953 "trtype": "tcp", 00:18:18.953 "traddr": "10.0.0.2", 00:18:18.953 "adrfam": "ipv4", 00:18:18.953 "trsvcid": "4420", 00:18:18.953 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.954 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.954 "hdgst": false, 00:18:18.954 "ddgst": false 00:18:18.954 }, 00:18:18.954 "method": "bdev_nvme_attach_controller" 00:18:18.954 }' 00:18:18.954 16:54:04 -- nvmf/common.sh@544 -- # jq . 00:18:18.954 16:54:04 -- nvmf/common.sh@545 -- # IFS=, 00:18:18.954 16:54:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:18.954 "params": { 00:18:18.954 "name": "Nvme1", 00:18:18.954 "trtype": "tcp", 00:18:18.954 "traddr": "10.0.0.2", 00:18:18.954 "adrfam": "ipv4", 00:18:18.954 "trsvcid": "4420", 00:18:18.954 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.954 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.954 "hdgst": false, 00:18:18.954 "ddgst": false 00:18:18.954 }, 00:18:18.954 "method": "bdev_nvme_attach_controller" 00:18:18.954 }' 00:18:18.954 16:54:04 -- nvmf/common.sh@545 -- # IFS=, 00:18:18.954 16:54:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:18.954 "params": { 00:18:18.954 "name": "Nvme1", 00:18:18.954 "trtype": "tcp", 00:18:18.954 "traddr": "10.0.0.2", 00:18:18.954 "adrfam": "ipv4", 00:18:18.954 "trsvcid": "4420", 00:18:18.954 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.954 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.954 "hdgst": false, 00:18:18.954 "ddgst": false 00:18:18.954 }, 00:18:18.954 "method": "bdev_nvme_attach_controller" 00:18:18.954 }' 00:18:18.954 [2024-11-16 16:54:04.487385] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:18.954 [2024-11-16 16:54:04.487386] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:18.954 [2024-11-16 16:54:04.487470] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-16 16:54:04.487471] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:18.954 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:18.954 [2024-11-16 16:54:04.488897] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:18.954 [2024-11-16 16:54:04.488937] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:18.954 [2024-11-16 16:54:04.488970] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:18.954 [2024-11-16 16:54:04.488994] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:18.954 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.954 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.954 [2024-11-16 16:54:04.664236] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.212 EAL: No free 2048 kB hugepages reported on node 1 00:18:19.212 [2024-11-16 16:54:04.738938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:19.212 [2024-11-16 16:54:04.767605] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.212 EAL: No free 2048 kB hugepages reported on node 1 00:18:19.212 [2024-11-16 16:54:04.839822] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.212 [2024-11-16 16:54:04.842199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:19.212 [2024-11-16 16:54:04.903836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:19.212 [2024-11-16 16:54:04.912689] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.470 [2024-11-16 16:54:04.979120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:19.470 Running I/O for 1 seconds... 00:18:19.470 Running I/O for 1 seconds... 00:18:19.470 Running I/O for 1 seconds... 00:18:19.470 Running I/O for 1 seconds... 00:18:20.407 00:18:20.407 Latency(us) 00:18:20.407 [2024-11-16T15:54:06.157Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:20.407 [2024-11-16T15:54:06.157Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:20.407 Nvme1n1 : 1.00 179168.04 699.88 0.00 0.00 711.71 283.69 879.88 00:18:20.407 [2024-11-16T15:54:06.157Z] =================================================================================================================== 00:18:20.407 [2024-11-16T15:54:06.157Z] Total : 179168.04 699.88 0.00 0.00 711.71 283.69 879.88 00:18:20.668 00:18:20.668 Latency(us) 00:18:20.668 [2024-11-16T15:54:06.418Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:20.668 [2024-11-16T15:54:06.418Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:20.668 Nvme1n1 : 1.02 6567.72 25.66 0.00 0.00 19310.73 8107.05 25437.68 00:18:20.668 [2024-11-16T15:54:06.418Z] =================================================================================================================== 00:18:20.668 [2024-11-16T15:54:06.418Z] Total : 6567.72 25.66 0.00 0.00 19310.73 8107.05 25437.68 00:18:20.668 00:18:20.668 Latency(us) 00:18:20.668 [2024-11-16T15:54:06.418Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:20.668 [2024-11-16T15:54:06.418Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:20.668 Nvme1n1 : 1.01 9466.55 36.98 0.00 0.00 13459.49 7961.41 26214.40 00:18:20.668 [2024-11-16T15:54:06.418Z] =================================================================================================================== 00:18:20.668 [2024-11-16T15:54:06.418Z] Total : 9466.55 36.98 0.00 0.00 13459.49 7961.41 26214.40 00:18:20.668 00:18:20.668 Latency(us) 00:18:20.668 [2024-11-16T15:54:06.418Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:20.668 [2024-11-16T15:54:06.418Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:20.668 Nvme1n1 : 1.01 6386.63 24.95 0.00 0.00 19967.52 6941.96 41554.68 00:18:20.668 [2024-11-16T15:54:06.418Z] =================================================================================================================== 00:18:20.668 [2024-11-16T15:54:06.418Z] Total : 6386.63 24.95 0.00 0.00 19967.52 6941.96 41554.68 00:18:20.927 16:54:06 -- target/bdev_io_wait.sh@38 -- # wait 1198537 00:18:20.927 16:54:06 -- target/bdev_io_wait.sh@39 -- # wait 1198539 00:18:20.927 16:54:06 -- target/bdev_io_wait.sh@40 -- # wait 1198542 00:18:20.927 16:54:06 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:20.927 16:54:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:20.927 16:54:06 -- common/autotest_common.sh@10 -- # set +x 00:18:20.927 16:54:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:20.927 16:54:06 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:20.927 16:54:06 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:20.927 16:54:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:20.927 16:54:06 -- nvmf/common.sh@116 -- # sync 00:18:20.927 16:54:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:20.927 16:54:06 -- nvmf/common.sh@119 -- # set +e 00:18:20.927 16:54:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:20.927 16:54:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:20.927 rmmod nvme_tcp 00:18:20.927 rmmod nvme_fabrics 00:18:20.927 rmmod nvme_keyring 00:18:20.927 16:54:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:20.927 16:54:06 -- nvmf/common.sh@123 -- # set -e 00:18:20.927 16:54:06 -- nvmf/common.sh@124 -- # return 0 00:18:20.927 16:54:06 -- nvmf/common.sh@477 -- # '[' -n 1198507 ']' 00:18:20.927 16:54:06 -- nvmf/common.sh@478 -- # killprocess 1198507 00:18:20.927 16:54:06 -- common/autotest_common.sh@936 -- # '[' -z 1198507 ']' 00:18:20.927 16:54:06 -- common/autotest_common.sh@940 -- # kill -0 1198507 00:18:20.927 16:54:06 -- common/autotest_common.sh@941 -- # uname 00:18:20.927 16:54:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:20.927 16:54:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1198507 00:18:21.186 16:54:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:21.186 16:54:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:21.186 16:54:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1198507' 00:18:21.186 killing process with pid 1198507 00:18:21.186 16:54:06 -- common/autotest_common.sh@955 -- # kill 1198507 00:18:21.186 16:54:06 -- common/autotest_common.sh@960 -- # wait 1198507 00:18:21.186 16:54:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:21.186 16:54:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:21.186 16:54:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:21.186 16:54:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:21.186 16:54:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:21.186 16:54:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:21.186 16:54:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:21.186 16:54:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.721 16:54:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:23.721 00:18:23.721 real 0m7.249s 00:18:23.721 user 0m16.453s 00:18:23.721 sys 0m3.488s 00:18:23.721 16:54:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:23.721 16:54:08 -- common/autotest_common.sh@10 -- # set +x 00:18:23.721 ************************************ 00:18:23.721 END TEST nvmf_bdev_io_wait 00:18:23.721 ************************************ 00:18:23.721 16:54:08 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:23.721 16:54:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:23.721 16:54:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:23.721 16:54:08 -- common/autotest_common.sh@10 -- # set +x 00:18:23.721 ************************************ 00:18:23.721 START TEST nvmf_queue_depth 00:18:23.721 ************************************ 00:18:23.721 16:54:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:23.721 * Looking for test storage... 00:18:23.721 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:23.721 16:54:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:23.721 16:54:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:23.721 16:54:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:23.721 16:54:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:23.721 16:54:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:23.721 16:54:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:23.721 16:54:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:23.721 16:54:09 -- scripts/common.sh@335 -- # IFS=.-: 00:18:23.721 16:54:09 -- scripts/common.sh@335 -- # read -ra ver1 00:18:23.721 16:54:09 -- scripts/common.sh@336 -- # IFS=.-: 00:18:23.721 16:54:09 -- scripts/common.sh@336 -- # read -ra ver2 00:18:23.721 16:54:09 -- scripts/common.sh@337 -- # local 'op=<' 00:18:23.721 16:54:09 -- scripts/common.sh@339 -- # ver1_l=2 00:18:23.721 16:54:09 -- scripts/common.sh@340 -- # ver2_l=1 00:18:23.721 16:54:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:23.721 16:54:09 -- scripts/common.sh@343 -- # case "$op" in 00:18:23.721 16:54:09 -- scripts/common.sh@344 -- # : 1 00:18:23.721 16:54:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:23.721 16:54:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:23.721 16:54:09 -- scripts/common.sh@364 -- # decimal 1 00:18:23.721 16:54:09 -- scripts/common.sh@352 -- # local d=1 00:18:23.721 16:54:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:23.721 16:54:09 -- scripts/common.sh@354 -- # echo 1 00:18:23.721 16:54:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:23.721 16:54:09 -- scripts/common.sh@365 -- # decimal 2 00:18:23.721 16:54:09 -- scripts/common.sh@352 -- # local d=2 00:18:23.721 16:54:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:23.721 16:54:09 -- scripts/common.sh@354 -- # echo 2 00:18:23.721 16:54:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:23.721 16:54:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:23.721 16:54:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:23.721 16:54:09 -- scripts/common.sh@367 -- # return 0 00:18:23.721 16:54:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:23.721 16:54:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:23.721 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.721 --rc genhtml_branch_coverage=1 00:18:23.721 --rc genhtml_function_coverage=1 00:18:23.721 --rc genhtml_legend=1 00:18:23.721 --rc geninfo_all_blocks=1 00:18:23.721 --rc geninfo_unexecuted_blocks=1 00:18:23.721 00:18:23.721 ' 00:18:23.721 16:54:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:23.721 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.721 --rc genhtml_branch_coverage=1 00:18:23.721 --rc genhtml_function_coverage=1 00:18:23.721 --rc genhtml_legend=1 00:18:23.721 --rc geninfo_all_blocks=1 00:18:23.721 --rc geninfo_unexecuted_blocks=1 00:18:23.721 00:18:23.721 ' 00:18:23.721 16:54:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:23.721 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.721 --rc genhtml_branch_coverage=1 00:18:23.721 --rc genhtml_function_coverage=1 00:18:23.721 --rc genhtml_legend=1 00:18:23.721 --rc geninfo_all_blocks=1 00:18:23.721 --rc geninfo_unexecuted_blocks=1 00:18:23.721 00:18:23.721 ' 00:18:23.721 16:54:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:23.721 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.721 --rc genhtml_branch_coverage=1 00:18:23.721 --rc genhtml_function_coverage=1 00:18:23.721 --rc genhtml_legend=1 00:18:23.721 --rc geninfo_all_blocks=1 00:18:23.721 --rc geninfo_unexecuted_blocks=1 00:18:23.721 00:18:23.721 ' 00:18:23.721 16:54:09 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:23.721 16:54:09 -- nvmf/common.sh@7 -- # uname -s 00:18:23.721 16:54:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:23.721 16:54:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:23.721 16:54:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:23.721 16:54:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:23.721 16:54:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:23.721 16:54:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:23.721 16:54:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:23.721 16:54:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:23.721 16:54:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:23.721 16:54:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:23.721 16:54:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:23.721 16:54:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:23.721 16:54:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:23.721 16:54:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:23.721 16:54:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:23.721 16:54:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:23.721 16:54:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:23.722 16:54:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:23.722 16:54:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:23.722 16:54:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.722 16:54:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.722 16:54:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.722 16:54:09 -- paths/export.sh@5 -- # export PATH 00:18:23.722 16:54:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.722 16:54:09 -- nvmf/common.sh@46 -- # : 0 00:18:23.722 16:54:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:23.722 16:54:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:23.722 16:54:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:23.722 16:54:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:23.722 16:54:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:23.722 16:54:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:23.722 16:54:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:23.722 16:54:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:23.722 16:54:09 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:23.722 16:54:09 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:23.722 16:54:09 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:23.722 16:54:09 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:23.722 16:54:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:23.722 16:54:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:23.722 16:54:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:23.722 16:54:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:23.722 16:54:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:23.722 16:54:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:23.722 16:54:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:23.722 16:54:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.722 16:54:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:23.722 16:54:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:23.722 16:54:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:23.722 16:54:09 -- common/autotest_common.sh@10 -- # set +x 00:18:25.628 16:54:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:25.628 16:54:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:25.628 16:54:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:25.628 16:54:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:25.628 16:54:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:25.628 16:54:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:25.628 16:54:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:25.628 16:54:11 -- nvmf/common.sh@294 -- # net_devs=() 00:18:25.628 16:54:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:25.628 16:54:11 -- nvmf/common.sh@295 -- # e810=() 00:18:25.628 16:54:11 -- nvmf/common.sh@295 -- # local -ga e810 00:18:25.628 16:54:11 -- nvmf/common.sh@296 -- # x722=() 00:18:25.628 16:54:11 -- nvmf/common.sh@296 -- # local -ga x722 00:18:25.628 16:54:11 -- nvmf/common.sh@297 -- # mlx=() 00:18:25.628 16:54:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:25.628 16:54:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:25.628 16:54:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:25.628 16:54:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:25.628 16:54:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:25.628 16:54:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:25.628 16:54:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:25.628 16:54:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:25.628 16:54:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:25.628 16:54:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:25.628 16:54:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:25.628 16:54:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:25.628 16:54:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:25.628 16:54:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:25.628 16:54:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:25.628 16:54:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:25.628 16:54:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:25.628 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:25.628 16:54:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:25.628 16:54:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:25.628 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:25.628 16:54:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:25.628 16:54:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:25.628 16:54:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:25.628 16:54:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:25.628 16:54:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:25.628 16:54:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:25.628 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:25.628 16:54:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:25.628 16:54:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:25.628 16:54:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:25.628 16:54:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:25.628 16:54:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:25.628 16:54:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:25.628 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:25.628 16:54:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:25.628 16:54:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:25.628 16:54:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:25.628 16:54:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:25.628 16:54:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:25.628 16:54:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:25.628 16:54:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:25.628 16:54:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:25.628 16:54:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:25.628 16:54:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:25.628 16:54:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:25.628 16:54:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:25.628 16:54:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:25.628 16:54:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:25.628 16:54:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:25.628 16:54:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:25.628 16:54:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:25.628 16:54:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:25.628 16:54:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:25.628 16:54:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:25.628 16:54:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:25.628 16:54:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:25.628 16:54:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:25.628 16:54:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:25.628 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:25.628 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.183 ms 00:18:25.628 00:18:25.628 --- 10.0.0.2 ping statistics --- 00:18:25.628 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:25.628 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:18:25.628 16:54:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:25.628 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:25.628 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.065 ms 00:18:25.628 00:18:25.628 --- 10.0.0.1 ping statistics --- 00:18:25.628 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:25.628 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:18:25.628 16:54:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:25.628 16:54:11 -- nvmf/common.sh@410 -- # return 0 00:18:25.628 16:54:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:25.628 16:54:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:25.628 16:54:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:25.628 16:54:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:25.628 16:54:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:25.628 16:54:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:25.628 16:54:11 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:25.628 16:54:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:25.628 16:54:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:25.628 16:54:11 -- common/autotest_common.sh@10 -- # set +x 00:18:25.628 16:54:11 -- nvmf/common.sh@469 -- # nvmfpid=1201281 00:18:25.628 16:54:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:25.628 16:54:11 -- nvmf/common.sh@470 -- # waitforlisten 1201281 00:18:25.628 16:54:11 -- common/autotest_common.sh@829 -- # '[' -z 1201281 ']' 00:18:25.629 16:54:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:25.629 16:54:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:25.629 16:54:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:25.629 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:25.629 16:54:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:25.629 16:54:11 -- common/autotest_common.sh@10 -- # set +x 00:18:25.629 [2024-11-16 16:54:11.307389] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:25.629 [2024-11-16 16:54:11.307467] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:25.629 EAL: No free 2048 kB hugepages reported on node 1 00:18:25.887 [2024-11-16 16:54:11.383382] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:25.887 [2024-11-16 16:54:11.478359] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:25.887 [2024-11-16 16:54:11.478539] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:25.887 [2024-11-16 16:54:11.478559] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:25.887 [2024-11-16 16:54:11.478573] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:25.887 [2024-11-16 16:54:11.478606] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:26.822 16:54:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:26.822 16:54:12 -- common/autotest_common.sh@862 -- # return 0 00:18:26.822 16:54:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:26.822 16:54:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:26.822 16:54:12 -- common/autotest_common.sh@10 -- # set +x 00:18:26.822 16:54:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:26.822 16:54:12 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:26.822 16:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.822 16:54:12 -- common/autotest_common.sh@10 -- # set +x 00:18:26.822 [2024-11-16 16:54:12.333536] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:26.822 16:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.822 16:54:12 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:26.822 16:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.822 16:54:12 -- common/autotest_common.sh@10 -- # set +x 00:18:26.822 Malloc0 00:18:26.822 16:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.822 16:54:12 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:26.822 16:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.822 16:54:12 -- common/autotest_common.sh@10 -- # set +x 00:18:26.822 16:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.822 16:54:12 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:26.822 16:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.822 16:54:12 -- common/autotest_common.sh@10 -- # set +x 00:18:26.822 16:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.822 16:54:12 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:26.822 16:54:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.822 16:54:12 -- common/autotest_common.sh@10 -- # set +x 00:18:26.822 [2024-11-16 16:54:12.398394] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:26.822 16:54:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.822 16:54:12 -- target/queue_depth.sh@30 -- # bdevperf_pid=1201445 00:18:26.822 16:54:12 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:26.822 16:54:12 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:26.822 16:54:12 -- target/queue_depth.sh@33 -- # waitforlisten 1201445 /var/tmp/bdevperf.sock 00:18:26.822 16:54:12 -- common/autotest_common.sh@829 -- # '[' -z 1201445 ']' 00:18:26.822 16:54:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:26.822 16:54:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:26.822 16:54:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:26.822 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:26.822 16:54:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:26.822 16:54:12 -- common/autotest_common.sh@10 -- # set +x 00:18:26.822 [2024-11-16 16:54:12.442142] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:26.822 [2024-11-16 16:54:12.442201] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1201445 ] 00:18:26.822 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.822 [2024-11-16 16:54:12.502399] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:27.082 [2024-11-16 16:54:12.591628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:28.018 16:54:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:28.018 16:54:13 -- common/autotest_common.sh@862 -- # return 0 00:18:28.018 16:54:13 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:28.018 16:54:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:28.018 16:54:13 -- common/autotest_common.sh@10 -- # set +x 00:18:28.018 NVMe0n1 00:18:28.018 16:54:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:28.018 16:54:13 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:28.018 Running I/O for 10 seconds... 00:18:38.004 00:18:38.004 Latency(us) 00:18:38.004 [2024-11-16T15:54:23.754Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:38.004 [2024-11-16T15:54:23.754Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:38.004 Verification LBA range: start 0x0 length 0x4000 00:18:38.004 NVMe0n1 : 10.07 12726.77 49.71 0.00 0.00 80152.03 12815.93 63691.28 00:18:38.004 [2024-11-16T15:54:23.754Z] =================================================================================================================== 00:18:38.004 [2024-11-16T15:54:23.754Z] Total : 12726.77 49.71 0.00 0.00 80152.03 12815.93 63691.28 00:18:38.004 0 00:18:38.004 16:54:23 -- target/queue_depth.sh@39 -- # killprocess 1201445 00:18:38.004 16:54:23 -- common/autotest_common.sh@936 -- # '[' -z 1201445 ']' 00:18:38.004 16:54:23 -- common/autotest_common.sh@940 -- # kill -0 1201445 00:18:38.004 16:54:23 -- common/autotest_common.sh@941 -- # uname 00:18:38.004 16:54:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:38.004 16:54:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1201445 00:18:38.262 16:54:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:38.262 16:54:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:38.262 16:54:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1201445' 00:18:38.262 killing process with pid 1201445 00:18:38.262 16:54:23 -- common/autotest_common.sh@955 -- # kill 1201445 00:18:38.262 Received shutdown signal, test time was about 10.000000 seconds 00:18:38.262 00:18:38.262 Latency(us) 00:18:38.262 [2024-11-16T15:54:24.012Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:38.262 [2024-11-16T15:54:24.012Z] =================================================================================================================== 00:18:38.262 [2024-11-16T15:54:24.012Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:38.262 16:54:23 -- common/autotest_common.sh@960 -- # wait 1201445 00:18:38.262 16:54:24 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:38.262 16:54:24 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:38.262 16:54:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:38.262 16:54:24 -- nvmf/common.sh@116 -- # sync 00:18:38.262 16:54:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:38.262 16:54:24 -- nvmf/common.sh@119 -- # set +e 00:18:38.521 16:54:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:38.521 16:54:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:38.521 rmmod nvme_tcp 00:18:38.521 rmmod nvme_fabrics 00:18:38.521 rmmod nvme_keyring 00:18:38.521 16:54:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:38.521 16:54:24 -- nvmf/common.sh@123 -- # set -e 00:18:38.521 16:54:24 -- nvmf/common.sh@124 -- # return 0 00:18:38.521 16:54:24 -- nvmf/common.sh@477 -- # '[' -n 1201281 ']' 00:18:38.521 16:54:24 -- nvmf/common.sh@478 -- # killprocess 1201281 00:18:38.521 16:54:24 -- common/autotest_common.sh@936 -- # '[' -z 1201281 ']' 00:18:38.521 16:54:24 -- common/autotest_common.sh@940 -- # kill -0 1201281 00:18:38.521 16:54:24 -- common/autotest_common.sh@941 -- # uname 00:18:38.521 16:54:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:38.521 16:54:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1201281 00:18:38.521 16:54:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:38.521 16:54:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:38.521 16:54:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1201281' 00:18:38.521 killing process with pid 1201281 00:18:38.521 16:54:24 -- common/autotest_common.sh@955 -- # kill 1201281 00:18:38.521 16:54:24 -- common/autotest_common.sh@960 -- # wait 1201281 00:18:38.780 16:54:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:38.780 16:54:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:38.780 16:54:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:38.780 16:54:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:38.781 16:54:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:38.781 16:54:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:38.781 16:54:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:38.781 16:54:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:40.687 16:54:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:40.687 00:18:40.687 real 0m17.422s 00:18:40.687 user 0m25.095s 00:18:40.687 sys 0m3.106s 00:18:40.687 16:54:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:40.687 16:54:26 -- common/autotest_common.sh@10 -- # set +x 00:18:40.687 ************************************ 00:18:40.687 END TEST nvmf_queue_depth 00:18:40.687 ************************************ 00:18:40.687 16:54:26 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:40.687 16:54:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:40.687 16:54:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:40.687 16:54:26 -- common/autotest_common.sh@10 -- # set +x 00:18:40.687 ************************************ 00:18:40.687 START TEST nvmf_multipath 00:18:40.687 ************************************ 00:18:40.687 16:54:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:40.946 * Looking for test storage... 00:18:40.946 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:40.946 16:54:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:40.946 16:54:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:40.946 16:54:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:40.946 16:54:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:40.946 16:54:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:40.946 16:54:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:40.946 16:54:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:40.946 16:54:26 -- scripts/common.sh@335 -- # IFS=.-: 00:18:40.946 16:54:26 -- scripts/common.sh@335 -- # read -ra ver1 00:18:40.946 16:54:26 -- scripts/common.sh@336 -- # IFS=.-: 00:18:40.946 16:54:26 -- scripts/common.sh@336 -- # read -ra ver2 00:18:40.946 16:54:26 -- scripts/common.sh@337 -- # local 'op=<' 00:18:40.946 16:54:26 -- scripts/common.sh@339 -- # ver1_l=2 00:18:40.946 16:54:26 -- scripts/common.sh@340 -- # ver2_l=1 00:18:40.946 16:54:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:40.946 16:54:26 -- scripts/common.sh@343 -- # case "$op" in 00:18:40.946 16:54:26 -- scripts/common.sh@344 -- # : 1 00:18:40.946 16:54:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:40.946 16:54:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:40.946 16:54:26 -- scripts/common.sh@364 -- # decimal 1 00:18:40.946 16:54:26 -- scripts/common.sh@352 -- # local d=1 00:18:40.946 16:54:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:40.946 16:54:26 -- scripts/common.sh@354 -- # echo 1 00:18:40.946 16:54:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:40.946 16:54:26 -- scripts/common.sh@365 -- # decimal 2 00:18:40.946 16:54:26 -- scripts/common.sh@352 -- # local d=2 00:18:40.946 16:54:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:40.946 16:54:26 -- scripts/common.sh@354 -- # echo 2 00:18:40.946 16:54:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:40.946 16:54:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:40.946 16:54:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:40.946 16:54:26 -- scripts/common.sh@367 -- # return 0 00:18:40.946 16:54:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:40.946 16:54:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:40.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.946 --rc genhtml_branch_coverage=1 00:18:40.946 --rc genhtml_function_coverage=1 00:18:40.946 --rc genhtml_legend=1 00:18:40.946 --rc geninfo_all_blocks=1 00:18:40.946 --rc geninfo_unexecuted_blocks=1 00:18:40.946 00:18:40.946 ' 00:18:40.946 16:54:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:40.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.946 --rc genhtml_branch_coverage=1 00:18:40.946 --rc genhtml_function_coverage=1 00:18:40.946 --rc genhtml_legend=1 00:18:40.946 --rc geninfo_all_blocks=1 00:18:40.946 --rc geninfo_unexecuted_blocks=1 00:18:40.946 00:18:40.946 ' 00:18:40.946 16:54:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:40.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.946 --rc genhtml_branch_coverage=1 00:18:40.946 --rc genhtml_function_coverage=1 00:18:40.946 --rc genhtml_legend=1 00:18:40.946 --rc geninfo_all_blocks=1 00:18:40.946 --rc geninfo_unexecuted_blocks=1 00:18:40.946 00:18:40.946 ' 00:18:40.946 16:54:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:40.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.946 --rc genhtml_branch_coverage=1 00:18:40.946 --rc genhtml_function_coverage=1 00:18:40.946 --rc genhtml_legend=1 00:18:40.946 --rc geninfo_all_blocks=1 00:18:40.946 --rc geninfo_unexecuted_blocks=1 00:18:40.946 00:18:40.946 ' 00:18:40.946 16:54:26 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:40.946 16:54:26 -- nvmf/common.sh@7 -- # uname -s 00:18:40.946 16:54:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:40.946 16:54:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:40.946 16:54:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:40.946 16:54:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:40.946 16:54:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:40.946 16:54:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:40.946 16:54:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:40.946 16:54:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:40.946 16:54:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:40.946 16:54:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:40.946 16:54:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:40.946 16:54:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:40.946 16:54:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:40.946 16:54:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:40.946 16:54:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:40.946 16:54:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:40.946 16:54:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:40.946 16:54:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:40.946 16:54:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:40.946 16:54:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.946 16:54:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.946 16:54:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.946 16:54:26 -- paths/export.sh@5 -- # export PATH 00:18:40.946 16:54:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.946 16:54:26 -- nvmf/common.sh@46 -- # : 0 00:18:40.946 16:54:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:40.946 16:54:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:40.946 16:54:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:40.946 16:54:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:40.946 16:54:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:40.946 16:54:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:40.946 16:54:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:40.946 16:54:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:40.946 16:54:26 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:40.946 16:54:26 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:40.946 16:54:26 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:40.946 16:54:26 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:40.946 16:54:26 -- target/multipath.sh@43 -- # nvmftestinit 00:18:40.946 16:54:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:40.946 16:54:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:40.946 16:54:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:40.946 16:54:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:40.946 16:54:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:40.946 16:54:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:40.946 16:54:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:40.947 16:54:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:40.947 16:54:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:40.947 16:54:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:40.947 16:54:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:40.947 16:54:26 -- common/autotest_common.sh@10 -- # set +x 00:18:43.483 16:54:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:43.483 16:54:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:43.483 16:54:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:43.483 16:54:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:43.483 16:54:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:43.483 16:54:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:43.483 16:54:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:43.483 16:54:28 -- nvmf/common.sh@294 -- # net_devs=() 00:18:43.483 16:54:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:43.483 16:54:28 -- nvmf/common.sh@295 -- # e810=() 00:18:43.483 16:54:28 -- nvmf/common.sh@295 -- # local -ga e810 00:18:43.483 16:54:28 -- nvmf/common.sh@296 -- # x722=() 00:18:43.483 16:54:28 -- nvmf/common.sh@296 -- # local -ga x722 00:18:43.483 16:54:28 -- nvmf/common.sh@297 -- # mlx=() 00:18:43.483 16:54:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:43.483 16:54:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:43.483 16:54:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:43.483 16:54:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:43.483 16:54:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:43.483 16:54:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:43.483 16:54:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:43.483 16:54:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:43.483 16:54:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:43.483 16:54:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:43.483 16:54:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:43.483 16:54:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:43.483 16:54:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:43.483 16:54:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:43.483 16:54:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:43.483 16:54:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:43.483 16:54:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:43.483 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:43.483 16:54:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:43.483 16:54:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:43.483 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:43.483 16:54:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:43.483 16:54:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:43.483 16:54:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:43.483 16:54:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:43.483 16:54:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:43.483 16:54:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:43.483 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:43.483 16:54:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:43.483 16:54:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:43.483 16:54:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:43.483 16:54:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:43.483 16:54:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:43.483 16:54:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:43.483 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:43.483 16:54:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:43.483 16:54:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:43.483 16:54:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:43.483 16:54:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:43.483 16:54:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:43.483 16:54:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:43.483 16:54:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:43.483 16:54:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:43.483 16:54:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:43.483 16:54:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:43.483 16:54:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:43.483 16:54:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:43.483 16:54:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:43.483 16:54:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:43.483 16:54:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:43.483 16:54:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:43.483 16:54:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:43.483 16:54:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:43.483 16:54:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:43.483 16:54:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:43.483 16:54:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:43.483 16:54:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:43.483 16:54:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:43.483 16:54:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:43.483 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:43.483 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.215 ms 00:18:43.483 00:18:43.483 --- 10.0.0.2 ping statistics --- 00:18:43.483 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:43.483 rtt min/avg/max/mdev = 0.215/0.215/0.215/0.000 ms 00:18:43.483 16:54:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:43.483 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:43.483 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:18:43.483 00:18:43.483 --- 10.0.0.1 ping statistics --- 00:18:43.483 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:43.483 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:18:43.483 16:54:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:43.483 16:54:28 -- nvmf/common.sh@410 -- # return 0 00:18:43.483 16:54:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:43.483 16:54:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:43.483 16:54:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:43.483 16:54:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:43.483 16:54:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:43.483 16:54:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:43.483 16:54:28 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:43.483 16:54:28 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:43.483 only one NIC for nvmf test 00:18:43.484 16:54:28 -- target/multipath.sh@47 -- # nvmftestfini 00:18:43.484 16:54:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:43.484 16:54:28 -- nvmf/common.sh@116 -- # sync 00:18:43.484 16:54:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:43.484 16:54:28 -- nvmf/common.sh@119 -- # set +e 00:18:43.484 16:54:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:43.484 16:54:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:43.484 rmmod nvme_tcp 00:18:43.484 rmmod nvme_fabrics 00:18:43.484 rmmod nvme_keyring 00:18:43.484 16:54:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:43.484 16:54:28 -- nvmf/common.sh@123 -- # set -e 00:18:43.484 16:54:28 -- nvmf/common.sh@124 -- # return 0 00:18:43.484 16:54:28 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:43.484 16:54:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:43.484 16:54:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:43.484 16:54:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:43.484 16:54:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:43.484 16:54:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:43.484 16:54:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:43.484 16:54:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:43.484 16:54:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:45.387 16:54:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:45.387 16:54:30 -- target/multipath.sh@48 -- # exit 0 00:18:45.387 16:54:30 -- target/multipath.sh@1 -- # nvmftestfini 00:18:45.387 16:54:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:45.387 16:54:30 -- nvmf/common.sh@116 -- # sync 00:18:45.387 16:54:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:45.387 16:54:31 -- nvmf/common.sh@119 -- # set +e 00:18:45.387 16:54:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:45.387 16:54:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:45.387 16:54:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:45.387 16:54:31 -- nvmf/common.sh@123 -- # set -e 00:18:45.387 16:54:31 -- nvmf/common.sh@124 -- # return 0 00:18:45.387 16:54:31 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:45.387 16:54:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:45.387 16:54:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:45.387 16:54:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:45.387 16:54:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:45.387 16:54:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:45.387 16:54:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:45.387 16:54:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:45.387 16:54:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:45.387 16:54:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:45.387 00:18:45.387 real 0m4.597s 00:18:45.387 user 0m0.959s 00:18:45.387 sys 0m1.586s 00:18:45.387 16:54:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:45.387 16:54:31 -- common/autotest_common.sh@10 -- # set +x 00:18:45.387 ************************************ 00:18:45.387 END TEST nvmf_multipath 00:18:45.387 ************************************ 00:18:45.387 16:54:31 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:45.387 16:54:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:45.387 16:54:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:45.387 16:54:31 -- common/autotest_common.sh@10 -- # set +x 00:18:45.387 ************************************ 00:18:45.387 START TEST nvmf_zcopy 00:18:45.387 ************************************ 00:18:45.387 16:54:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:45.387 * Looking for test storage... 00:18:45.387 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:45.387 16:54:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:45.387 16:54:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:45.387 16:54:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:45.647 16:54:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:45.647 16:54:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:45.647 16:54:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:45.647 16:54:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:45.647 16:54:31 -- scripts/common.sh@335 -- # IFS=.-: 00:18:45.647 16:54:31 -- scripts/common.sh@335 -- # read -ra ver1 00:18:45.647 16:54:31 -- scripts/common.sh@336 -- # IFS=.-: 00:18:45.647 16:54:31 -- scripts/common.sh@336 -- # read -ra ver2 00:18:45.647 16:54:31 -- scripts/common.sh@337 -- # local 'op=<' 00:18:45.647 16:54:31 -- scripts/common.sh@339 -- # ver1_l=2 00:18:45.647 16:54:31 -- scripts/common.sh@340 -- # ver2_l=1 00:18:45.647 16:54:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:45.647 16:54:31 -- scripts/common.sh@343 -- # case "$op" in 00:18:45.647 16:54:31 -- scripts/common.sh@344 -- # : 1 00:18:45.647 16:54:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:45.647 16:54:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:45.647 16:54:31 -- scripts/common.sh@364 -- # decimal 1 00:18:45.647 16:54:31 -- scripts/common.sh@352 -- # local d=1 00:18:45.647 16:54:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:45.648 16:54:31 -- scripts/common.sh@354 -- # echo 1 00:18:45.648 16:54:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:45.648 16:54:31 -- scripts/common.sh@365 -- # decimal 2 00:18:45.648 16:54:31 -- scripts/common.sh@352 -- # local d=2 00:18:45.648 16:54:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:45.648 16:54:31 -- scripts/common.sh@354 -- # echo 2 00:18:45.648 16:54:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:45.648 16:54:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:45.648 16:54:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:45.648 16:54:31 -- scripts/common.sh@367 -- # return 0 00:18:45.648 16:54:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:45.648 16:54:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:45.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.648 --rc genhtml_branch_coverage=1 00:18:45.648 --rc genhtml_function_coverage=1 00:18:45.648 --rc genhtml_legend=1 00:18:45.648 --rc geninfo_all_blocks=1 00:18:45.648 --rc geninfo_unexecuted_blocks=1 00:18:45.648 00:18:45.648 ' 00:18:45.648 16:54:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:45.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.648 --rc genhtml_branch_coverage=1 00:18:45.648 --rc genhtml_function_coverage=1 00:18:45.648 --rc genhtml_legend=1 00:18:45.648 --rc geninfo_all_blocks=1 00:18:45.648 --rc geninfo_unexecuted_blocks=1 00:18:45.648 00:18:45.648 ' 00:18:45.648 16:54:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:45.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.648 --rc genhtml_branch_coverage=1 00:18:45.648 --rc genhtml_function_coverage=1 00:18:45.648 --rc genhtml_legend=1 00:18:45.648 --rc geninfo_all_blocks=1 00:18:45.648 --rc geninfo_unexecuted_blocks=1 00:18:45.648 00:18:45.648 ' 00:18:45.648 16:54:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:45.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.648 --rc genhtml_branch_coverage=1 00:18:45.648 --rc genhtml_function_coverage=1 00:18:45.648 --rc genhtml_legend=1 00:18:45.648 --rc geninfo_all_blocks=1 00:18:45.648 --rc geninfo_unexecuted_blocks=1 00:18:45.648 00:18:45.648 ' 00:18:45.648 16:54:31 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:45.648 16:54:31 -- nvmf/common.sh@7 -- # uname -s 00:18:45.648 16:54:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:45.648 16:54:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:45.648 16:54:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:45.648 16:54:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:45.648 16:54:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:45.648 16:54:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:45.648 16:54:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:45.648 16:54:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:45.648 16:54:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:45.648 16:54:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:45.648 16:54:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:45.648 16:54:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:45.648 16:54:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:45.648 16:54:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:45.648 16:54:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:45.648 16:54:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:45.648 16:54:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:45.648 16:54:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:45.648 16:54:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:45.648 16:54:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.648 16:54:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.648 16:54:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.648 16:54:31 -- paths/export.sh@5 -- # export PATH 00:18:45.648 16:54:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.648 16:54:31 -- nvmf/common.sh@46 -- # : 0 00:18:45.648 16:54:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:45.648 16:54:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:45.648 16:54:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:45.648 16:54:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:45.648 16:54:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:45.648 16:54:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:45.648 16:54:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:45.648 16:54:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:45.648 16:54:31 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:45.648 16:54:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:45.648 16:54:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:45.648 16:54:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:45.648 16:54:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:45.648 16:54:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:45.648 16:54:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:45.648 16:54:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:45.648 16:54:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:45.648 16:54:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:45.648 16:54:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:45.648 16:54:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:45.648 16:54:31 -- common/autotest_common.sh@10 -- # set +x 00:18:48.182 16:54:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:48.182 16:54:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:48.182 16:54:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:48.182 16:54:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:48.182 16:54:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:48.182 16:54:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:48.182 16:54:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:48.182 16:54:33 -- nvmf/common.sh@294 -- # net_devs=() 00:18:48.182 16:54:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:48.182 16:54:33 -- nvmf/common.sh@295 -- # e810=() 00:18:48.182 16:54:33 -- nvmf/common.sh@295 -- # local -ga e810 00:18:48.182 16:54:33 -- nvmf/common.sh@296 -- # x722=() 00:18:48.182 16:54:33 -- nvmf/common.sh@296 -- # local -ga x722 00:18:48.182 16:54:33 -- nvmf/common.sh@297 -- # mlx=() 00:18:48.182 16:54:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:48.182 16:54:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:48.182 16:54:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:48.182 16:54:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:48.182 16:54:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:48.182 16:54:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:48.182 16:54:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:48.182 16:54:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:48.182 16:54:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:48.183 16:54:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:48.183 16:54:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:48.183 16:54:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:48.183 16:54:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:48.183 16:54:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:48.183 16:54:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:48.183 16:54:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:48.183 16:54:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:48.183 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:48.183 16:54:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:48.183 16:54:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:48.183 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:48.183 16:54:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:48.183 16:54:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:48.183 16:54:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:48.183 16:54:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:48.183 16:54:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:48.183 16:54:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:48.183 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:48.183 16:54:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:48.183 16:54:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:48.183 16:54:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:48.183 16:54:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:48.183 16:54:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:48.183 16:54:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:48.183 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:48.183 16:54:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:48.183 16:54:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:48.183 16:54:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:48.183 16:54:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:48.183 16:54:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:48.183 16:54:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:48.183 16:54:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:48.183 16:54:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:48.183 16:54:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:48.183 16:54:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:48.183 16:54:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:48.183 16:54:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:48.183 16:54:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:48.183 16:54:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:48.183 16:54:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:48.183 16:54:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:48.183 16:54:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:48.183 16:54:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:48.183 16:54:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:48.183 16:54:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:48.183 16:54:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:48.183 16:54:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:48.183 16:54:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:48.183 16:54:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:48.183 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:48.183 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.188 ms 00:18:48.183 00:18:48.183 --- 10.0.0.2 ping statistics --- 00:18:48.183 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:48.183 rtt min/avg/max/mdev = 0.188/0.188/0.188/0.000 ms 00:18:48.183 16:54:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:48.183 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:48.183 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:18:48.183 00:18:48.183 --- 10.0.0.1 ping statistics --- 00:18:48.183 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:48.183 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:18:48.183 16:54:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:48.183 16:54:33 -- nvmf/common.sh@410 -- # return 0 00:18:48.183 16:54:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:48.183 16:54:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:48.183 16:54:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:48.183 16:54:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:48.183 16:54:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:48.183 16:54:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:48.183 16:54:33 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:48.183 16:54:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:48.183 16:54:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:48.183 16:54:33 -- common/autotest_common.sh@10 -- # set +x 00:18:48.183 16:54:33 -- nvmf/common.sh@469 -- # nvmfpid=1206818 00:18:48.183 16:54:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:48.183 16:54:33 -- nvmf/common.sh@470 -- # waitforlisten 1206818 00:18:48.183 16:54:33 -- common/autotest_common.sh@829 -- # '[' -z 1206818 ']' 00:18:48.183 16:54:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:48.183 16:54:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:48.183 16:54:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:48.183 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:48.183 16:54:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:48.183 16:54:33 -- common/autotest_common.sh@10 -- # set +x 00:18:48.183 [2024-11-16 16:54:33.546446] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:48.183 [2024-11-16 16:54:33.546526] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:48.183 EAL: No free 2048 kB hugepages reported on node 1 00:18:48.183 [2024-11-16 16:54:33.616375] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:48.183 [2024-11-16 16:54:33.710004] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:48.183 [2024-11-16 16:54:33.710159] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:48.183 [2024-11-16 16:54:33.710179] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:48.183 [2024-11-16 16:54:33.710193] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:48.183 [2024-11-16 16:54:33.710228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:49.116 16:54:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:49.116 16:54:34 -- common/autotest_common.sh@862 -- # return 0 00:18:49.116 16:54:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:49.116 16:54:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:49.116 16:54:34 -- common/autotest_common.sh@10 -- # set +x 00:18:49.116 16:54:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:49.116 16:54:34 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:49.116 16:54:34 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:49.116 16:54:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.116 16:54:34 -- common/autotest_common.sh@10 -- # set +x 00:18:49.116 [2024-11-16 16:54:34.614178] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:49.116 16:54:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.116 16:54:34 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:49.116 16:54:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.116 16:54:34 -- common/autotest_common.sh@10 -- # set +x 00:18:49.116 16:54:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.117 16:54:34 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:49.117 16:54:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.117 16:54:34 -- common/autotest_common.sh@10 -- # set +x 00:18:49.117 [2024-11-16 16:54:34.630364] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:49.117 16:54:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.117 16:54:34 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:49.117 16:54:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.117 16:54:34 -- common/autotest_common.sh@10 -- # set +x 00:18:49.117 16:54:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.117 16:54:34 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:49.117 16:54:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.117 16:54:34 -- common/autotest_common.sh@10 -- # set +x 00:18:49.117 malloc0 00:18:49.117 16:54:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.117 16:54:34 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:49.117 16:54:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.117 16:54:34 -- common/autotest_common.sh@10 -- # set +x 00:18:49.117 16:54:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.117 16:54:34 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:49.117 16:54:34 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:49.117 16:54:34 -- nvmf/common.sh@520 -- # config=() 00:18:49.117 16:54:34 -- nvmf/common.sh@520 -- # local subsystem config 00:18:49.117 16:54:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:49.117 16:54:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:49.117 { 00:18:49.117 "params": { 00:18:49.117 "name": "Nvme$subsystem", 00:18:49.117 "trtype": "$TEST_TRANSPORT", 00:18:49.117 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:49.117 "adrfam": "ipv4", 00:18:49.117 "trsvcid": "$NVMF_PORT", 00:18:49.117 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:49.117 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:49.117 "hdgst": ${hdgst:-false}, 00:18:49.117 "ddgst": ${ddgst:-false} 00:18:49.117 }, 00:18:49.117 "method": "bdev_nvme_attach_controller" 00:18:49.117 } 00:18:49.117 EOF 00:18:49.117 )") 00:18:49.117 16:54:34 -- nvmf/common.sh@542 -- # cat 00:18:49.117 16:54:34 -- nvmf/common.sh@544 -- # jq . 00:18:49.117 16:54:34 -- nvmf/common.sh@545 -- # IFS=, 00:18:49.117 16:54:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:49.117 "params": { 00:18:49.117 "name": "Nvme1", 00:18:49.117 "trtype": "tcp", 00:18:49.117 "traddr": "10.0.0.2", 00:18:49.117 "adrfam": "ipv4", 00:18:49.117 "trsvcid": "4420", 00:18:49.117 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:49.117 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:49.117 "hdgst": false, 00:18:49.117 "ddgst": false 00:18:49.117 }, 00:18:49.117 "method": "bdev_nvme_attach_controller" 00:18:49.117 }' 00:18:49.117 [2024-11-16 16:54:34.705994] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:49.117 [2024-11-16 16:54:34.706061] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1206976 ] 00:18:49.117 EAL: No free 2048 kB hugepages reported on node 1 00:18:49.117 [2024-11-16 16:54:34.767361] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:49.117 [2024-11-16 16:54:34.861757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:49.374 Running I/O for 10 seconds... 00:18:59.414 00:18:59.414 Latency(us) 00:18:59.414 [2024-11-16T15:54:45.164Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:59.414 [2024-11-16T15:54:45.164Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:59.414 Verification LBA range: start 0x0 length 0x1000 00:18:59.414 Nvme1n1 : 10.01 8447.12 65.99 0.00 0.00 15117.31 1759.76 23398.78 00:18:59.414 [2024-11-16T15:54:45.164Z] =================================================================================================================== 00:18:59.414 [2024-11-16T15:54:45.164Z] Total : 8447.12 65.99 0.00 0.00 15117.31 1759.76 23398.78 00:18:59.674 16:54:45 -- target/zcopy.sh@39 -- # perfpid=1208206 00:18:59.674 16:54:45 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:59.674 16:54:45 -- common/autotest_common.sh@10 -- # set +x 00:18:59.674 16:54:45 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:59.674 16:54:45 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:59.674 16:54:45 -- nvmf/common.sh@520 -- # config=() 00:18:59.674 16:54:45 -- nvmf/common.sh@520 -- # local subsystem config 00:18:59.674 16:54:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:59.674 16:54:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:59.674 { 00:18:59.674 "params": { 00:18:59.674 "name": "Nvme$subsystem", 00:18:59.674 "trtype": "$TEST_TRANSPORT", 00:18:59.674 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:59.674 "adrfam": "ipv4", 00:18:59.674 "trsvcid": "$NVMF_PORT", 00:18:59.674 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:59.674 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:59.674 "hdgst": ${hdgst:-false}, 00:18:59.674 "ddgst": ${ddgst:-false} 00:18:59.674 }, 00:18:59.674 "method": "bdev_nvme_attach_controller" 00:18:59.674 } 00:18:59.674 EOF 00:18:59.674 )") 00:18:59.674 16:54:45 -- nvmf/common.sh@542 -- # cat 00:18:59.674 [2024-11-16 16:54:45.361958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.674 [2024-11-16 16:54:45.362003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.674 16:54:45 -- nvmf/common.sh@544 -- # jq . 00:18:59.674 16:54:45 -- nvmf/common.sh@545 -- # IFS=, 00:18:59.674 16:54:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:59.674 "params": { 00:18:59.674 "name": "Nvme1", 00:18:59.674 "trtype": "tcp", 00:18:59.674 "traddr": "10.0.0.2", 00:18:59.674 "adrfam": "ipv4", 00:18:59.674 "trsvcid": "4420", 00:18:59.674 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:59.674 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:59.674 "hdgst": false, 00:18:59.674 "ddgst": false 00:18:59.674 }, 00:18:59.674 "method": "bdev_nvme_attach_controller" 00:18:59.674 }' 00:18:59.674 [2024-11-16 16:54:45.369929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.674 [2024-11-16 16:54:45.369955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.674 [2024-11-16 16:54:45.377948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.674 [2024-11-16 16:54:45.377973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.674 [2024-11-16 16:54:45.385981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.674 [2024-11-16 16:54:45.386000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.674 [2024-11-16 16:54:45.393989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.674 [2024-11-16 16:54:45.394009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.674 [2024-11-16 16:54:45.398010] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:59.674 [2024-11-16 16:54:45.398094] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1208206 ] 00:18:59.674 [2024-11-16 16:54:45.402009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.674 [2024-11-16 16:54:45.402028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.674 [2024-11-16 16:54:45.410035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.674 [2024-11-16 16:54:45.410069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.674 [2024-11-16 16:54:45.418053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.674 [2024-11-16 16:54:45.418073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.426090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.426124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 EAL: No free 2048 kB hugepages reported on node 1 00:18:59.933 [2024-11-16 16:54:45.434112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.434137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.442134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.442158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.450157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.450181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.458179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.458203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.462027] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:59.933 [2024-11-16 16:54:45.466205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.466230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.474246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.474298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.482246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.482272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.490267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.490291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.498291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.498314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.506314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.506338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.514342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.514371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.522377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.522416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.530380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.530404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.538399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.538424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.546421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.546445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.554442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.554466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.555355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:59.933 [2024-11-16 16:54:45.562465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.562489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.570497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.570535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.578530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.578570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.586554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.586592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.594578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.594626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.602598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.602644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.610833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.610881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.618655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.618705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.626690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.626712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.634715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.634749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.642730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.642766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.650734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.650757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.658758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.658781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.666809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.666835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.674805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.674829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.933 [2024-11-16 16:54:45.682827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.933 [2024-11-16 16:54:45.682851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.193 [2024-11-16 16:54:45.690848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.193 [2024-11-16 16:54:45.690872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.698865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.698889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.706886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.706930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.714925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.714950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.722950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.722984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.730976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.731002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.739006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.739029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.747028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.747055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.755047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.755071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.763070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.763094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.771094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.771118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.779116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.779140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.787144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.787169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.795165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.795190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.803187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.803212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.811209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.811234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.819232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.819256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.827253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.827277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.835277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.835302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.882794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.882822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.887467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.887490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.895493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.895516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 Running I/O for 5 seconds... 00:19:00.194 [2024-11-16 16:54:45.908098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.908125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.917905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.917935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.929521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.929563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.194 [2024-11-16 16:54:45.939966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.194 [2024-11-16 16:54:45.939992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:45.950397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:45.950425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:45.961435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:45.961461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:45.972054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:45.972080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:45.984217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:45.984243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:45.993809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:45.993837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.005113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.005139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.017671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.017699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.029483] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.029509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.038834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.038860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.050231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.050257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.061026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.061052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.072120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.072148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.084742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.084769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.094397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.094422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.105024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.105050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.117706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.117733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.127694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.127721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.138046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.138072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.149117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.149143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.159719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.159746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.170706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.170733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.183067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.183093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.194540] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.194566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.455 [2024-11-16 16:54:46.203947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.455 [2024-11-16 16:54:46.203976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.215404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.215431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.225777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.225804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.236688] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.236715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.249168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.249193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.258888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.258914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.269709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.269736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.282278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.282304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.292258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.292284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.303269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.303296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.314982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.315008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.325957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.325998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.337099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.337124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.350004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.350029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.359974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.360000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.370521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.370547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.383216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.383242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.714 [2024-11-16 16:54:46.392613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.714 [2024-11-16 16:54:46.392648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.715 [2024-11-16 16:54:46.403788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.715 [2024-11-16 16:54:46.403815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.715 [2024-11-16 16:54:46.414595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.715 [2024-11-16 16:54:46.414643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.715 [2024-11-16 16:54:46.424542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.715 [2024-11-16 16:54:46.424569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.715 [2024-11-16 16:54:46.435364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.715 [2024-11-16 16:54:46.435390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.715 [2024-11-16 16:54:46.447588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.715 [2024-11-16 16:54:46.447614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.715 [2024-11-16 16:54:46.457444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.715 [2024-11-16 16:54:46.457470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.468179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.468206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.479010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.479036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.489761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.489788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.502532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.502558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.514026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.514053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.522964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.522991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.534378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.534431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.546748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.546775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.556896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.556937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.567483] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.567512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.580291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.580318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.590541] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.590567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.601901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.601942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.615224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.615253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.626433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.626463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.637419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.637449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.650816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.650843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.661157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.661187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.672284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.672314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.685244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.685274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.695668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.695695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.706778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.706805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.978 [2024-11-16 16:54:46.719142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.978 [2024-11-16 16:54:46.719169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.728656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.728684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.740187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.740218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.753125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.753160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.763578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.763609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.775025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.775051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.785521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.785548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.796290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.796318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.807044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.807071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.817698] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.817726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.828509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.828539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.839773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.839801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.853066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.853097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.863378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.863408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.873967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.873994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.884897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.884938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.895801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.895828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.907447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.907478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.918524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.918550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.932044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.932074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.942647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.942674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.954022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.954048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.967238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.967276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.977514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.977540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:46.989309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:46.989334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.266 [2024-11-16 16:54:47.000658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.266 [2024-11-16 16:54:47.000685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.539 [2024-11-16 16:54:47.013878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.539 [2024-11-16 16:54:47.013908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.539 [2024-11-16 16:54:47.024328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.539 [2024-11-16 16:54:47.024358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.539 [2024-11-16 16:54:47.035473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.539 [2024-11-16 16:54:47.035502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.539 [2024-11-16 16:54:47.048884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.539 [2024-11-16 16:54:47.048926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.539 [2024-11-16 16:54:47.059755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.539 [2024-11-16 16:54:47.059783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.539 [2024-11-16 16:54:47.070914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.539 [2024-11-16 16:54:47.070956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.539 [2024-11-16 16:54:47.084032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.539 [2024-11-16 16:54:47.084062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.539 [2024-11-16 16:54:47.093931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.539 [2024-11-16 16:54:47.093961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.539 [2024-11-16 16:54:47.105684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.105712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.116776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.116804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.127860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.127887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.138669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.138696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.149662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.149690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.160940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.160971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.172119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.172148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.183385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.183419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.194431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.194461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.205464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.205493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.218731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.218759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.229552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.229582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.240898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.240939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.252137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.252163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.263196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.263226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.540 [2024-11-16 16:54:47.274417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.540 [2024-11-16 16:54:47.274447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.285736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.285763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.298383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.298413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.308466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.308496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.319984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.320010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.333001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.333043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.343193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.343218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.354496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.354522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.365582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.365631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.376511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.376537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.387694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.387721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.399154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.399179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.412187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.412216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.422645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.422682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.433545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.433573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.444688] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.444714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.455978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.456004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.467445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.467472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.478872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.805 [2024-11-16 16:54:47.478898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.805 [2024-11-16 16:54:47.490259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.806 [2024-11-16 16:54:47.490284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.806 [2024-11-16 16:54:47.500877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.806 [2024-11-16 16:54:47.500903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.806 [2024-11-16 16:54:47.514088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.806 [2024-11-16 16:54:47.514114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.806 [2024-11-16 16:54:47.524140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.806 [2024-11-16 16:54:47.524170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.806 [2024-11-16 16:54:47.535209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.806 [2024-11-16 16:54:47.535240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.806 [2024-11-16 16:54:47.548369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.806 [2024-11-16 16:54:47.548398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.559081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.559111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.570458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.570485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.583051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.583078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.594998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.595028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.604279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.604306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.616298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.616325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.629066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.629108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.639797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.639825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.650770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.650797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.664072] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.664098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.674845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.674872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.686023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.686053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.698909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.698956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.709389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.709419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.720406] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.720436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.731376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.731402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.742378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.742403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.755427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.755457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.765742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.064 [2024-11-16 16:54:47.765779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.064 [2024-11-16 16:54:47.776642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.065 [2024-11-16 16:54:47.776685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.065 [2024-11-16 16:54:47.789385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.065 [2024-11-16 16:54:47.789415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.065 [2024-11-16 16:54:47.799811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.065 [2024-11-16 16:54:47.799838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.065 [2024-11-16 16:54:47.810670] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.065 [2024-11-16 16:54:47.810699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.821934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.821961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.832654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.832681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.845359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.845386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.855327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.855356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.866262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.866288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.877524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.877551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.888268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.888295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.899424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.899451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.910660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.910687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.923834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.923861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.934371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.934400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.946061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.946104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.957188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.957218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.968193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.968222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.979287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.979317] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:47.992460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:47.992490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:48.002476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:48.002505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:48.013465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:48.013495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:48.025996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:48.026040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:48.034977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:48.035004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:48.048808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:48.048835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:48.059735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:48.059762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.323 [2024-11-16 16:54:48.071212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.323 [2024-11-16 16:54:48.071246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.583 [2024-11-16 16:54:48.082903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.583 [2024-11-16 16:54:48.082946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.583 [2024-11-16 16:54:48.094374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.583 [2024-11-16 16:54:48.094404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.583 [2024-11-16 16:54:48.105674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.583 [2024-11-16 16:54:48.105702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.583 [2024-11-16 16:54:48.116729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.583 [2024-11-16 16:54:48.116756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.583 [2024-11-16 16:54:48.127854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.583 [2024-11-16 16:54:48.127881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.583 [2024-11-16 16:54:48.138863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.583 [2024-11-16 16:54:48.138890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.152105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.152135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.162224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.162253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.173102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.173132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.183980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.184006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.195144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.195174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.208314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.208343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.218608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.218657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.229585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.229612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.240944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.240970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.251995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.252035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.263078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.263108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.274131] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.274161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.287214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.287244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.297885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.297913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.308560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.308586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.321164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.321193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.584 [2024-11-16 16:54:48.331119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.584 [2024-11-16 16:54:48.331150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.844 [2024-11-16 16:54:48.343161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.844 [2024-11-16 16:54:48.343187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.844 [2024-11-16 16:54:48.354066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.844 [2024-11-16 16:54:48.354091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.844 [2024-11-16 16:54:48.364899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.844 [2024-11-16 16:54:48.364941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.844 [2024-11-16 16:54:48.376131] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.844 [2024-11-16 16:54:48.376157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.844 [2024-11-16 16:54:48.387128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.844 [2024-11-16 16:54:48.387154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.844 [2024-11-16 16:54:48.398208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.844 [2024-11-16 16:54:48.398235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.844 [2024-11-16 16:54:48.409724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.844 [2024-11-16 16:54:48.409750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.844 [2024-11-16 16:54:48.420452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.844 [2024-11-16 16:54:48.420477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.844 [2024-11-16 16:54:48.431680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.844 [2024-11-16 16:54:48.431708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.844 [2024-11-16 16:54:48.442907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.844 [2024-11-16 16:54:48.442939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.844 [2024-11-16 16:54:48.453874] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.844 [2024-11-16 16:54:48.453915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.845 [2024-11-16 16:54:48.466788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.845 [2024-11-16 16:54:48.466825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.845 [2024-11-16 16:54:48.476640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.845 [2024-11-16 16:54:48.476666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.845 [2024-11-16 16:54:48.488206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.845 [2024-11-16 16:54:48.488235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.845 [2024-11-16 16:54:48.501422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.845 [2024-11-16 16:54:48.501451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.845 [2024-11-16 16:54:48.511894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.845 [2024-11-16 16:54:48.511923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.845 [2024-11-16 16:54:48.522870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.845 [2024-11-16 16:54:48.522901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.845 [2024-11-16 16:54:48.534588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.845 [2024-11-16 16:54:48.534628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.845 [2024-11-16 16:54:48.545824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.845 [2024-11-16 16:54:48.545853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.845 [2024-11-16 16:54:48.558775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.845 [2024-11-16 16:54:48.558806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.845 [2024-11-16 16:54:48.569309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.845 [2024-11-16 16:54:48.569338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.845 [2024-11-16 16:54:48.580593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.845 [2024-11-16 16:54:48.580632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.845 [2024-11-16 16:54:48.591577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.845 [2024-11-16 16:54:48.591606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.602663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.602694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.615580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.615609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.625965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.625995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.637157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.637186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.650475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.650505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.661071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.661101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.672502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.672532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.685373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.685412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.695673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.695703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.707018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.707047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.718265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.718294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.729598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.729641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.741049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.741077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.751890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.751919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.763208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.763237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.774137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.774166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.786815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.786845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.796955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.796984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.808256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.808286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.821041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.821071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.831278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.831308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.104 [2024-11-16 16:54:48.843355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.104 [2024-11-16 16:54:48.843386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:48.854416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:48.854447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:48.866908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:48.866938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:48.877521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:48.877550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:48.888778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:48.888808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:48.902170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:48.902210] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:48.912959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:48.912989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:48.923783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:48.923812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:48.936685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:48.936714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:48.947013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:48.947042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:48.958122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:48.958152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:48.970459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:48.970488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:48.980058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:48.980087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:48.991890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:48.991920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:49.003172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:49.003203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:49.014097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:49.014128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:49.027219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:49.027250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:49.036773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:49.036803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:49.048505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:49.048536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:49.059984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:49.060014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:49.070866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:49.070897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:49.082108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:49.082139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:49.095040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:49.095071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.364 [2024-11-16 16:54:49.105087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.364 [2024-11-16 16:54:49.105116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.117300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.117331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.128960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.128990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.140243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.140273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.151725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.151762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.162409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.162435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.172741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.172767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.183232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.183257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.193928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.193954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.206590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.206639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.216322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.216348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.226780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.226806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.237463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.237489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.249952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.249979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.260008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.260034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.270699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.270727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.282641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.282667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.291787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.291814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.304265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.304291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.314104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.314130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.325007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.325033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.337655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.337683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.347836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.347862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.357959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.357985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.628 [2024-11-16 16:54:49.368364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.628 [2024-11-16 16:54:49.368390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.378604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.378655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.389174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.389200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.399496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.399522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.409887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.409913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.420206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.420232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.430805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.430831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.441494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.441520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.452098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.452125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.464614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.464649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.476381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.476407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.485376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.485401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.497032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.497058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.509535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.509562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.519569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.519596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.530270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.530296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.890 [2024-11-16 16:54:49.542669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.890 [2024-11-16 16:54:49.542697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.891 [2024-11-16 16:54:49.552498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.891 [2024-11-16 16:54:49.552524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.891 [2024-11-16 16:54:49.563020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.891 [2024-11-16 16:54:49.563046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.891 [2024-11-16 16:54:49.573766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.891 [2024-11-16 16:54:49.573793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.891 [2024-11-16 16:54:49.586403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.891 [2024-11-16 16:54:49.586429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.891 [2024-11-16 16:54:49.596238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.891 [2024-11-16 16:54:49.596263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.891 [2024-11-16 16:54:49.606708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.891 [2024-11-16 16:54:49.606735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.891 [2024-11-16 16:54:49.617328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.891 [2024-11-16 16:54:49.617354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.891 [2024-11-16 16:54:49.630079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.891 [2024-11-16 16:54:49.630106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.891 [2024-11-16 16:54:49.640125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.891 [2024-11-16 16:54:49.640151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.651076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.651104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.662198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.662224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.672753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.672780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.685148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.685174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.694526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.694551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.705311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.705337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.715952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.715978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.726733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.726760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.739188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.739214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.748646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.748672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.758994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.759020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.769528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.769569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.781901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.781943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.792007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.792048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.802215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.802257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.812516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.812542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.822875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.822902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.833390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.833416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.843989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.844031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.854384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.854410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.866663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.866690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.876108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.876135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.887322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.887348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.150 [2024-11-16 16:54:49.898101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.150 [2024-11-16 16:54:49.898131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:49.909426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:49.909456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:49.920312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:49.920341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:49.931543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:49.931581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:49.944774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:49.944802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:49.955242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:49.955271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:49.966610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:49.966661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:49.979292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:49.979318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:49.989328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:49.989358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:49.999752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:49.999779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:50.011030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:50.011059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:50.024355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:50.024387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:50.035033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:50.035061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:50.048955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:50.049012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:50.063402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:50.063439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:50.078697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:50.078731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:50.091879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:50.091910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:50.103473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:50.103504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:50.116840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:50.116868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:50.127529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:50.127560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:50.138556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:50.138584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.409 [2024-11-16 16:54:50.150100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.409 [2024-11-16 16:54:50.150147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.669 [2024-11-16 16:54:50.161777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.669 [2024-11-16 16:54:50.161821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.669 [2024-11-16 16:54:50.172630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.669 [2024-11-16 16:54:50.172657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.669 [2024-11-16 16:54:50.184326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.669 [2024-11-16 16:54:50.184357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.195701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.195729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.206780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.206813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.218331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.218361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.229868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.229896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.243632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.243666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.254606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.254644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.265633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.265661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.276751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.276786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.288037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.288064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.299809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.299836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.311114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.311140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.322474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.322502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.335787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.335815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.346063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.346093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.357124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.357159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.368591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.368630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.379999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.380040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.393371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.393401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.403937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.403963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.670 [2024-11-16 16:54:50.415287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.670 [2024-11-16 16:54:50.415318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.428170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.428201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.438588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.438641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.450267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.450297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.461201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.461231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.472583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.472613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.484469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.484499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.495958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.495985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.506779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.506806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.519939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.519970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.530216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.530247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.541960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.541986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.553741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.553769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.564889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.564916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.576434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.576464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.587389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.587418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.598494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.598535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.610341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.610374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.621806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.621840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.634837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.634864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.645760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.645788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.657255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.657285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.931 [2024-11-16 16:54:50.668979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.931 [2024-11-16 16:54:50.669006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.682293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.682324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.693052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.693078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.704035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.704065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.714770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.714796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.725951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.725977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.736912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.736954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.748127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.748153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.760437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.760463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.769581] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.769629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.781870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.781896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.794873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.794899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.805886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.805916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.817142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.817167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.834573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.834601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.845019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.845049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.855478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.855507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.866678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.866706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.877322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.877349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.887989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.888017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.900560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.900586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.911880] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.911910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.919216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.919241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 00:19:05.190 Latency(us) 00:19:05.190 [2024-11-16T15:54:50.940Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:05.190 [2024-11-16T15:54:50.940Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:19:05.190 Nvme1n1 : 5.01 11558.32 90.30 0.00 0.00 11061.21 4369.07 22816.24 00:19:05.190 [2024-11-16T15:54:50.940Z] =================================================================================================================== 00:19:05.190 [2024-11-16T15:54:50.940Z] Total : 11558.32 90.30 0.00 0.00 11061.21 4369.07 22816.24 00:19:05.190 [2024-11-16 16:54:50.927019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.927047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.190 [2024-11-16 16:54:50.935036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.190 [2024-11-16 16:54:50.935064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.448 [2024-11-16 16:54:50.943106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.448 [2024-11-16 16:54:50.943155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.448 [2024-11-16 16:54:50.951129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.448 [2024-11-16 16:54:50.951183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.448 [2024-11-16 16:54:50.959139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.448 [2024-11-16 16:54:50.959187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.448 [2024-11-16 16:54:50.967161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.448 [2024-11-16 16:54:50.967208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.448 [2024-11-16 16:54:50.975178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.448 [2024-11-16 16:54:50.975225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.448 [2024-11-16 16:54:50.983224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.448 [2024-11-16 16:54:50.983275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.448 [2024-11-16 16:54:50.991229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.448 [2024-11-16 16:54:50.991277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.448 [2024-11-16 16:54:50.999274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.448 [2024-11-16 16:54:50.999324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.448 [2024-11-16 16:54:51.007294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.448 [2024-11-16 16:54:51.007344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.448 [2024-11-16 16:54:51.015315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.015365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.023341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.023389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.031368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.031418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.039390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.039436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.047391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.047435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.055387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.055412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.063432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.063469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.071480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.071525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.079494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.079540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.087479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.087506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.095512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.095544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.103559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.103614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.111575] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.111657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.119566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.119590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.127585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.127612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 [2024-11-16 16:54:51.135612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:05.449 [2024-11-16 16:54:51.135643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:05.449 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (1208206) - No such process 00:19:05.449 16:54:51 -- target/zcopy.sh@49 -- # wait 1208206 00:19:05.449 16:54:51 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:19:05.449 16:54:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:05.449 16:54:51 -- common/autotest_common.sh@10 -- # set +x 00:19:05.449 16:54:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:05.449 16:54:51 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:19:05.449 16:54:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:05.449 16:54:51 -- common/autotest_common.sh@10 -- # set +x 00:19:05.449 delay0 00:19:05.449 16:54:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:05.449 16:54:51 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:19:05.449 16:54:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:05.449 16:54:51 -- common/autotest_common.sh@10 -- # set +x 00:19:05.449 16:54:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:05.449 16:54:51 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:19:05.449 EAL: No free 2048 kB hugepages reported on node 1 00:19:05.708 [2024-11-16 16:54:51.208049] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:19:13.827 Initializing NVMe Controllers 00:19:13.827 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:13.827 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:13.827 Initialization complete. Launching workers. 00:19:13.827 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 237, failed: 21837 00:19:13.827 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 21947, failed to submit 127 00:19:13.827 success 21860, unsuccess 87, failed 0 00:19:13.827 16:54:58 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:19:13.827 16:54:58 -- target/zcopy.sh@60 -- # nvmftestfini 00:19:13.827 16:54:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:13.827 16:54:58 -- nvmf/common.sh@116 -- # sync 00:19:13.827 16:54:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:13.827 16:54:58 -- nvmf/common.sh@119 -- # set +e 00:19:13.827 16:54:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:13.827 16:54:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:13.827 rmmod nvme_tcp 00:19:13.827 rmmod nvme_fabrics 00:19:13.827 rmmod nvme_keyring 00:19:13.827 16:54:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:13.827 16:54:58 -- nvmf/common.sh@123 -- # set -e 00:19:13.827 16:54:58 -- nvmf/common.sh@124 -- # return 0 00:19:13.828 16:54:58 -- nvmf/common.sh@477 -- # '[' -n 1206818 ']' 00:19:13.828 16:54:58 -- nvmf/common.sh@478 -- # killprocess 1206818 00:19:13.828 16:54:58 -- common/autotest_common.sh@936 -- # '[' -z 1206818 ']' 00:19:13.828 16:54:58 -- common/autotest_common.sh@940 -- # kill -0 1206818 00:19:13.828 16:54:58 -- common/autotest_common.sh@941 -- # uname 00:19:13.828 16:54:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:13.828 16:54:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1206818 00:19:13.828 16:54:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:13.828 16:54:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:13.828 16:54:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1206818' 00:19:13.828 killing process with pid 1206818 00:19:13.828 16:54:58 -- common/autotest_common.sh@955 -- # kill 1206818 00:19:13.828 16:54:58 -- common/autotest_common.sh@960 -- # wait 1206818 00:19:13.828 16:54:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:13.828 16:54:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:13.828 16:54:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:13.828 16:54:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:13.828 16:54:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:13.828 16:54:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:13.828 16:54:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:13.828 16:54:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:15.211 16:55:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:15.211 00:19:15.211 real 0m29.604s 00:19:15.211 user 0m42.604s 00:19:15.211 sys 0m9.202s 00:19:15.211 16:55:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:15.211 16:55:00 -- common/autotest_common.sh@10 -- # set +x 00:19:15.211 ************************************ 00:19:15.211 END TEST nvmf_zcopy 00:19:15.211 ************************************ 00:19:15.211 16:55:00 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:15.211 16:55:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:15.211 16:55:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:15.211 16:55:00 -- common/autotest_common.sh@10 -- # set +x 00:19:15.211 ************************************ 00:19:15.211 START TEST nvmf_nmic 00:19:15.211 ************************************ 00:19:15.211 16:55:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:15.211 * Looking for test storage... 00:19:15.211 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:15.211 16:55:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:15.211 16:55:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:15.211 16:55:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:15.211 16:55:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:15.211 16:55:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:15.211 16:55:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:15.211 16:55:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:15.211 16:55:00 -- scripts/common.sh@335 -- # IFS=.-: 00:19:15.211 16:55:00 -- scripts/common.sh@335 -- # read -ra ver1 00:19:15.211 16:55:00 -- scripts/common.sh@336 -- # IFS=.-: 00:19:15.211 16:55:00 -- scripts/common.sh@336 -- # read -ra ver2 00:19:15.211 16:55:00 -- scripts/common.sh@337 -- # local 'op=<' 00:19:15.211 16:55:00 -- scripts/common.sh@339 -- # ver1_l=2 00:19:15.211 16:55:00 -- scripts/common.sh@340 -- # ver2_l=1 00:19:15.211 16:55:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:15.211 16:55:00 -- scripts/common.sh@343 -- # case "$op" in 00:19:15.211 16:55:00 -- scripts/common.sh@344 -- # : 1 00:19:15.211 16:55:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:15.211 16:55:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:15.211 16:55:00 -- scripts/common.sh@364 -- # decimal 1 00:19:15.211 16:55:00 -- scripts/common.sh@352 -- # local d=1 00:19:15.211 16:55:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:15.211 16:55:00 -- scripts/common.sh@354 -- # echo 1 00:19:15.211 16:55:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:15.211 16:55:00 -- scripts/common.sh@365 -- # decimal 2 00:19:15.211 16:55:00 -- scripts/common.sh@352 -- # local d=2 00:19:15.211 16:55:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:15.211 16:55:00 -- scripts/common.sh@354 -- # echo 2 00:19:15.211 16:55:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:15.211 16:55:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:15.211 16:55:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:15.211 16:55:00 -- scripts/common.sh@367 -- # return 0 00:19:15.211 16:55:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:15.211 16:55:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:15.211 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:15.211 --rc genhtml_branch_coverage=1 00:19:15.211 --rc genhtml_function_coverage=1 00:19:15.211 --rc genhtml_legend=1 00:19:15.211 --rc geninfo_all_blocks=1 00:19:15.211 --rc geninfo_unexecuted_blocks=1 00:19:15.211 00:19:15.211 ' 00:19:15.211 16:55:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:15.211 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:15.211 --rc genhtml_branch_coverage=1 00:19:15.211 --rc genhtml_function_coverage=1 00:19:15.211 --rc genhtml_legend=1 00:19:15.211 --rc geninfo_all_blocks=1 00:19:15.211 --rc geninfo_unexecuted_blocks=1 00:19:15.211 00:19:15.211 ' 00:19:15.211 16:55:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:15.211 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:15.211 --rc genhtml_branch_coverage=1 00:19:15.211 --rc genhtml_function_coverage=1 00:19:15.211 --rc genhtml_legend=1 00:19:15.211 --rc geninfo_all_blocks=1 00:19:15.211 --rc geninfo_unexecuted_blocks=1 00:19:15.211 00:19:15.211 ' 00:19:15.211 16:55:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:15.211 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:15.211 --rc genhtml_branch_coverage=1 00:19:15.211 --rc genhtml_function_coverage=1 00:19:15.211 --rc genhtml_legend=1 00:19:15.211 --rc geninfo_all_blocks=1 00:19:15.211 --rc geninfo_unexecuted_blocks=1 00:19:15.211 00:19:15.211 ' 00:19:15.211 16:55:00 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:15.211 16:55:00 -- nvmf/common.sh@7 -- # uname -s 00:19:15.211 16:55:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:15.211 16:55:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:15.211 16:55:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:15.211 16:55:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:15.211 16:55:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:15.211 16:55:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:15.211 16:55:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:15.211 16:55:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:15.211 16:55:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:15.211 16:55:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:15.211 16:55:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:15.211 16:55:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:15.211 16:55:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:15.211 16:55:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:15.212 16:55:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:15.212 16:55:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:15.212 16:55:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:15.212 16:55:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:15.212 16:55:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:15.212 16:55:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:15.212 16:55:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:15.212 16:55:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:15.212 16:55:00 -- paths/export.sh@5 -- # export PATH 00:19:15.212 16:55:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:15.212 16:55:00 -- nvmf/common.sh@46 -- # : 0 00:19:15.212 16:55:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:15.212 16:55:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:15.212 16:55:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:15.212 16:55:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:15.212 16:55:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:15.212 16:55:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:15.212 16:55:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:15.212 16:55:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:15.212 16:55:00 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:15.212 16:55:00 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:15.212 16:55:00 -- target/nmic.sh@14 -- # nvmftestinit 00:19:15.212 16:55:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:15.212 16:55:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:15.212 16:55:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:15.212 16:55:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:15.212 16:55:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:15.212 16:55:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:15.212 16:55:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:15.212 16:55:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:15.212 16:55:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:15.212 16:55:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:15.212 16:55:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:15.212 16:55:00 -- common/autotest_common.sh@10 -- # set +x 00:19:17.118 16:55:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:17.118 16:55:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:17.118 16:55:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:17.118 16:55:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:17.118 16:55:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:17.118 16:55:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:17.118 16:55:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:17.118 16:55:02 -- nvmf/common.sh@294 -- # net_devs=() 00:19:17.118 16:55:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:17.118 16:55:02 -- nvmf/common.sh@295 -- # e810=() 00:19:17.118 16:55:02 -- nvmf/common.sh@295 -- # local -ga e810 00:19:17.118 16:55:02 -- nvmf/common.sh@296 -- # x722=() 00:19:17.378 16:55:02 -- nvmf/common.sh@296 -- # local -ga x722 00:19:17.378 16:55:02 -- nvmf/common.sh@297 -- # mlx=() 00:19:17.378 16:55:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:17.378 16:55:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:17.378 16:55:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:17.378 16:55:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:17.378 16:55:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:17.378 16:55:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:17.378 16:55:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:17.378 16:55:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:17.378 16:55:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:17.378 16:55:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:17.378 16:55:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:17.378 16:55:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:17.378 16:55:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:17.378 16:55:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:17.378 16:55:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:17.378 16:55:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:17.378 16:55:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:17.378 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:17.378 16:55:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:17.378 16:55:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:17.378 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:17.378 16:55:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:17.378 16:55:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:17.378 16:55:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:17.378 16:55:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:17.378 16:55:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:17.378 16:55:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:17.378 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:17.378 16:55:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:17.378 16:55:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:17.378 16:55:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:17.378 16:55:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:17.378 16:55:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:17.378 16:55:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:17.378 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:17.378 16:55:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:17.378 16:55:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:17.378 16:55:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:17.378 16:55:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:17.378 16:55:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:17.378 16:55:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:17.378 16:55:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:17.378 16:55:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:17.378 16:55:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:17.378 16:55:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:17.378 16:55:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:17.378 16:55:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:17.378 16:55:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:17.378 16:55:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:17.378 16:55:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:17.378 16:55:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:17.378 16:55:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:17.378 16:55:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:17.378 16:55:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:17.378 16:55:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:17.378 16:55:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:17.378 16:55:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:17.378 16:55:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:17.378 16:55:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:17.378 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:17.378 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.159 ms 00:19:17.378 00:19:17.378 --- 10.0.0.2 ping statistics --- 00:19:17.378 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:17.378 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:19:17.378 16:55:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:17.378 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:17.378 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:19:17.378 00:19:17.378 --- 10.0.0.1 ping statistics --- 00:19:17.378 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:17.378 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:19:17.378 16:55:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:17.378 16:55:02 -- nvmf/common.sh@410 -- # return 0 00:19:17.378 16:55:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:17.378 16:55:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:17.378 16:55:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:17.378 16:55:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:17.378 16:55:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:17.378 16:55:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:17.378 16:55:03 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:17.378 16:55:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:17.378 16:55:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:17.378 16:55:03 -- common/autotest_common.sh@10 -- # set +x 00:19:17.378 16:55:03 -- nvmf/common.sh@469 -- # nvmfpid=1211776 00:19:17.378 16:55:03 -- nvmf/common.sh@470 -- # waitforlisten 1211776 00:19:17.378 16:55:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:17.378 16:55:03 -- common/autotest_common.sh@829 -- # '[' -z 1211776 ']' 00:19:17.378 16:55:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:17.378 16:55:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:17.378 16:55:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:17.378 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:17.378 16:55:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:17.378 16:55:03 -- common/autotest_common.sh@10 -- # set +x 00:19:17.378 [2024-11-16 16:55:03.058500] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:17.378 [2024-11-16 16:55:03.058576] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:17.378 EAL: No free 2048 kB hugepages reported on node 1 00:19:17.378 [2024-11-16 16:55:03.125913] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:17.638 [2024-11-16 16:55:03.221533] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:17.638 [2024-11-16 16:55:03.221706] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:17.638 [2024-11-16 16:55:03.221727] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:17.638 [2024-11-16 16:55:03.221742] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:17.638 [2024-11-16 16:55:03.221796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:17.638 [2024-11-16 16:55:03.221851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:17.638 [2024-11-16 16:55:03.221915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:17.638 [2024-11-16 16:55:03.221918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:18.576 16:55:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:18.576 16:55:04 -- common/autotest_common.sh@862 -- # return 0 00:19:18.576 16:55:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:18.576 16:55:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:18.576 16:55:04 -- common/autotest_common.sh@10 -- # set +x 00:19:18.576 16:55:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:18.576 16:55:04 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:18.576 16:55:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:18.576 16:55:04 -- common/autotest_common.sh@10 -- # set +x 00:19:18.576 [2024-11-16 16:55:04.051255] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:18.576 16:55:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:18.576 16:55:04 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:18.576 16:55:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:18.576 16:55:04 -- common/autotest_common.sh@10 -- # set +x 00:19:18.576 Malloc0 00:19:18.576 16:55:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:18.576 16:55:04 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:18.576 16:55:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:18.576 16:55:04 -- common/autotest_common.sh@10 -- # set +x 00:19:18.576 16:55:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:18.576 16:55:04 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:18.576 16:55:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:18.576 16:55:04 -- common/autotest_common.sh@10 -- # set +x 00:19:18.576 16:55:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:18.576 16:55:04 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:18.576 16:55:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:18.576 16:55:04 -- common/autotest_common.sh@10 -- # set +x 00:19:18.576 [2024-11-16 16:55:04.104645] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:18.576 16:55:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:18.576 16:55:04 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:18.576 test case1: single bdev can't be used in multiple subsystems 00:19:18.576 16:55:04 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:18.576 16:55:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:18.576 16:55:04 -- common/autotest_common.sh@10 -- # set +x 00:19:18.576 16:55:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:18.576 16:55:04 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:18.576 16:55:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:18.576 16:55:04 -- common/autotest_common.sh@10 -- # set +x 00:19:18.576 16:55:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:18.576 16:55:04 -- target/nmic.sh@28 -- # nmic_status=0 00:19:18.576 16:55:04 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:18.576 16:55:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:18.576 16:55:04 -- common/autotest_common.sh@10 -- # set +x 00:19:18.576 [2024-11-16 16:55:04.128450] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:18.576 [2024-11-16 16:55:04.128479] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:18.576 [2024-11-16 16:55:04.128509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:18.576 request: 00:19:18.576 { 00:19:18.576 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:18.576 "namespace": { 00:19:18.576 "bdev_name": "Malloc0" 00:19:18.576 }, 00:19:18.576 "method": "nvmf_subsystem_add_ns", 00:19:18.576 "req_id": 1 00:19:18.576 } 00:19:18.576 Got JSON-RPC error response 00:19:18.576 response: 00:19:18.576 { 00:19:18.576 "code": -32602, 00:19:18.576 "message": "Invalid parameters" 00:19:18.576 } 00:19:18.576 16:55:04 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:19:18.576 16:55:04 -- target/nmic.sh@29 -- # nmic_status=1 00:19:18.576 16:55:04 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:18.576 16:55:04 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:18.576 Adding namespace failed - expected result. 00:19:18.576 16:55:04 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:18.576 test case2: host connect to nvmf target in multiple paths 00:19:18.576 16:55:04 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:19:18.576 16:55:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:18.576 16:55:04 -- common/autotest_common.sh@10 -- # set +x 00:19:18.576 [2024-11-16 16:55:04.136555] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:19:18.576 16:55:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:18.576 16:55:04 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:19.147 16:55:04 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:19:19.715 16:55:05 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:19.715 16:55:05 -- common/autotest_common.sh@1187 -- # local i=0 00:19:19.715 16:55:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:19.715 16:55:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:19.715 16:55:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:21.621 16:55:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:21.621 16:55:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:21.621 16:55:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:21.621 16:55:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:21.621 16:55:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:21.621 16:55:07 -- common/autotest_common.sh@1197 -- # return 0 00:19:21.621 16:55:07 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:21.885 [global] 00:19:21.885 thread=1 00:19:21.885 invalidate=1 00:19:21.885 rw=write 00:19:21.885 time_based=1 00:19:21.885 runtime=1 00:19:21.885 ioengine=libaio 00:19:21.885 direct=1 00:19:21.885 bs=4096 00:19:21.885 iodepth=1 00:19:21.885 norandommap=0 00:19:21.885 numjobs=1 00:19:21.885 00:19:21.885 verify_dump=1 00:19:21.885 verify_backlog=512 00:19:21.885 verify_state_save=0 00:19:21.885 do_verify=1 00:19:21.885 verify=crc32c-intel 00:19:21.885 [job0] 00:19:21.885 filename=/dev/nvme0n1 00:19:21.885 Could not set queue depth (nvme0n1) 00:19:21.885 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:21.885 fio-3.35 00:19:21.886 Starting 1 thread 00:19:23.291 00:19:23.291 job0: (groupid=0, jobs=1): err= 0: pid=1212442: Sat Nov 16 16:55:08 2024 00:19:23.291 read: IOPS=158, BW=635KiB/s (650kB/s)(656KiB/1033msec) 00:19:23.291 slat (nsec): min=5357, max=65672, avg=17026.32, stdev=10907.50 00:19:23.291 clat (usec): min=195, max=41080, avg=5706.11, stdev=13919.95 00:19:23.291 lat (usec): min=206, max=41095, avg=5723.13, stdev=13921.68 00:19:23.291 clat percentiles (usec): 00:19:23.291 | 1.00th=[ 198], 5.00th=[ 204], 10.00th=[ 210], 20.00th=[ 217], 00:19:23.291 | 30.00th=[ 225], 40.00th=[ 231], 50.00th=[ 243], 60.00th=[ 262], 00:19:23.291 | 70.00th=[ 277], 80.00th=[ 297], 90.00th=[41157], 95.00th=[41157], 00:19:23.291 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:23.291 | 99.99th=[41157] 00:19:23.291 write: IOPS=495, BW=1983KiB/s (2030kB/s)(2048KiB/1033msec); 0 zone resets 00:19:23.291 slat (nsec): min=7057, max=41857, avg=15541.19, stdev=6156.20 00:19:23.291 clat (usec): min=138, max=267, avg=162.10, stdev=15.71 00:19:23.291 lat (usec): min=147, max=309, avg=177.64, stdev=16.92 00:19:23.291 clat percentiles (usec): 00:19:23.291 | 1.00th=[ 141], 5.00th=[ 147], 10.00th=[ 149], 20.00th=[ 153], 00:19:23.291 | 30.00th=[ 155], 40.00th=[ 159], 50.00th=[ 161], 60.00th=[ 163], 00:19:23.291 | 70.00th=[ 165], 80.00th=[ 167], 90.00th=[ 174], 95.00th=[ 180], 00:19:23.291 | 99.00th=[ 243], 99.50th=[ 265], 99.90th=[ 269], 99.95th=[ 269], 00:19:23.291 | 99.99th=[ 269] 00:19:23.291 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:19:23.291 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:23.291 lat (usec) : 250=88.91%, 500=7.84% 00:19:23.291 lat (msec) : 50=3.25% 00:19:23.291 cpu : usr=0.39%, sys=1.16%, ctx=676, majf=0, minf=1 00:19:23.291 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:23.291 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.291 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.291 issued rwts: total=164,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:23.291 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:23.291 00:19:23.291 Run status group 0 (all jobs): 00:19:23.291 READ: bw=635KiB/s (650kB/s), 635KiB/s-635KiB/s (650kB/s-650kB/s), io=656KiB (672kB), run=1033-1033msec 00:19:23.291 WRITE: bw=1983KiB/s (2030kB/s), 1983KiB/s-1983KiB/s (2030kB/s-2030kB/s), io=2048KiB (2097kB), run=1033-1033msec 00:19:23.291 00:19:23.291 Disk stats (read/write): 00:19:23.291 nvme0n1: ios=210/512, merge=0/0, ticks=801/78, in_queue=879, util=92.08% 00:19:23.291 16:55:08 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:23.291 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:23.291 16:55:08 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:23.291 16:55:08 -- common/autotest_common.sh@1208 -- # local i=0 00:19:23.291 16:55:08 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:23.291 16:55:08 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:23.291 16:55:08 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:23.291 16:55:08 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:23.291 16:55:08 -- common/autotest_common.sh@1220 -- # return 0 00:19:23.291 16:55:08 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:23.291 16:55:08 -- target/nmic.sh@53 -- # nvmftestfini 00:19:23.291 16:55:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:23.291 16:55:08 -- nvmf/common.sh@116 -- # sync 00:19:23.291 16:55:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:23.291 16:55:08 -- nvmf/common.sh@119 -- # set +e 00:19:23.291 16:55:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:23.291 16:55:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:23.291 rmmod nvme_tcp 00:19:23.291 rmmod nvme_fabrics 00:19:23.291 rmmod nvme_keyring 00:19:23.291 16:55:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:23.291 16:55:08 -- nvmf/common.sh@123 -- # set -e 00:19:23.291 16:55:08 -- nvmf/common.sh@124 -- # return 0 00:19:23.291 16:55:08 -- nvmf/common.sh@477 -- # '[' -n 1211776 ']' 00:19:23.291 16:55:08 -- nvmf/common.sh@478 -- # killprocess 1211776 00:19:23.291 16:55:08 -- common/autotest_common.sh@936 -- # '[' -z 1211776 ']' 00:19:23.291 16:55:08 -- common/autotest_common.sh@940 -- # kill -0 1211776 00:19:23.291 16:55:08 -- common/autotest_common.sh@941 -- # uname 00:19:23.291 16:55:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:23.291 16:55:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1211776 00:19:23.291 16:55:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:23.291 16:55:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:23.291 16:55:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1211776' 00:19:23.291 killing process with pid 1211776 00:19:23.291 16:55:08 -- common/autotest_common.sh@955 -- # kill 1211776 00:19:23.291 16:55:08 -- common/autotest_common.sh@960 -- # wait 1211776 00:19:23.551 16:55:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:23.551 16:55:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:23.551 16:55:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:23.551 16:55:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:23.551 16:55:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:23.551 16:55:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:23.551 16:55:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:23.551 16:55:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:26.096 16:55:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:26.096 00:19:26.096 real 0m10.630s 00:19:26.096 user 0m25.261s 00:19:26.096 sys 0m2.396s 00:19:26.096 16:55:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:26.096 16:55:11 -- common/autotest_common.sh@10 -- # set +x 00:19:26.096 ************************************ 00:19:26.096 END TEST nvmf_nmic 00:19:26.096 ************************************ 00:19:26.096 16:55:11 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:26.096 16:55:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:26.096 16:55:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:26.096 16:55:11 -- common/autotest_common.sh@10 -- # set +x 00:19:26.096 ************************************ 00:19:26.096 START TEST nvmf_fio_target 00:19:26.096 ************************************ 00:19:26.096 16:55:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:26.096 * Looking for test storage... 00:19:26.096 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:26.096 16:55:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:26.096 16:55:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:26.096 16:55:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:26.096 16:55:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:26.096 16:55:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:26.096 16:55:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:26.096 16:55:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:26.096 16:55:11 -- scripts/common.sh@335 -- # IFS=.-: 00:19:26.096 16:55:11 -- scripts/common.sh@335 -- # read -ra ver1 00:19:26.096 16:55:11 -- scripts/common.sh@336 -- # IFS=.-: 00:19:26.096 16:55:11 -- scripts/common.sh@336 -- # read -ra ver2 00:19:26.096 16:55:11 -- scripts/common.sh@337 -- # local 'op=<' 00:19:26.096 16:55:11 -- scripts/common.sh@339 -- # ver1_l=2 00:19:26.096 16:55:11 -- scripts/common.sh@340 -- # ver2_l=1 00:19:26.096 16:55:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:26.096 16:55:11 -- scripts/common.sh@343 -- # case "$op" in 00:19:26.096 16:55:11 -- scripts/common.sh@344 -- # : 1 00:19:26.096 16:55:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:26.096 16:55:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:26.096 16:55:11 -- scripts/common.sh@364 -- # decimal 1 00:19:26.096 16:55:11 -- scripts/common.sh@352 -- # local d=1 00:19:26.096 16:55:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:26.096 16:55:11 -- scripts/common.sh@354 -- # echo 1 00:19:26.096 16:55:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:26.096 16:55:11 -- scripts/common.sh@365 -- # decimal 2 00:19:26.096 16:55:11 -- scripts/common.sh@352 -- # local d=2 00:19:26.096 16:55:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:26.096 16:55:11 -- scripts/common.sh@354 -- # echo 2 00:19:26.096 16:55:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:26.096 16:55:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:26.096 16:55:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:26.096 16:55:11 -- scripts/common.sh@367 -- # return 0 00:19:26.096 16:55:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:26.096 16:55:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:26.096 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:26.096 --rc genhtml_branch_coverage=1 00:19:26.096 --rc genhtml_function_coverage=1 00:19:26.096 --rc genhtml_legend=1 00:19:26.096 --rc geninfo_all_blocks=1 00:19:26.096 --rc geninfo_unexecuted_blocks=1 00:19:26.096 00:19:26.096 ' 00:19:26.096 16:55:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:26.096 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:26.096 --rc genhtml_branch_coverage=1 00:19:26.096 --rc genhtml_function_coverage=1 00:19:26.096 --rc genhtml_legend=1 00:19:26.096 --rc geninfo_all_blocks=1 00:19:26.096 --rc geninfo_unexecuted_blocks=1 00:19:26.096 00:19:26.096 ' 00:19:26.096 16:55:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:26.096 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:26.096 --rc genhtml_branch_coverage=1 00:19:26.096 --rc genhtml_function_coverage=1 00:19:26.096 --rc genhtml_legend=1 00:19:26.096 --rc geninfo_all_blocks=1 00:19:26.096 --rc geninfo_unexecuted_blocks=1 00:19:26.096 00:19:26.096 ' 00:19:26.096 16:55:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:26.096 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:26.096 --rc genhtml_branch_coverage=1 00:19:26.096 --rc genhtml_function_coverage=1 00:19:26.096 --rc genhtml_legend=1 00:19:26.096 --rc geninfo_all_blocks=1 00:19:26.096 --rc geninfo_unexecuted_blocks=1 00:19:26.096 00:19:26.096 ' 00:19:26.096 16:55:11 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:26.096 16:55:11 -- nvmf/common.sh@7 -- # uname -s 00:19:26.096 16:55:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:26.096 16:55:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:26.096 16:55:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:26.096 16:55:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:26.096 16:55:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:26.096 16:55:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:26.096 16:55:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:26.096 16:55:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:26.097 16:55:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:26.097 16:55:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:26.097 16:55:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:26.097 16:55:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:26.097 16:55:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:26.097 16:55:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:26.097 16:55:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:26.097 16:55:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:26.097 16:55:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:26.097 16:55:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:26.097 16:55:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:26.097 16:55:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:26.097 16:55:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:26.097 16:55:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:26.097 16:55:11 -- paths/export.sh@5 -- # export PATH 00:19:26.097 16:55:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:26.097 16:55:11 -- nvmf/common.sh@46 -- # : 0 00:19:26.097 16:55:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:26.097 16:55:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:26.097 16:55:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:26.097 16:55:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:26.097 16:55:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:26.097 16:55:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:26.097 16:55:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:26.097 16:55:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:26.097 16:55:11 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:26.097 16:55:11 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:26.097 16:55:11 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:26.097 16:55:11 -- target/fio.sh@16 -- # nvmftestinit 00:19:26.097 16:55:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:26.097 16:55:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:26.097 16:55:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:26.097 16:55:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:26.097 16:55:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:26.097 16:55:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:26.097 16:55:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:26.097 16:55:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:26.097 16:55:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:26.097 16:55:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:26.097 16:55:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:26.097 16:55:11 -- common/autotest_common.sh@10 -- # set +x 00:19:28.005 16:55:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:28.005 16:55:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:28.005 16:55:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:28.005 16:55:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:28.005 16:55:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:28.005 16:55:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:28.005 16:55:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:28.005 16:55:13 -- nvmf/common.sh@294 -- # net_devs=() 00:19:28.005 16:55:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:28.005 16:55:13 -- nvmf/common.sh@295 -- # e810=() 00:19:28.005 16:55:13 -- nvmf/common.sh@295 -- # local -ga e810 00:19:28.005 16:55:13 -- nvmf/common.sh@296 -- # x722=() 00:19:28.005 16:55:13 -- nvmf/common.sh@296 -- # local -ga x722 00:19:28.005 16:55:13 -- nvmf/common.sh@297 -- # mlx=() 00:19:28.005 16:55:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:28.005 16:55:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:28.005 16:55:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:28.005 16:55:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:28.005 16:55:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:28.005 16:55:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:28.005 16:55:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:28.005 16:55:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:28.005 16:55:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:28.005 16:55:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:28.005 16:55:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:28.005 16:55:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:28.005 16:55:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:28.005 16:55:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:28.005 16:55:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:28.005 16:55:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:28.005 16:55:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:28.005 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:28.005 16:55:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:28.005 16:55:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:28.005 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:28.005 16:55:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:28.005 16:55:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:28.005 16:55:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:28.005 16:55:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:28.005 16:55:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:28.005 16:55:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:28.005 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:28.005 16:55:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:28.005 16:55:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:28.005 16:55:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:28.005 16:55:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:28.005 16:55:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:28.005 16:55:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:28.005 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:28.005 16:55:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:28.005 16:55:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:28.005 16:55:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:28.005 16:55:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:28.005 16:55:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:28.005 16:55:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:28.005 16:55:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:28.005 16:55:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:28.005 16:55:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:28.005 16:55:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:28.005 16:55:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:28.005 16:55:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:28.005 16:55:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:28.005 16:55:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:28.005 16:55:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:28.005 16:55:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:28.005 16:55:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:28.005 16:55:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:28.005 16:55:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:28.005 16:55:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:28.005 16:55:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:28.005 16:55:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:28.005 16:55:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:28.005 16:55:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:28.005 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:28.005 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.248 ms 00:19:28.005 00:19:28.005 --- 10.0.0.2 ping statistics --- 00:19:28.005 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:28.005 rtt min/avg/max/mdev = 0.248/0.248/0.248/0.000 ms 00:19:28.005 16:55:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:28.005 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:28.005 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:19:28.005 00:19:28.005 --- 10.0.0.1 ping statistics --- 00:19:28.005 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:28.005 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:19:28.005 16:55:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:28.005 16:55:13 -- nvmf/common.sh@410 -- # return 0 00:19:28.005 16:55:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:28.005 16:55:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:28.005 16:55:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:28.005 16:55:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:28.005 16:55:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:28.005 16:55:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:28.005 16:55:13 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:28.005 16:55:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:28.005 16:55:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:28.005 16:55:13 -- common/autotest_common.sh@10 -- # set +x 00:19:28.005 16:55:13 -- nvmf/common.sh@469 -- # nvmfpid=1214537 00:19:28.005 16:55:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:28.005 16:55:13 -- nvmf/common.sh@470 -- # waitforlisten 1214537 00:19:28.005 16:55:13 -- common/autotest_common.sh@829 -- # '[' -z 1214537 ']' 00:19:28.005 16:55:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:28.005 16:55:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:28.005 16:55:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:28.005 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:28.006 16:55:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:28.006 16:55:13 -- common/autotest_common.sh@10 -- # set +x 00:19:28.006 [2024-11-16 16:55:13.595174] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:28.006 [2024-11-16 16:55:13.595254] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:28.006 EAL: No free 2048 kB hugepages reported on node 1 00:19:28.006 [2024-11-16 16:55:13.667356] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:28.264 [2024-11-16 16:55:13.758754] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:28.264 [2024-11-16 16:55:13.758908] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:28.264 [2024-11-16 16:55:13.758929] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:28.264 [2024-11-16 16:55:13.758944] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:28.264 [2024-11-16 16:55:13.759001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:28.264 [2024-11-16 16:55:13.759058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:28.264 [2024-11-16 16:55:13.759113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:28.264 [2024-11-16 16:55:13.759115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:29.198 16:55:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:29.198 16:55:14 -- common/autotest_common.sh@862 -- # return 0 00:19:29.198 16:55:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:29.198 16:55:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:29.198 16:55:14 -- common/autotest_common.sh@10 -- # set +x 00:19:29.198 16:55:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:29.198 16:55:14 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:29.198 [2024-11-16 16:55:14.842144] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:29.198 16:55:14 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:29.457 16:55:15 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:29.457 16:55:15 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:29.715 16:55:15 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:29.715 16:55:15 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:29.973 16:55:15 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:29.973 16:55:15 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:30.231 16:55:15 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:30.231 16:55:15 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:30.488 16:55:16 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:30.746 16:55:16 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:30.746 16:55:16 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:31.311 16:55:16 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:31.311 16:55:16 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:31.311 16:55:17 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:31.311 16:55:17 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:31.569 16:55:17 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:31.827 16:55:17 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:31.827 16:55:17 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:32.085 16:55:17 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:32.085 16:55:17 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:32.342 16:55:18 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:32.600 [2024-11-16 16:55:18.301345] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:32.600 16:55:18 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:32.857 16:55:18 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:33.115 16:55:18 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:34.046 16:55:19 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:34.046 16:55:19 -- common/autotest_common.sh@1187 -- # local i=0 00:19:34.046 16:55:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:34.046 16:55:19 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:34.046 16:55:19 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:34.046 16:55:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:35.945 16:55:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:35.945 16:55:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:35.945 16:55:21 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:35.945 16:55:21 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:35.945 16:55:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:35.945 16:55:21 -- common/autotest_common.sh@1197 -- # return 0 00:19:35.945 16:55:21 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:35.945 [global] 00:19:35.945 thread=1 00:19:35.945 invalidate=1 00:19:35.945 rw=write 00:19:35.945 time_based=1 00:19:35.945 runtime=1 00:19:35.945 ioengine=libaio 00:19:35.945 direct=1 00:19:35.945 bs=4096 00:19:35.945 iodepth=1 00:19:35.945 norandommap=0 00:19:35.945 numjobs=1 00:19:35.945 00:19:35.945 verify_dump=1 00:19:35.945 verify_backlog=512 00:19:35.945 verify_state_save=0 00:19:35.945 do_verify=1 00:19:35.945 verify=crc32c-intel 00:19:35.945 [job0] 00:19:35.945 filename=/dev/nvme0n1 00:19:35.945 [job1] 00:19:35.945 filename=/dev/nvme0n2 00:19:35.945 [job2] 00:19:35.945 filename=/dev/nvme0n3 00:19:35.945 [job3] 00:19:35.945 filename=/dev/nvme0n4 00:19:35.945 Could not set queue depth (nvme0n1) 00:19:35.945 Could not set queue depth (nvme0n2) 00:19:35.945 Could not set queue depth (nvme0n3) 00:19:35.945 Could not set queue depth (nvme0n4) 00:19:36.202 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:36.202 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:36.202 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:36.202 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:36.202 fio-3.35 00:19:36.202 Starting 4 threads 00:19:37.573 00:19:37.573 job0: (groupid=0, jobs=1): err= 0: pid=1215643: Sat Nov 16 16:55:22 2024 00:19:37.573 read: IOPS=201, BW=805KiB/s (824kB/s)(828KiB/1029msec) 00:19:37.573 slat (nsec): min=5941, max=34207, avg=8777.09, stdev=6585.82 00:19:37.573 clat (usec): min=186, max=41012, avg=4352.13, stdev=12313.43 00:19:37.573 lat (usec): min=193, max=41041, avg=4360.91, stdev=12318.77 00:19:37.573 clat percentiles (usec): 00:19:37.573 | 1.00th=[ 192], 5.00th=[ 196], 10.00th=[ 200], 20.00th=[ 206], 00:19:37.573 | 30.00th=[ 210], 40.00th=[ 217], 50.00th=[ 223], 60.00th=[ 229], 00:19:37.573 | 70.00th=[ 241], 80.00th=[ 255], 90.00th=[40109], 95.00th=[41157], 00:19:37.573 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:37.573 | 99.99th=[41157] 00:19:37.573 write: IOPS=497, BW=1990KiB/s (2038kB/s)(2048KiB/1029msec); 0 zone resets 00:19:37.573 slat (usec): min=7, max=912, avg=12.41, stdev=44.09 00:19:37.573 clat (usec): min=141, max=682, avg=229.44, stdev=40.80 00:19:37.573 lat (usec): min=149, max=1084, avg=241.85, stdev=60.20 00:19:37.573 clat percentiles (usec): 00:19:37.573 | 1.00th=[ 153], 5.00th=[ 194], 10.00th=[ 204], 20.00th=[ 212], 00:19:37.573 | 30.00th=[ 215], 40.00th=[ 219], 50.00th=[ 223], 60.00th=[ 227], 00:19:37.573 | 70.00th=[ 233], 80.00th=[ 239], 90.00th=[ 251], 95.00th=[ 302], 00:19:37.573 | 99.00th=[ 396], 99.50th=[ 416], 99.90th=[ 685], 99.95th=[ 685], 00:19:37.573 | 99.99th=[ 685] 00:19:37.573 bw ( KiB/s): min= 4096, max= 4096, per=22.87%, avg=4096.00, stdev= 0.00, samples=1 00:19:37.573 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:37.573 lat (usec) : 250=85.40%, 500=11.54%, 750=0.14% 00:19:37.573 lat (msec) : 50=2.92% 00:19:37.573 cpu : usr=0.78%, sys=0.39%, ctx=723, majf=0, minf=1 00:19:37.573 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:37.573 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.573 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.573 issued rwts: total=207,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:37.573 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:37.573 job1: (groupid=0, jobs=1): err= 0: pid=1215644: Sat Nov 16 16:55:22 2024 00:19:37.573 read: IOPS=21, BW=86.0KiB/s (88.1kB/s)(88.0KiB/1023msec) 00:19:37.573 slat (nsec): min=7618, max=36101, avg=25443.09, stdev=11167.74 00:19:37.573 clat (usec): min=40399, max=41583, avg=40962.68, stdev=185.40 00:19:37.573 lat (usec): min=40412, max=41596, avg=40988.12, stdev=185.41 00:19:37.573 clat percentiles (usec): 00:19:37.573 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:19:37.573 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:37.573 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:37.573 | 99.00th=[41681], 99.50th=[41681], 99.90th=[41681], 99.95th=[41681], 00:19:37.573 | 99.99th=[41681] 00:19:37.573 write: IOPS=500, BW=2002KiB/s (2050kB/s)(2048KiB/1023msec); 0 zone resets 00:19:37.573 slat (nsec): min=7651, max=32467, avg=9265.05, stdev=2540.28 00:19:37.573 clat (usec): min=143, max=374, avg=223.72, stdev=26.85 00:19:37.573 lat (usec): min=153, max=401, avg=232.99, stdev=27.00 00:19:37.573 clat percentiles (usec): 00:19:37.573 | 1.00th=[ 155], 5.00th=[ 188], 10.00th=[ 200], 20.00th=[ 208], 00:19:37.573 | 30.00th=[ 215], 40.00th=[ 219], 50.00th=[ 223], 60.00th=[ 227], 00:19:37.573 | 70.00th=[ 231], 80.00th=[ 239], 90.00th=[ 247], 95.00th=[ 262], 00:19:37.573 | 99.00th=[ 330], 99.50th=[ 351], 99.90th=[ 375], 99.95th=[ 375], 00:19:37.573 | 99.99th=[ 375] 00:19:37.573 bw ( KiB/s): min= 4096, max= 4096, per=22.87%, avg=4096.00, stdev= 0.00, samples=1 00:19:37.574 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:37.574 lat (usec) : 250=88.20%, 500=7.68% 00:19:37.574 lat (msec) : 50=4.12% 00:19:37.574 cpu : usr=0.29%, sys=0.68%, ctx=535, majf=0, minf=1 00:19:37.574 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:37.574 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.574 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.574 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:37.574 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:37.574 job2: (groupid=0, jobs=1): err= 0: pid=1215645: Sat Nov 16 16:55:22 2024 00:19:37.574 read: IOPS=1006, BW=4027KiB/s (4124kB/s)(4128KiB/1025msec) 00:19:37.574 slat (nsec): min=6876, max=31791, avg=8574.05, stdev=2546.29 00:19:37.574 clat (usec): min=200, max=41037, avg=665.86, stdev=3567.04 00:19:37.574 lat (usec): min=208, max=41051, avg=674.44, stdev=3567.55 00:19:37.574 clat percentiles (usec): 00:19:37.574 | 1.00th=[ 212], 5.00th=[ 235], 10.00th=[ 258], 20.00th=[ 269], 00:19:37.574 | 30.00th=[ 277], 40.00th=[ 285], 50.00th=[ 297], 60.00th=[ 343], 00:19:37.574 | 70.00th=[ 429], 80.00th=[ 486], 90.00th=[ 510], 95.00th=[ 537], 00:19:37.574 | 99.00th=[ 578], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:37.574 | 99.99th=[41157] 00:19:37.574 write: IOPS=1498, BW=5994KiB/s (6138kB/s)(6144KiB/1025msec); 0 zone resets 00:19:37.574 slat (nsec): min=8883, max=46515, avg=10205.10, stdev=1874.17 00:19:37.574 clat (usec): min=130, max=344, avg=199.26, stdev=29.85 00:19:37.574 lat (usec): min=139, max=354, avg=209.47, stdev=29.95 00:19:37.574 clat percentiles (usec): 00:19:37.574 | 1.00th=[ 139], 5.00th=[ 145], 10.00th=[ 157], 20.00th=[ 178], 00:19:37.574 | 30.00th=[ 188], 40.00th=[ 192], 50.00th=[ 198], 60.00th=[ 208], 00:19:37.574 | 70.00th=[ 215], 80.00th=[ 223], 90.00th=[ 235], 95.00th=[ 245], 00:19:37.574 | 99.00th=[ 277], 99.50th=[ 285], 99.90th=[ 314], 99.95th=[ 347], 00:19:37.574 | 99.99th=[ 347] 00:19:37.574 bw ( KiB/s): min= 4096, max= 8192, per=34.30%, avg=6144.00, stdev=2896.31, samples=2 00:19:37.574 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:19:37.574 lat (usec) : 250=60.51%, 500=33.61%, 750=5.57% 00:19:37.574 lat (msec) : 50=0.31% 00:19:37.574 cpu : usr=1.95%, sys=2.93%, ctx=2570, majf=0, minf=1 00:19:37.574 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:37.574 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.574 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.574 issued rwts: total=1032,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:37.574 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:37.574 job3: (groupid=0, jobs=1): err= 0: pid=1215646: Sat Nov 16 16:55:22 2024 00:19:37.574 read: IOPS=1755, BW=7021KiB/s (7189kB/s)(7028KiB/1001msec) 00:19:37.574 slat (nsec): min=5825, max=47609, avg=13692.41, stdev=6208.00 00:19:37.574 clat (usec): min=180, max=639, avg=282.30, stdev=75.22 00:19:37.574 lat (usec): min=187, max=650, avg=295.99, stdev=74.29 00:19:37.574 clat percentiles (usec): 00:19:37.574 | 1.00th=[ 200], 5.00th=[ 219], 10.00th=[ 229], 20.00th=[ 237], 00:19:37.574 | 30.00th=[ 243], 40.00th=[ 249], 50.00th=[ 258], 60.00th=[ 269], 00:19:37.574 | 70.00th=[ 281], 80.00th=[ 306], 90.00th=[ 367], 95.00th=[ 474], 00:19:37.574 | 99.00th=[ 570], 99.50th=[ 594], 99.90th=[ 635], 99.95th=[ 644], 00:19:37.574 | 99.99th=[ 644] 00:19:37.574 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:37.574 slat (nsec): min=6987, max=74750, avg=17103.34, stdev=9012.70 00:19:37.574 clat (usec): min=125, max=1058, avg=209.02, stdev=57.86 00:19:37.574 lat (usec): min=134, max=1066, avg=226.12, stdev=60.59 00:19:37.574 clat percentiles (usec): 00:19:37.574 | 1.00th=[ 133], 5.00th=[ 145], 10.00th=[ 163], 20.00th=[ 176], 00:19:37.574 | 30.00th=[ 182], 40.00th=[ 186], 50.00th=[ 192], 60.00th=[ 204], 00:19:37.574 | 70.00th=[ 217], 80.00th=[ 233], 90.00th=[ 289], 95.00th=[ 314], 00:19:37.574 | 99.00th=[ 424], 99.50th=[ 449], 99.90th=[ 474], 99.95th=[ 734], 00:19:37.574 | 99.99th=[ 1057] 00:19:37.574 bw ( KiB/s): min= 8192, max= 8192, per=45.73%, avg=8192.00, stdev= 0.00, samples=1 00:19:37.574 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:37.574 lat (usec) : 250=64.73%, 500=33.59%, 750=1.66% 00:19:37.574 lat (msec) : 2=0.03% 00:19:37.574 cpu : usr=4.10%, sys=7.90%, ctx=3806, majf=0, minf=1 00:19:37.574 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:37.574 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.574 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.574 issued rwts: total=1757,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:37.574 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:37.574 00:19:37.574 Run status group 0 (all jobs): 00:19:37.574 READ: bw=11.5MiB/s (12.0MB/s), 86.0KiB/s-7021KiB/s (88.1kB/s-7189kB/s), io=11.8MiB (12.4MB), run=1001-1029msec 00:19:37.574 WRITE: bw=17.5MiB/s (18.3MB/s), 1990KiB/s-8184KiB/s (2038kB/s-8380kB/s), io=18.0MiB (18.9MB), run=1001-1029msec 00:19:37.574 00:19:37.574 Disk stats (read/write): 00:19:37.574 nvme0n1: ios=259/512, merge=0/0, ticks=868/112, in_queue=980, util=98.20% 00:19:37.574 nvme0n2: ios=67/512, merge=0/0, ticks=889/115, in_queue=1004, util=98.47% 00:19:37.574 nvme0n3: ios=1085/1536, merge=0/0, ticks=915/295, in_queue=1210, util=98.33% 00:19:37.574 nvme0n4: ios=1594/1633, merge=0/0, ticks=700/328, in_queue=1028, util=98.32% 00:19:37.574 16:55:22 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:37.574 [global] 00:19:37.574 thread=1 00:19:37.574 invalidate=1 00:19:37.574 rw=randwrite 00:19:37.574 time_based=1 00:19:37.574 runtime=1 00:19:37.574 ioengine=libaio 00:19:37.574 direct=1 00:19:37.574 bs=4096 00:19:37.574 iodepth=1 00:19:37.574 norandommap=0 00:19:37.574 numjobs=1 00:19:37.574 00:19:37.574 verify_dump=1 00:19:37.574 verify_backlog=512 00:19:37.574 verify_state_save=0 00:19:37.574 do_verify=1 00:19:37.574 verify=crc32c-intel 00:19:37.574 [job0] 00:19:37.574 filename=/dev/nvme0n1 00:19:37.574 [job1] 00:19:37.574 filename=/dev/nvme0n2 00:19:37.574 [job2] 00:19:37.574 filename=/dev/nvme0n3 00:19:37.574 [job3] 00:19:37.574 filename=/dev/nvme0n4 00:19:37.574 Could not set queue depth (nvme0n1) 00:19:37.574 Could not set queue depth (nvme0n2) 00:19:37.574 Could not set queue depth (nvme0n3) 00:19:37.574 Could not set queue depth (nvme0n4) 00:19:37.574 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.574 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.574 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.574 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.574 fio-3.35 00:19:37.574 Starting 4 threads 00:19:38.991 00:19:38.991 job0: (groupid=0, jobs=1): err= 0: pid=1215998: Sat Nov 16 16:55:24 2024 00:19:38.991 read: IOPS=2218, BW=8875KiB/s (9088kB/s)(8884KiB/1001msec) 00:19:38.991 slat (nsec): min=5143, max=59867, avg=9729.24, stdev=5124.40 00:19:38.991 clat (usec): min=176, max=778, avg=230.16, stdev=47.45 00:19:38.991 lat (usec): min=182, max=788, avg=239.89, stdev=49.56 00:19:38.991 clat percentiles (usec): 00:19:38.991 | 1.00th=[ 182], 5.00th=[ 188], 10.00th=[ 192], 20.00th=[ 198], 00:19:38.991 | 30.00th=[ 202], 40.00th=[ 210], 50.00th=[ 223], 60.00th=[ 231], 00:19:38.991 | 70.00th=[ 241], 80.00th=[ 253], 90.00th=[ 273], 95.00th=[ 289], 00:19:38.991 | 99.00th=[ 449], 99.50th=[ 510], 99.90th=[ 619], 99.95th=[ 709], 00:19:38.991 | 99.99th=[ 775] 00:19:38.991 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:19:38.991 slat (nsec): min=6405, max=54618, avg=11925.10, stdev=6211.94 00:19:38.991 clat (usec): min=131, max=325, avg=164.28, stdev=21.90 00:19:38.991 lat (usec): min=137, max=334, avg=176.20, stdev=25.30 00:19:38.991 clat percentiles (usec): 00:19:38.991 | 1.00th=[ 135], 5.00th=[ 139], 10.00th=[ 141], 20.00th=[ 145], 00:19:38.991 | 30.00th=[ 149], 40.00th=[ 155], 50.00th=[ 161], 60.00th=[ 169], 00:19:38.991 | 70.00th=[ 176], 80.00th=[ 180], 90.00th=[ 188], 95.00th=[ 200], 00:19:38.991 | 99.00th=[ 241], 99.50th=[ 253], 99.90th=[ 281], 99.95th=[ 293], 00:19:38.991 | 99.99th=[ 326] 00:19:38.991 bw ( KiB/s): min=12288, max=12288, per=75.75%, avg=12288.00, stdev= 0.00, samples=1 00:19:38.991 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=1 00:19:38.991 lat (usec) : 250=89.44%, 500=10.31%, 750=0.23%, 1000=0.02% 00:19:38.991 cpu : usr=4.50%, sys=6.70%, ctx=4781, majf=0, minf=1 00:19:38.991 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.991 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.991 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.991 issued rwts: total=2221,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.991 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.991 job1: (groupid=0, jobs=1): err= 0: pid=1215999: Sat Nov 16 16:55:24 2024 00:19:38.991 read: IOPS=278, BW=1113KiB/s (1140kB/s)(1124KiB/1010msec) 00:19:38.991 slat (nsec): min=4764, max=36780, avg=8205.69, stdev=5763.04 00:19:38.991 clat (usec): min=181, max=42019, avg=3248.33, stdev=10681.44 00:19:38.991 lat (usec): min=186, max=42037, avg=3256.53, stdev=10684.87 00:19:38.991 clat percentiles (usec): 00:19:38.991 | 1.00th=[ 198], 5.00th=[ 239], 10.00th=[ 241], 20.00th=[ 245], 00:19:38.991 | 30.00th=[ 249], 40.00th=[ 251], 50.00th=[ 255], 60.00th=[ 260], 00:19:38.991 | 70.00th=[ 269], 80.00th=[ 302], 90.00th=[ 502], 95.00th=[41681], 00:19:38.991 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:38.991 | 99.99th=[42206] 00:19:38.991 write: IOPS=506, BW=2028KiB/s (2076kB/s)(2048KiB/1010msec); 0 zone resets 00:19:38.991 slat (nsec): min=6876, max=39119, avg=8784.67, stdev=2347.50 00:19:38.991 clat (usec): min=131, max=295, avg=171.40, stdev=28.45 00:19:38.991 lat (usec): min=140, max=306, avg=180.18, stdev=28.30 00:19:38.991 clat percentiles (usec): 00:19:38.991 | 1.00th=[ 141], 5.00th=[ 145], 10.00th=[ 147], 20.00th=[ 153], 00:19:38.991 | 30.00th=[ 155], 40.00th=[ 159], 50.00th=[ 161], 60.00th=[ 165], 00:19:38.991 | 70.00th=[ 172], 80.00th=[ 182], 90.00th=[ 225], 95.00th=[ 233], 00:19:38.991 | 99.00th=[ 245], 99.50th=[ 247], 99.90th=[ 297], 99.95th=[ 297], 00:19:38.991 | 99.99th=[ 297] 00:19:38.991 bw ( KiB/s): min= 4096, max= 4096, per=25.25%, avg=4096.00, stdev= 0.00, samples=1 00:19:38.991 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:38.991 lat (usec) : 250=77.18%, 500=18.92%, 750=1.13%, 1000=0.13% 00:19:38.991 lat (msec) : 10=0.13%, 50=2.52% 00:19:38.991 cpu : usr=0.50%, sys=0.69%, ctx=794, majf=0, minf=1 00:19:38.991 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.991 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.991 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.991 issued rwts: total=281,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.991 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.991 job2: (groupid=0, jobs=1): err= 0: pid=1216001: Sat Nov 16 16:55:24 2024 00:19:38.991 read: IOPS=45, BW=184KiB/s (188kB/s)(184KiB/1001msec) 00:19:38.991 slat (nsec): min=7066, max=34351, avg=16338.80, stdev=7555.87 00:19:38.991 clat (usec): min=208, max=42017, avg=19286.00, stdev=20963.59 00:19:38.991 lat (usec): min=225, max=42034, avg=19302.34, stdev=20966.97 00:19:38.991 clat percentiles (usec): 00:19:38.991 | 1.00th=[ 208], 5.00th=[ 223], 10.00th=[ 225], 20.00th=[ 249], 00:19:38.991 | 30.00th=[ 293], 40.00th=[ 310], 50.00th=[ 343], 60.00th=[41681], 00:19:38.991 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:38.991 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:38.991 | 99.99th=[42206] 00:19:38.991 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:19:38.991 slat (nsec): min=6082, max=50468, avg=7823.72, stdev=2811.16 00:19:38.991 clat (usec): min=143, max=385, avg=209.05, stdev=25.73 00:19:38.991 lat (usec): min=149, max=436, avg=216.87, stdev=26.55 00:19:38.991 clat percentiles (usec): 00:19:38.991 | 1.00th=[ 159], 5.00th=[ 172], 10.00th=[ 178], 20.00th=[ 188], 00:19:38.991 | 30.00th=[ 194], 40.00th=[ 202], 50.00th=[ 208], 60.00th=[ 219], 00:19:38.991 | 70.00th=[ 225], 80.00th=[ 231], 90.00th=[ 237], 95.00th=[ 245], 00:19:38.991 | 99.00th=[ 258], 99.50th=[ 293], 99.90th=[ 388], 99.95th=[ 388], 00:19:38.991 | 99.99th=[ 388] 00:19:38.991 bw ( KiB/s): min= 4096, max= 4096, per=25.25%, avg=4096.00, stdev= 0.00, samples=1 00:19:38.991 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:38.991 lat (usec) : 250=91.04%, 500=5.20% 00:19:38.991 lat (msec) : 50=3.76% 00:19:38.991 cpu : usr=0.20%, sys=0.40%, ctx=558, majf=0, minf=2 00:19:38.991 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.991 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.991 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.991 issued rwts: total=46,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.991 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.991 job3: (groupid=0, jobs=1): err= 0: pid=1216003: Sat Nov 16 16:55:24 2024 00:19:38.991 read: IOPS=115, BW=463KiB/s (474kB/s)(468KiB/1010msec) 00:19:38.992 slat (nsec): min=6143, max=36169, avg=15662.32, stdev=6860.68 00:19:38.992 clat (usec): min=196, max=42034, avg=7746.43, stdev=16009.02 00:19:38.992 lat (usec): min=215, max=42053, avg=7762.09, stdev=16010.89 00:19:38.992 clat percentiles (usec): 00:19:38.992 | 1.00th=[ 198], 5.00th=[ 215], 10.00th=[ 221], 20.00th=[ 231], 00:19:38.992 | 30.00th=[ 273], 40.00th=[ 297], 50.00th=[ 310], 60.00th=[ 326], 00:19:38.992 | 70.00th=[ 347], 80.00th=[ 383], 90.00th=[42206], 95.00th=[42206], 00:19:38.992 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:38.992 | 99.99th=[42206] 00:19:38.992 write: IOPS=506, BW=2028KiB/s (2076kB/s)(2048KiB/1010msec); 0 zone resets 00:19:38.992 slat (nsec): min=6596, max=28732, avg=8054.42, stdev=2475.44 00:19:38.992 clat (usec): min=151, max=274, avg=186.70, stdev=16.25 00:19:38.992 lat (usec): min=159, max=293, avg=194.75, stdev=16.82 00:19:38.992 clat percentiles (usec): 00:19:38.992 | 1.00th=[ 155], 5.00th=[ 163], 10.00th=[ 165], 20.00th=[ 174], 00:19:38.992 | 30.00th=[ 178], 40.00th=[ 184], 50.00th=[ 188], 60.00th=[ 190], 00:19:38.992 | 70.00th=[ 194], 80.00th=[ 200], 90.00th=[ 206], 95.00th=[ 212], 00:19:38.992 | 99.00th=[ 225], 99.50th=[ 262], 99.90th=[ 277], 99.95th=[ 277], 00:19:38.992 | 99.99th=[ 277] 00:19:38.992 bw ( KiB/s): min= 4096, max= 4096, per=25.25%, avg=4096.00, stdev= 0.00, samples=1 00:19:38.992 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:38.992 lat (usec) : 250=85.85%, 500=10.65%, 750=0.16% 00:19:38.992 lat (msec) : 50=3.34% 00:19:38.992 cpu : usr=0.30%, sys=0.50%, ctx=630, majf=0, minf=1 00:19:38.992 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.992 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.992 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.992 issued rwts: total=117,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.992 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.992 00:19:38.992 Run status group 0 (all jobs): 00:19:38.992 READ: bw=10.3MiB/s (10.8MB/s), 184KiB/s-8875KiB/s (188kB/s-9088kB/s), io=10.4MiB (10.9MB), run=1001-1010msec 00:19:38.992 WRITE: bw=15.8MiB/s (16.6MB/s), 2028KiB/s-9.99MiB/s (2076kB/s-10.5MB/s), io=16.0MiB (16.8MB), run=1001-1010msec 00:19:38.992 00:19:38.992 Disk stats (read/write): 00:19:38.992 nvme0n1: ios=2080/2048, merge=0/0, ticks=472/316, in_queue=788, util=86.87% 00:19:38.992 nvme0n2: ios=316/512, merge=0/0, ticks=1760/89, in_queue=1849, util=96.44% 00:19:38.992 nvme0n3: ios=17/512, merge=0/0, ticks=713/106, in_queue=819, util=88.91% 00:19:38.992 nvme0n4: ios=158/512, merge=0/0, ticks=976/95, in_queue=1071, util=97.89% 00:19:38.992 16:55:24 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:38.992 [global] 00:19:38.992 thread=1 00:19:38.992 invalidate=1 00:19:38.992 rw=write 00:19:38.992 time_based=1 00:19:38.992 runtime=1 00:19:38.992 ioengine=libaio 00:19:38.992 direct=1 00:19:38.992 bs=4096 00:19:38.992 iodepth=128 00:19:38.992 norandommap=0 00:19:38.992 numjobs=1 00:19:38.992 00:19:38.992 verify_dump=1 00:19:38.992 verify_backlog=512 00:19:38.992 verify_state_save=0 00:19:38.992 do_verify=1 00:19:38.992 verify=crc32c-intel 00:19:38.992 [job0] 00:19:38.992 filename=/dev/nvme0n1 00:19:38.992 [job1] 00:19:38.992 filename=/dev/nvme0n2 00:19:38.992 [job2] 00:19:38.992 filename=/dev/nvme0n3 00:19:38.992 [job3] 00:19:38.992 filename=/dev/nvme0n4 00:19:38.992 Could not set queue depth (nvme0n1) 00:19:38.992 Could not set queue depth (nvme0n2) 00:19:38.992 Could not set queue depth (nvme0n3) 00:19:38.992 Could not set queue depth (nvme0n4) 00:19:38.992 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.992 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.992 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.992 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.992 fio-3.35 00:19:38.992 Starting 4 threads 00:19:40.417 00:19:40.417 job0: (groupid=0, jobs=1): err= 0: pid=1216240: Sat Nov 16 16:55:25 2024 00:19:40.417 read: IOPS=5400, BW=21.1MiB/s (22.1MB/s)(21.2MiB/1003msec) 00:19:40.417 slat (usec): min=2, max=14822, avg=74.30, stdev=596.37 00:19:40.417 clat (usec): min=396, max=53018, avg=11624.24, stdev=4287.51 00:19:40.417 lat (usec): min=1815, max=53022, avg=11698.53, stdev=4314.63 00:19:40.417 clat percentiles (usec): 00:19:40.417 | 1.00th=[ 3949], 5.00th=[ 5997], 10.00th=[ 8291], 20.00th=[ 9241], 00:19:40.417 | 30.00th=[ 9765], 40.00th=[10159], 50.00th=[10421], 60.00th=[11207], 00:19:40.417 | 70.00th=[11863], 80.00th=[14222], 90.00th=[17433], 95.00th=[19792], 00:19:40.417 | 99.00th=[23462], 99.50th=[23987], 99.90th=[49546], 99.95th=[49546], 00:19:40.417 | 99.99th=[53216] 00:19:40.417 write: IOPS=5615, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1003msec); 0 zone resets 00:19:40.417 slat (usec): min=3, max=10381, avg=74.58, stdev=521.01 00:19:40.417 clat (usec): min=725, max=70044, avg=11302.56, stdev=5915.03 00:19:40.417 lat (usec): min=729, max=70047, avg=11377.14, stdev=5939.31 00:19:40.417 clat percentiles (usec): 00:19:40.417 | 1.00th=[ 2737], 5.00th=[ 4621], 10.00th=[ 5997], 20.00th=[ 8225], 00:19:40.417 | 30.00th=[ 9896], 40.00th=[10290], 50.00th=[10814], 60.00th=[11207], 00:19:40.417 | 70.00th=[11863], 80.00th=[12256], 90.00th=[15926], 95.00th=[21627], 00:19:40.417 | 99.00th=[30278], 99.50th=[54789], 99.90th=[64750], 99.95th=[64750], 00:19:40.417 | 99.99th=[69731] 00:19:40.417 bw ( KiB/s): min=20480, max=24576, per=29.91%, avg=22528.00, stdev=2896.31, samples=2 00:19:40.417 iops : min= 5120, max= 6144, avg=5632.00, stdev=724.08, samples=2 00:19:40.417 lat (usec) : 500=0.01%, 750=0.05% 00:19:40.417 lat (msec) : 2=0.41%, 4=2.11%, 10=31.21%, 20=60.86%, 50=5.07% 00:19:40.417 lat (msec) : 100=0.29% 00:19:40.417 cpu : usr=3.99%, sys=5.89%, ctx=511, majf=0, minf=1 00:19:40.417 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:19:40.417 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.417 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:40.417 issued rwts: total=5417,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.417 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:40.417 job1: (groupid=0, jobs=1): err= 0: pid=1216241: Sat Nov 16 16:55:25 2024 00:19:40.417 read: IOPS=5340, BW=20.9MiB/s (21.9MB/s)(21.0MiB/1006msec) 00:19:40.417 slat (usec): min=3, max=13231, avg=91.00, stdev=640.04 00:19:40.417 clat (usec): min=3008, max=25887, avg=11375.29, stdev=3318.40 00:19:40.417 lat (usec): min=3693, max=25903, avg=11466.29, stdev=3355.53 00:19:40.417 clat percentiles (usec): 00:19:40.417 | 1.00th=[ 4948], 5.00th=[ 7111], 10.00th=[ 7963], 20.00th=[ 8979], 00:19:40.417 | 30.00th=[ 9503], 40.00th=[ 9896], 50.00th=[10814], 60.00th=[11469], 00:19:40.417 | 70.00th=[12387], 80.00th=[13042], 90.00th=[16319], 95.00th=[18220], 00:19:40.417 | 99.00th=[22152], 99.50th=[23987], 99.90th=[25297], 99.95th=[25822], 00:19:40.417 | 99.99th=[25822] 00:19:40.417 write: IOPS=5598, BW=21.9MiB/s (22.9MB/s)(22.0MiB/1006msec); 0 zone resets 00:19:40.417 slat (usec): min=3, max=35341, avg=82.85, stdev=752.94 00:19:40.417 clat (usec): min=3001, max=55769, avg=11761.01, stdev=7558.37 00:19:40.417 lat (usec): min=3009, max=55777, avg=11843.85, stdev=7600.43 00:19:40.417 clat percentiles (usec): 00:19:40.417 | 1.00th=[ 3687], 5.00th=[ 5800], 10.00th=[ 6783], 20.00th=[ 9110], 00:19:40.417 | 30.00th=[ 9896], 40.00th=[10421], 50.00th=[10945], 60.00th=[11338], 00:19:40.417 | 70.00th=[11469], 80.00th=[11994], 90.00th=[12649], 95.00th=[16057], 00:19:40.417 | 99.00th=[55837], 99.50th=[55837], 99.90th=[55837], 99.95th=[55837], 00:19:40.417 | 99.99th=[55837] 00:19:40.417 bw ( KiB/s): min=20521, max=24576, per=29.94%, avg=22548.50, stdev=2867.32, samples=2 00:19:40.417 iops : min= 5130, max= 6144, avg=5637.00, stdev=717.01, samples=2 00:19:40.417 lat (msec) : 4=0.95%, 10=36.68%, 20=58.89%, 50=2.35%, 100=1.12% 00:19:40.417 cpu : usr=5.87%, sys=9.05%, ctx=557, majf=0, minf=1 00:19:40.417 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:19:40.417 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.417 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:40.417 issued rwts: total=5373,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.417 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:40.417 job2: (groupid=0, jobs=1): err= 0: pid=1216242: Sat Nov 16 16:55:25 2024 00:19:40.417 read: IOPS=3088, BW=12.1MiB/s (12.7MB/s)(12.1MiB/1005msec) 00:19:40.417 slat (usec): min=3, max=16812, avg=155.11, stdev=991.98 00:19:40.417 clat (usec): min=2811, max=64850, avg=20164.47, stdev=13698.94 00:19:40.417 lat (usec): min=7820, max=64857, avg=20319.58, stdev=13772.60 00:19:40.417 clat percentiles (usec): 00:19:40.417 | 1.00th=[10290], 5.00th=[11469], 10.00th=[11994], 20.00th=[13042], 00:19:40.417 | 30.00th=[13698], 40.00th=[13960], 50.00th=[14091], 60.00th=[14222], 00:19:40.417 | 70.00th=[14615], 80.00th=[25297], 90.00th=[46400], 95.00th=[50070], 00:19:40.417 | 99.00th=[61080], 99.50th=[64750], 99.90th=[64750], 99.95th=[64750], 00:19:40.417 | 99.99th=[64750] 00:19:40.417 write: IOPS=3566, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1005msec); 0 zone resets 00:19:40.417 slat (usec): min=4, max=17530, avg=138.01, stdev=663.51 00:19:40.417 clat (usec): min=9478, max=39528, avg=18103.14, stdev=6445.24 00:19:40.417 lat (usec): min=9489, max=39538, avg=18241.14, stdev=6481.97 00:19:40.417 clat percentiles (usec): 00:19:40.417 | 1.00th=[ 9503], 5.00th=[10683], 10.00th=[12780], 20.00th=[13566], 00:19:40.417 | 30.00th=[13698], 40.00th=[13960], 50.00th=[14222], 60.00th=[16188], 00:19:40.417 | 70.00th=[22414], 80.00th=[24773], 90.00th=[25822], 95.00th=[29754], 00:19:40.417 | 99.00th=[36963], 99.50th=[38011], 99.90th=[39584], 99.95th=[39584], 00:19:40.417 | 99.99th=[39584] 00:19:40.417 bw ( KiB/s): min= 9088, max=18816, per=18.52%, avg=13952.00, stdev=6878.73, samples=2 00:19:40.417 iops : min= 2272, max= 4704, avg=3488.00, stdev=1719.68, samples=2 00:19:40.417 lat (msec) : 4=0.01%, 10=1.53%, 20=69.62%, 50=26.51%, 100=2.33% 00:19:40.417 cpu : usr=3.69%, sys=5.18%, ctx=409, majf=0, minf=1 00:19:40.417 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:40.417 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.417 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:40.417 issued rwts: total=3104,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.417 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:40.417 job3: (groupid=0, jobs=1): err= 0: pid=1216243: Sat Nov 16 16:55:25 2024 00:19:40.417 read: IOPS=3562, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1006msec) 00:19:40.417 slat (usec): min=2, max=10002, avg=126.52, stdev=736.99 00:19:40.417 clat (usec): min=8450, max=31479, avg=15704.28, stdev=3716.01 00:19:40.417 lat (usec): min=8455, max=31516, avg=15830.80, stdev=3771.27 00:19:40.417 clat percentiles (usec): 00:19:40.417 | 1.00th=[10421], 5.00th=[11076], 10.00th=[11600], 20.00th=[12387], 00:19:40.417 | 30.00th=[13304], 40.00th=[13829], 50.00th=[14746], 60.00th=[15795], 00:19:40.417 | 70.00th=[17171], 80.00th=[19268], 90.00th=[21627], 95.00th=[22414], 00:19:40.417 | 99.00th=[25297], 99.50th=[26346], 99.90th=[29230], 99.95th=[29230], 00:19:40.417 | 99.99th=[31589] 00:19:40.417 write: IOPS=4070, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1006msec); 0 zone resets 00:19:40.417 slat (usec): min=3, max=9454, avg=127.50, stdev=680.69 00:19:40.417 clat (usec): min=4904, max=33136, avg=17249.90, stdev=5492.12 00:19:40.417 lat (usec): min=6242, max=33142, avg=17377.39, stdev=5528.74 00:19:40.417 clat percentiles (usec): 00:19:40.418 | 1.00th=[ 8455], 5.00th=[11076], 10.00th=[12649], 20.00th=[13435], 00:19:40.418 | 30.00th=[13698], 40.00th=[14091], 50.00th=[14484], 60.00th=[15664], 00:19:40.418 | 70.00th=[19006], 80.00th=[24249], 90.00th=[25560], 95.00th=[27132], 00:19:40.418 | 99.00th=[30802], 99.50th=[31065], 99.90th=[32637], 99.95th=[33162], 00:19:40.418 | 99.99th=[33162] 00:19:40.418 bw ( KiB/s): min=15296, max=16440, per=21.07%, avg=15868.00, stdev=808.93, samples=2 00:19:40.418 iops : min= 3824, max= 4110, avg=3967.00, stdev=202.23, samples=2 00:19:40.418 lat (msec) : 10=1.28%, 20=75.37%, 50=23.35% 00:19:40.418 cpu : usr=2.89%, sys=4.88%, ctx=338, majf=0, minf=1 00:19:40.418 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:40.418 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.418 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:40.418 issued rwts: total=3584,4095,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.418 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:40.418 00:19:40.418 Run status group 0 (all jobs): 00:19:40.418 READ: bw=67.9MiB/s (71.2MB/s), 12.1MiB/s-21.1MiB/s (12.7MB/s-22.1MB/s), io=68.3MiB (71.6MB), run=1003-1006msec 00:19:40.418 WRITE: bw=73.6MiB/s (77.1MB/s), 13.9MiB/s-21.9MiB/s (14.6MB/s-23.0MB/s), io=74.0MiB (77.6MB), run=1003-1006msec 00:19:40.418 00:19:40.418 Disk stats (read/write): 00:19:40.418 nvme0n1: ios=4604/4608, merge=0/0, ticks=47143/42072, in_queue=89215, util=98.60% 00:19:40.418 nvme0n2: ios=4421/4608, merge=0/0, ticks=49967/50916, in_queue=100883, util=97.66% 00:19:40.418 nvme0n3: ios=2972/3072, merge=0/0, ticks=13896/17217, in_queue=31113, util=89.59% 00:19:40.418 nvme0n4: ios=3198/3584, merge=0/0, ticks=21465/22385, in_queue=43850, util=97.06% 00:19:40.418 16:55:25 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:40.418 [global] 00:19:40.418 thread=1 00:19:40.418 invalidate=1 00:19:40.418 rw=randwrite 00:19:40.418 time_based=1 00:19:40.418 runtime=1 00:19:40.418 ioengine=libaio 00:19:40.418 direct=1 00:19:40.418 bs=4096 00:19:40.418 iodepth=128 00:19:40.418 norandommap=0 00:19:40.418 numjobs=1 00:19:40.418 00:19:40.418 verify_dump=1 00:19:40.418 verify_backlog=512 00:19:40.418 verify_state_save=0 00:19:40.418 do_verify=1 00:19:40.418 verify=crc32c-intel 00:19:40.418 [job0] 00:19:40.418 filename=/dev/nvme0n1 00:19:40.418 [job1] 00:19:40.418 filename=/dev/nvme0n2 00:19:40.418 [job2] 00:19:40.418 filename=/dev/nvme0n3 00:19:40.418 [job3] 00:19:40.418 filename=/dev/nvme0n4 00:19:40.418 Could not set queue depth (nvme0n1) 00:19:40.418 Could not set queue depth (nvme0n2) 00:19:40.418 Could not set queue depth (nvme0n3) 00:19:40.418 Could not set queue depth (nvme0n4) 00:19:40.418 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.418 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.418 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.418 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.418 fio-3.35 00:19:40.418 Starting 4 threads 00:19:41.799 00:19:41.799 job0: (groupid=0, jobs=1): err= 0: pid=1216475: Sat Nov 16 16:55:27 2024 00:19:41.799 read: IOPS=5603, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1005msec) 00:19:41.799 slat (usec): min=2, max=10684, avg=85.72, stdev=620.42 00:19:41.799 clat (usec): min=3591, max=30794, avg=10867.27, stdev=3058.59 00:19:41.799 lat (usec): min=3596, max=30801, avg=10952.98, stdev=3103.47 00:19:41.799 clat percentiles (usec): 00:19:41.799 | 1.00th=[ 4948], 5.00th=[ 7767], 10.00th=[ 8455], 20.00th=[ 9110], 00:19:41.799 | 30.00th=[ 9372], 40.00th=[ 9634], 50.00th=[10028], 60.00th=[10552], 00:19:41.799 | 70.00th=[11207], 80.00th=[12125], 90.00th=[14484], 95.00th=[16450], 00:19:41.799 | 99.00th=[21890], 99.50th=[28705], 99.90th=[30016], 99.95th=[30802], 00:19:41.799 | 99.99th=[30802] 00:19:41.799 write: IOPS=5695, BW=22.2MiB/s (23.3MB/s)(22.4MiB/1005msec); 0 zone resets 00:19:41.799 slat (usec): min=3, max=42875, avg=81.92, stdev=736.43 00:19:41.799 clat (usec): min=1462, max=61375, avg=11539.47, stdev=7069.38 00:19:41.799 lat (usec): min=1957, max=61382, avg=11621.39, stdev=7112.10 00:19:41.799 clat percentiles (usec): 00:19:41.799 | 1.00th=[ 3392], 5.00th=[ 5407], 10.00th=[ 6390], 20.00th=[ 7767], 00:19:41.799 | 30.00th=[ 9503], 40.00th=[10290], 50.00th=[10945], 60.00th=[11076], 00:19:41.799 | 70.00th=[11469], 80.00th=[13173], 90.00th=[14877], 95.00th=[19268], 00:19:41.799 | 99.00th=[53216], 99.50th=[55313], 99.90th=[60556], 99.95th=[61604], 00:19:41.799 | 99.99th=[61604] 00:19:41.799 bw ( KiB/s): min=20480, max=24624, per=32.41%, avg=22552.00, stdev=2930.25, samples=2 00:19:41.799 iops : min= 5120, max= 6156, avg=5638.00, stdev=732.56, samples=2 00:19:41.799 lat (msec) : 2=0.05%, 4=1.18%, 10=41.30%, 20=54.96%, 50=1.63% 00:19:41.799 lat (msec) : 100=0.88% 00:19:41.799 cpu : usr=6.18%, sys=9.96%, ctx=483, majf=0, minf=1 00:19:41.799 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:19:41.799 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.799 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.799 issued rwts: total=5632,5724,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.799 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.799 job1: (groupid=0, jobs=1): err= 0: pid=1216476: Sat Nov 16 16:55:27 2024 00:19:41.799 read: IOPS=3044, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1009msec) 00:19:41.799 slat (usec): min=3, max=41511, avg=158.94, stdev=1299.59 00:19:41.799 clat (usec): min=7321, max=91062, avg=21178.78, stdev=13725.86 00:19:41.799 lat (usec): min=7327, max=91098, avg=21337.72, stdev=13846.96 00:19:41.799 clat percentiles (usec): 00:19:41.799 | 1.00th=[ 8160], 5.00th=[10814], 10.00th=[11469], 20.00th=[11994], 00:19:41.799 | 30.00th=[12911], 40.00th=[14877], 50.00th=[15926], 60.00th=[16909], 00:19:41.799 | 70.00th=[21365], 80.00th=[27395], 90.00th=[39584], 95.00th=[49021], 00:19:41.799 | 99.00th=[72877], 99.50th=[72877], 99.90th=[73925], 99.95th=[89654], 00:19:41.799 | 99.99th=[90702] 00:19:41.799 write: IOPS=3099, BW=12.1MiB/s (12.7MB/s)(12.2MiB/1009msec); 0 zone resets 00:19:41.799 slat (usec): min=3, max=16918, avg=155.99, stdev=901.54 00:19:41.799 clat (usec): min=6825, max=67983, avg=19992.85, stdev=10984.51 00:19:41.799 lat (usec): min=6833, max=69371, avg=20148.84, stdev=11044.20 00:19:41.799 clat percentiles (usec): 00:19:41.799 | 1.00th=[10945], 5.00th=[11207], 10.00th=[11994], 20.00th=[13042], 00:19:41.799 | 30.00th=[13829], 40.00th=[14222], 50.00th=[15270], 60.00th=[16909], 00:19:41.799 | 70.00th=[20841], 80.00th=[25822], 90.00th=[34341], 95.00th=[49021], 00:19:41.799 | 99.00th=[63177], 99.50th=[66323], 99.90th=[67634], 99.95th=[67634], 00:19:41.799 | 99.99th=[67634] 00:19:41.799 bw ( KiB/s): min= 8192, max=16384, per=17.66%, avg=12288.00, stdev=5792.62, samples=2 00:19:41.799 iops : min= 2048, max= 4096, avg=3072.00, stdev=1448.15, samples=2 00:19:41.799 lat (msec) : 10=2.24%, 20=65.08%, 50=28.83%, 100=3.86% 00:19:41.799 cpu : usr=3.67%, sys=4.27%, ctx=311, majf=0, minf=2 00:19:41.799 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:41.799 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.799 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.799 issued rwts: total=3072,3127,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.799 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.799 job2: (groupid=0, jobs=1): err= 0: pid=1216477: Sat Nov 16 16:55:27 2024 00:19:41.799 read: IOPS=3468, BW=13.5MiB/s (14.2MB/s)(13.6MiB/1007msec) 00:19:41.799 slat (usec): min=2, max=33392, avg=143.64, stdev=1209.24 00:19:41.799 clat (usec): min=2010, max=63953, avg=17991.77, stdev=8464.28 00:19:41.799 lat (usec): min=2021, max=63957, avg=18135.42, stdev=8501.57 00:19:41.799 clat percentiles (usec): 00:19:41.799 | 1.00th=[ 6390], 5.00th=[10421], 10.00th=[12125], 20.00th=[12780], 00:19:41.799 | 30.00th=[13435], 40.00th=[13829], 50.00th=[16188], 60.00th=[17171], 00:19:41.799 | 70.00th=[19006], 80.00th=[21103], 90.00th=[25297], 95.00th=[39584], 00:19:41.799 | 99.00th=[52167], 99.50th=[52167], 99.90th=[52167], 99.95th=[52167], 00:19:41.799 | 99.99th=[63701] 00:19:41.799 write: IOPS=3559, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1007msec); 0 zone resets 00:19:41.799 slat (usec): min=3, max=13982, avg=112.01, stdev=732.46 00:19:41.799 clat (usec): min=3731, max=60973, avg=18019.55, stdev=11217.43 00:19:41.799 lat (usec): min=3739, max=60978, avg=18131.56, stdev=11294.14 00:19:41.800 clat percentiles (usec): 00:19:41.800 | 1.00th=[ 5080], 5.00th=[ 6652], 10.00th=[10028], 20.00th=[12125], 00:19:41.800 | 30.00th=[12780], 40.00th=[13042], 50.00th=[13566], 60.00th=[14353], 00:19:41.800 | 70.00th=[17433], 80.00th=[25297], 90.00th=[31851], 95.00th=[45876], 00:19:41.800 | 99.00th=[59507], 99.50th=[60556], 99.90th=[61080], 99.95th=[61080], 00:19:41.800 | 99.99th=[61080] 00:19:41.800 bw ( KiB/s): min=12288, max=16384, per=20.60%, avg=14336.00, stdev=2896.31, samples=2 00:19:41.800 iops : min= 3072, max= 4096, avg=3584.00, stdev=724.08, samples=2 00:19:41.800 lat (msec) : 4=0.35%, 10=7.11%, 20=68.66%, 50=21.20%, 100=2.68% 00:19:41.800 cpu : usr=2.49%, sys=3.98%, ctx=250, majf=0, minf=1 00:19:41.800 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:41.800 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.800 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.800 issued rwts: total=3493,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.800 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.800 job3: (groupid=0, jobs=1): err= 0: pid=1216478: Sat Nov 16 16:55:27 2024 00:19:41.800 read: IOPS=4835, BW=18.9MiB/s (19.8MB/s)(19.0MiB/1005msec) 00:19:41.800 slat (usec): min=2, max=11381, avg=104.22, stdev=758.92 00:19:41.800 clat (usec): min=1004, max=29780, avg=13232.70, stdev=3488.18 00:19:41.800 lat (usec): min=4595, max=29795, avg=13336.93, stdev=3532.22 00:19:41.800 clat percentiles (usec): 00:19:41.800 | 1.00th=[ 5014], 5.00th=[ 9110], 10.00th=[10290], 20.00th=[11076], 00:19:41.800 | 30.00th=[11338], 40.00th=[11600], 50.00th=[11863], 60.00th=[12911], 00:19:41.800 | 70.00th=[14222], 80.00th=[15664], 90.00th=[19006], 95.00th=[20841], 00:19:41.800 | 99.00th=[22676], 99.50th=[23200], 99.90th=[23725], 99.95th=[23725], 00:19:41.800 | 99.99th=[29754] 00:19:41.800 write: IOPS=5094, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1005msec); 0 zone resets 00:19:41.800 slat (usec): min=3, max=18087, avg=88.38, stdev=620.38 00:19:41.800 clat (usec): min=1491, max=33814, avg=12341.01, stdev=2829.79 00:19:41.800 lat (usec): min=1502, max=33829, avg=12429.39, stdev=2901.55 00:19:41.800 clat percentiles (usec): 00:19:41.800 | 1.00th=[ 4424], 5.00th=[ 6456], 10.00th=[ 9372], 20.00th=[11600], 00:19:41.800 | 30.00th=[11994], 40.00th=[12518], 50.00th=[12780], 60.00th=[12911], 00:19:41.800 | 70.00th=[13173], 80.00th=[13435], 90.00th=[14091], 95.00th=[14615], 00:19:41.800 | 99.00th=[23200], 99.50th=[23200], 99.90th=[25035], 99.95th=[25035], 00:19:41.800 | 99.99th=[33817] 00:19:41.800 bw ( KiB/s): min=20480, max=20480, per=29.43%, avg=20480.00, stdev= 0.00, samples=2 00:19:41.800 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=2 00:19:41.800 lat (msec) : 2=0.08%, 4=0.34%, 10=11.33%, 20=83.65%, 50=4.60% 00:19:41.800 cpu : usr=4.68%, sys=9.46%, ctx=483, majf=0, minf=1 00:19:41.800 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:41.800 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.800 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.800 issued rwts: total=4860,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.800 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.800 00:19:41.800 Run status group 0 (all jobs): 00:19:41.800 READ: bw=66.0MiB/s (69.2MB/s), 11.9MiB/s-21.9MiB/s (12.5MB/s-23.0MB/s), io=66.6MiB (69.9MB), run=1005-1009msec 00:19:41.800 WRITE: bw=68.0MiB/s (71.3MB/s), 12.1MiB/s-22.2MiB/s (12.7MB/s-23.3MB/s), io=68.6MiB (71.9MB), run=1005-1009msec 00:19:41.800 00:19:41.800 Disk stats (read/write): 00:19:41.800 nvme0n1: ios=4644/4763, merge=0/0, ticks=49221/50777, in_queue=99998, util=99.50% 00:19:41.800 nvme0n2: ios=2732/3072, merge=0/0, ticks=21456/30036, in_queue=51492, util=87.72% 00:19:41.800 nvme0n3: ios=2667/3072, merge=0/0, ticks=40008/44585, in_queue=84593, util=89.05% 00:19:41.800 nvme0n4: ios=4096/4194, merge=0/0, ticks=53261/50845, in_queue=104106, util=89.71% 00:19:41.800 16:55:27 -- target/fio.sh@55 -- # sync 00:19:41.800 16:55:27 -- target/fio.sh@59 -- # fio_pid=1216618 00:19:41.800 16:55:27 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:41.800 16:55:27 -- target/fio.sh@61 -- # sleep 3 00:19:41.800 [global] 00:19:41.800 thread=1 00:19:41.800 invalidate=1 00:19:41.800 rw=read 00:19:41.800 time_based=1 00:19:41.800 runtime=10 00:19:41.800 ioengine=libaio 00:19:41.800 direct=1 00:19:41.800 bs=4096 00:19:41.800 iodepth=1 00:19:41.800 norandommap=1 00:19:41.800 numjobs=1 00:19:41.800 00:19:41.800 [job0] 00:19:41.800 filename=/dev/nvme0n1 00:19:41.800 [job1] 00:19:41.800 filename=/dev/nvme0n2 00:19:41.800 [job2] 00:19:41.800 filename=/dev/nvme0n3 00:19:41.800 [job3] 00:19:41.800 filename=/dev/nvme0n4 00:19:41.800 Could not set queue depth (nvme0n1) 00:19:41.800 Could not set queue depth (nvme0n2) 00:19:41.800 Could not set queue depth (nvme0n3) 00:19:41.800 Could not set queue depth (nvme0n4) 00:19:42.058 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:42.058 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:42.058 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:42.058 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:42.058 fio-3.35 00:19:42.058 Starting 4 threads 00:19:44.583 16:55:30 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:45.148 16:55:30 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:45.148 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=16486400, buflen=4096 00:19:45.148 fio: pid=1216839, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:45.405 16:55:30 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:45.405 16:55:30 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:45.405 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=40235008, buflen=4096 00:19:45.405 fio: pid=1216838, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:45.663 16:55:31 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:45.663 16:55:31 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:45.663 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=19714048, buflen=4096 00:19:45.663 fio: pid=1216836, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:45.921 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=30244864, buflen=4096 00:19:45.921 fio: pid=1216837, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:45.921 16:55:31 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:45.921 16:55:31 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:45.921 00:19:45.921 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1216836: Sat Nov 16 16:55:31 2024 00:19:45.921 read: IOPS=1396, BW=5587KiB/s (5721kB/s)(18.8MiB/3446msec) 00:19:45.921 slat (usec): min=5, max=17620, avg=20.00, stdev=384.60 00:19:45.921 clat (usec): min=167, max=46745, avg=688.37, stdev=4316.47 00:19:45.921 lat (usec): min=174, max=53974, avg=708.38, stdev=4358.62 00:19:45.921 clat percentiles (usec): 00:19:45.921 | 1.00th=[ 178], 5.00th=[ 184], 10.00th=[ 188], 20.00th=[ 194], 00:19:45.921 | 30.00th=[ 198], 40.00th=[ 202], 50.00th=[ 210], 60.00th=[ 221], 00:19:45.921 | 70.00th=[ 239], 80.00th=[ 260], 90.00th=[ 306], 95.00th=[ 359], 00:19:45.921 | 99.00th=[40633], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:19:45.921 | 99.99th=[46924] 00:19:45.921 bw ( KiB/s): min= 96, max=17016, per=19.37%, avg=5437.33, stdev=6233.59, samples=6 00:19:45.921 iops : min= 24, max= 4254, avg=1359.33, stdev=1558.40, samples=6 00:19:45.921 lat (usec) : 250=76.30%, 500=22.31%, 750=0.17%, 1000=0.08% 00:19:45.921 lat (msec) : 50=1.12% 00:19:45.921 cpu : usr=0.81%, sys=2.35%, ctx=4818, majf=0, minf=2 00:19:45.921 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:45.921 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.921 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.921 issued rwts: total=4814,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:45.921 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:45.921 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1216837: Sat Nov 16 16:55:31 2024 00:19:45.921 read: IOPS=1989, BW=7957KiB/s (8148kB/s)(28.8MiB/3712msec) 00:19:45.921 slat (usec): min=4, max=12885, avg=12.98, stdev=199.76 00:19:45.921 clat (usec): min=159, max=43642, avg=484.56, stdev=3297.09 00:19:45.921 lat (usec): min=164, max=54982, avg=497.54, stdev=3325.66 00:19:45.921 clat percentiles (usec): 00:19:45.921 | 1.00th=[ 174], 5.00th=[ 180], 10.00th=[ 184], 20.00th=[ 188], 00:19:45.921 | 30.00th=[ 194], 40.00th=[ 198], 50.00th=[ 202], 60.00th=[ 208], 00:19:45.921 | 70.00th=[ 217], 80.00th=[ 233], 90.00th=[ 285], 95.00th=[ 338], 00:19:45.921 | 99.00th=[ 433], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:19:45.921 | 99.99th=[43779] 00:19:45.921 bw ( KiB/s): min= 1176, max=13504, per=27.31%, avg=7667.00, stdev=4072.54, samples=7 00:19:45.921 iops : min= 294, max= 3376, avg=1916.71, stdev=1018.17, samples=7 00:19:45.921 lat (usec) : 250=84.05%, 500=15.21% 00:19:45.921 lat (msec) : 2=0.03%, 4=0.03%, 10=0.04%, 50=0.64% 00:19:45.921 cpu : usr=0.46%, sys=2.40%, ctx=7390, majf=0, minf=1 00:19:45.921 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:45.921 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.921 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.921 issued rwts: total=7385,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:45.921 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:45.921 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1216838: Sat Nov 16 16:55:31 2024 00:19:45.921 read: IOPS=3086, BW=12.1MiB/s (12.6MB/s)(38.4MiB/3183msec) 00:19:45.921 slat (usec): min=4, max=11755, avg=13.34, stdev=162.35 00:19:45.921 clat (usec): min=181, max=41878, avg=305.24, stdev=1430.99 00:19:45.921 lat (usec): min=188, max=41886, avg=318.59, stdev=1440.15 00:19:45.921 clat percentiles (usec): 00:19:45.921 | 1.00th=[ 190], 5.00th=[ 200], 10.00th=[ 206], 20.00th=[ 212], 00:19:45.921 | 30.00th=[ 221], 40.00th=[ 229], 50.00th=[ 237], 60.00th=[ 249], 00:19:45.921 | 70.00th=[ 265], 80.00th=[ 289], 90.00th=[ 318], 95.00th=[ 375], 00:19:45.921 | 99.00th=[ 523], 99.50th=[ 553], 99.90th=[40633], 99.95th=[41681], 00:19:45.921 | 99.99th=[41681] 00:19:45.921 bw ( KiB/s): min= 6064, max=15752, per=44.31%, avg=12436.00, stdev=3692.28, samples=6 00:19:45.921 iops : min= 1516, max= 3938, avg=3109.00, stdev=923.07, samples=6 00:19:45.921 lat (usec) : 250=61.68%, 500=37.02%, 750=1.17% 00:19:45.921 lat (msec) : 50=0.12% 00:19:45.921 cpu : usr=2.11%, sys=5.09%, ctx=9826, majf=0, minf=1 00:19:45.921 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:45.921 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.921 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.921 issued rwts: total=9824,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:45.921 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:45.921 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1216839: Sat Nov 16 16:55:31 2024 00:19:45.921 read: IOPS=1385, BW=5540KiB/s (5673kB/s)(15.7MiB/2906msec) 00:19:45.921 slat (nsec): min=4454, max=50371, avg=7822.31, stdev=3837.20 00:19:45.921 clat (usec): min=171, max=42041, avg=706.88, stdev=4497.33 00:19:45.921 lat (usec): min=176, max=42058, avg=714.70, stdev=4498.91 00:19:45.921 clat percentiles (usec): 00:19:45.921 | 1.00th=[ 180], 5.00th=[ 186], 10.00th=[ 188], 20.00th=[ 194], 00:19:45.921 | 30.00th=[ 196], 40.00th=[ 200], 50.00th=[ 204], 60.00th=[ 206], 00:19:45.921 | 70.00th=[ 210], 80.00th=[ 217], 90.00th=[ 227], 95.00th=[ 243], 00:19:45.921 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:19:45.921 | 99.99th=[42206] 00:19:45.921 bw ( KiB/s): min= 96, max=18112, per=22.87%, avg=6420.80, stdev=8787.34, samples=5 00:19:45.921 iops : min= 24, max= 4528, avg=1605.20, stdev=2196.83, samples=5 00:19:45.921 lat (usec) : 250=95.78%, 500=2.78%, 750=0.17% 00:19:45.921 lat (msec) : 4=0.02%, 50=1.22% 00:19:45.921 cpu : usr=0.24%, sys=1.38%, ctx=4028, majf=0, minf=2 00:19:45.921 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:45.921 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.921 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.921 issued rwts: total=4026,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:45.921 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:45.921 00:19:45.921 Run status group 0 (all jobs): 00:19:45.921 READ: bw=27.4MiB/s (28.7MB/s), 5540KiB/s-12.1MiB/s (5673kB/s-12.6MB/s), io=102MiB (107MB), run=2906-3712msec 00:19:45.921 00:19:45.921 Disk stats (read/write): 00:19:45.921 nvme0n1: ios=4849/0, merge=0/0, ticks=3431/0, in_queue=3431, util=98.86% 00:19:45.921 nvme0n2: ios=6768/0, merge=0/0, ticks=3425/0, in_queue=3425, util=95.14% 00:19:45.921 nvme0n3: ios=9597/0, merge=0/0, ticks=2780/0, in_queue=2780, util=95.91% 00:19:45.921 nvme0n4: ios=4065/0, merge=0/0, ticks=2854/0, in_queue=2854, util=99.21% 00:19:46.180 16:55:31 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.180 16:55:31 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:46.438 16:55:31 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.438 16:55:31 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:46.696 16:55:32 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.696 16:55:32 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:46.954 16:55:32 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.954 16:55:32 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:47.212 16:55:32 -- target/fio.sh@69 -- # fio_status=0 00:19:47.212 16:55:32 -- target/fio.sh@70 -- # wait 1216618 00:19:47.212 16:55:32 -- target/fio.sh@70 -- # fio_status=4 00:19:47.212 16:55:32 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:47.212 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:47.212 16:55:32 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:47.212 16:55:32 -- common/autotest_common.sh@1208 -- # local i=0 00:19:47.212 16:55:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:47.212 16:55:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:47.212 16:55:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:47.212 16:55:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:47.212 16:55:32 -- common/autotest_common.sh@1220 -- # return 0 00:19:47.212 16:55:32 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:47.212 16:55:32 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:47.212 nvmf hotplug test: fio failed as expected 00:19:47.212 16:55:32 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:47.469 16:55:33 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:47.470 16:55:33 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:47.470 16:55:33 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:47.470 16:55:33 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:47.470 16:55:33 -- target/fio.sh@91 -- # nvmftestfini 00:19:47.470 16:55:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:47.470 16:55:33 -- nvmf/common.sh@116 -- # sync 00:19:47.470 16:55:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:47.470 16:55:33 -- nvmf/common.sh@119 -- # set +e 00:19:47.470 16:55:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:47.470 16:55:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:47.470 rmmod nvme_tcp 00:19:47.470 rmmod nvme_fabrics 00:19:47.470 rmmod nvme_keyring 00:19:47.728 16:55:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:47.728 16:55:33 -- nvmf/common.sh@123 -- # set -e 00:19:47.728 16:55:33 -- nvmf/common.sh@124 -- # return 0 00:19:47.728 16:55:33 -- nvmf/common.sh@477 -- # '[' -n 1214537 ']' 00:19:47.728 16:55:33 -- nvmf/common.sh@478 -- # killprocess 1214537 00:19:47.728 16:55:33 -- common/autotest_common.sh@936 -- # '[' -z 1214537 ']' 00:19:47.728 16:55:33 -- common/autotest_common.sh@940 -- # kill -0 1214537 00:19:47.728 16:55:33 -- common/autotest_common.sh@941 -- # uname 00:19:47.728 16:55:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:47.728 16:55:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1214537 00:19:47.728 16:55:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:47.728 16:55:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:47.728 16:55:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1214537' 00:19:47.728 killing process with pid 1214537 00:19:47.728 16:55:33 -- common/autotest_common.sh@955 -- # kill 1214537 00:19:47.728 16:55:33 -- common/autotest_common.sh@960 -- # wait 1214537 00:19:47.987 16:55:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:47.987 16:55:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:47.987 16:55:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:47.987 16:55:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:47.987 16:55:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:47.987 16:55:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:47.987 16:55:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:47.987 16:55:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:49.892 16:55:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:49.892 00:19:49.892 real 0m24.215s 00:19:49.892 user 1m24.939s 00:19:49.892 sys 0m7.153s 00:19:49.892 16:55:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:49.892 16:55:35 -- common/autotest_common.sh@10 -- # set +x 00:19:49.892 ************************************ 00:19:49.892 END TEST nvmf_fio_target 00:19:49.892 ************************************ 00:19:49.892 16:55:35 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:49.892 16:55:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:49.892 16:55:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:49.892 16:55:35 -- common/autotest_common.sh@10 -- # set +x 00:19:49.892 ************************************ 00:19:49.892 START TEST nvmf_bdevio 00:19:49.892 ************************************ 00:19:49.892 16:55:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:49.892 * Looking for test storage... 00:19:49.892 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:49.892 16:55:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:49.892 16:55:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:49.892 16:55:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:50.151 16:55:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:50.151 16:55:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:50.151 16:55:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:50.151 16:55:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:50.151 16:55:35 -- scripts/common.sh@335 -- # IFS=.-: 00:19:50.151 16:55:35 -- scripts/common.sh@335 -- # read -ra ver1 00:19:50.151 16:55:35 -- scripts/common.sh@336 -- # IFS=.-: 00:19:50.151 16:55:35 -- scripts/common.sh@336 -- # read -ra ver2 00:19:50.151 16:55:35 -- scripts/common.sh@337 -- # local 'op=<' 00:19:50.151 16:55:35 -- scripts/common.sh@339 -- # ver1_l=2 00:19:50.151 16:55:35 -- scripts/common.sh@340 -- # ver2_l=1 00:19:50.151 16:55:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:50.151 16:55:35 -- scripts/common.sh@343 -- # case "$op" in 00:19:50.151 16:55:35 -- scripts/common.sh@344 -- # : 1 00:19:50.151 16:55:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:50.151 16:55:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:50.151 16:55:35 -- scripts/common.sh@364 -- # decimal 1 00:19:50.151 16:55:35 -- scripts/common.sh@352 -- # local d=1 00:19:50.151 16:55:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:50.151 16:55:35 -- scripts/common.sh@354 -- # echo 1 00:19:50.151 16:55:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:50.151 16:55:35 -- scripts/common.sh@365 -- # decimal 2 00:19:50.151 16:55:35 -- scripts/common.sh@352 -- # local d=2 00:19:50.151 16:55:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:50.151 16:55:35 -- scripts/common.sh@354 -- # echo 2 00:19:50.151 16:55:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:50.151 16:55:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:50.151 16:55:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:50.151 16:55:35 -- scripts/common.sh@367 -- # return 0 00:19:50.151 16:55:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:50.151 16:55:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:50.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:50.151 --rc genhtml_branch_coverage=1 00:19:50.151 --rc genhtml_function_coverage=1 00:19:50.151 --rc genhtml_legend=1 00:19:50.151 --rc geninfo_all_blocks=1 00:19:50.151 --rc geninfo_unexecuted_blocks=1 00:19:50.151 00:19:50.151 ' 00:19:50.151 16:55:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:50.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:50.151 --rc genhtml_branch_coverage=1 00:19:50.151 --rc genhtml_function_coverage=1 00:19:50.151 --rc genhtml_legend=1 00:19:50.151 --rc geninfo_all_blocks=1 00:19:50.151 --rc geninfo_unexecuted_blocks=1 00:19:50.151 00:19:50.151 ' 00:19:50.151 16:55:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:50.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:50.151 --rc genhtml_branch_coverage=1 00:19:50.151 --rc genhtml_function_coverage=1 00:19:50.151 --rc genhtml_legend=1 00:19:50.151 --rc geninfo_all_blocks=1 00:19:50.151 --rc geninfo_unexecuted_blocks=1 00:19:50.151 00:19:50.151 ' 00:19:50.151 16:55:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:50.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:50.151 --rc genhtml_branch_coverage=1 00:19:50.151 --rc genhtml_function_coverage=1 00:19:50.151 --rc genhtml_legend=1 00:19:50.151 --rc geninfo_all_blocks=1 00:19:50.151 --rc geninfo_unexecuted_blocks=1 00:19:50.152 00:19:50.152 ' 00:19:50.152 16:55:35 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:50.152 16:55:35 -- nvmf/common.sh@7 -- # uname -s 00:19:50.152 16:55:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:50.152 16:55:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:50.152 16:55:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:50.152 16:55:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:50.152 16:55:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:50.152 16:55:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:50.152 16:55:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:50.152 16:55:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:50.152 16:55:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:50.152 16:55:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:50.152 16:55:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:50.152 16:55:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:50.152 16:55:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:50.152 16:55:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:50.152 16:55:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:50.152 16:55:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:50.152 16:55:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:50.152 16:55:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:50.152 16:55:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:50.152 16:55:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:50.152 16:55:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:50.152 16:55:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:50.152 16:55:35 -- paths/export.sh@5 -- # export PATH 00:19:50.152 16:55:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:50.152 16:55:35 -- nvmf/common.sh@46 -- # : 0 00:19:50.152 16:55:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:50.152 16:55:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:50.152 16:55:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:50.152 16:55:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:50.152 16:55:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:50.152 16:55:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:50.152 16:55:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:50.152 16:55:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:50.152 16:55:35 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:50.152 16:55:35 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:50.152 16:55:35 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:50.152 16:55:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:50.152 16:55:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:50.152 16:55:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:50.152 16:55:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:50.152 16:55:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:50.152 16:55:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:50.152 16:55:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:50.152 16:55:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:50.152 16:55:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:50.152 16:55:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:50.152 16:55:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:50.152 16:55:35 -- common/autotest_common.sh@10 -- # set +x 00:19:52.142 16:55:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:52.142 16:55:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:52.142 16:55:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:52.142 16:55:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:52.142 16:55:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:52.142 16:55:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:52.142 16:55:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:52.142 16:55:37 -- nvmf/common.sh@294 -- # net_devs=() 00:19:52.142 16:55:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:52.142 16:55:37 -- nvmf/common.sh@295 -- # e810=() 00:19:52.142 16:55:37 -- nvmf/common.sh@295 -- # local -ga e810 00:19:52.142 16:55:37 -- nvmf/common.sh@296 -- # x722=() 00:19:52.142 16:55:37 -- nvmf/common.sh@296 -- # local -ga x722 00:19:52.142 16:55:37 -- nvmf/common.sh@297 -- # mlx=() 00:19:52.142 16:55:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:52.142 16:55:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:52.142 16:55:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:52.142 16:55:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:52.142 16:55:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:52.142 16:55:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:52.142 16:55:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:52.142 16:55:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:52.142 16:55:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:52.142 16:55:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:52.142 16:55:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:52.142 16:55:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:52.142 16:55:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:52.142 16:55:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:52.142 16:55:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:52.142 16:55:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:52.142 16:55:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:52.142 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:52.142 16:55:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:52.142 16:55:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:52.142 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:52.142 16:55:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:52.142 16:55:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:52.142 16:55:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:52.142 16:55:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:52.142 16:55:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:52.142 16:55:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:52.142 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:52.142 16:55:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:52.142 16:55:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:52.142 16:55:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:52.142 16:55:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:52.142 16:55:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:52.142 16:55:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:52.142 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:52.142 16:55:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:52.142 16:55:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:52.142 16:55:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:52.142 16:55:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:52.142 16:55:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:52.142 16:55:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:52.142 16:55:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:52.142 16:55:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:52.142 16:55:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:52.142 16:55:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:52.142 16:55:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:52.142 16:55:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:52.142 16:55:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:52.142 16:55:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:52.142 16:55:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:52.142 16:55:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:52.142 16:55:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:52.142 16:55:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:52.142 16:55:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:52.142 16:55:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:52.142 16:55:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:52.142 16:55:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:52.142 16:55:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:52.142 16:55:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:52.142 16:55:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:52.142 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:52.142 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.157 ms 00:19:52.142 00:19:52.142 --- 10.0.0.2 ping statistics --- 00:19:52.142 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:52.142 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:19:52.142 16:55:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:52.401 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:52.401 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:19:52.401 00:19:52.401 --- 10.0.0.1 ping statistics --- 00:19:52.401 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:52.401 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:19:52.401 16:55:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:52.401 16:55:37 -- nvmf/common.sh@410 -- # return 0 00:19:52.401 16:55:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:52.401 16:55:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:52.401 16:55:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:52.401 16:55:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:52.401 16:55:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:52.401 16:55:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:52.401 16:55:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:52.401 16:55:37 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:52.401 16:55:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:52.401 16:55:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:52.401 16:55:37 -- common/autotest_common.sh@10 -- # set +x 00:19:52.401 16:55:37 -- nvmf/common.sh@469 -- # nvmfpid=1219493 00:19:52.401 16:55:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:52.401 16:55:37 -- nvmf/common.sh@470 -- # waitforlisten 1219493 00:19:52.401 16:55:37 -- common/autotest_common.sh@829 -- # '[' -z 1219493 ']' 00:19:52.401 16:55:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:52.401 16:55:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:52.401 16:55:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:52.401 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:52.401 16:55:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:52.401 16:55:37 -- common/autotest_common.sh@10 -- # set +x 00:19:52.401 [2024-11-16 16:55:37.970385] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:52.401 [2024-11-16 16:55:37.970489] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:52.401 EAL: No free 2048 kB hugepages reported on node 1 00:19:52.401 [2024-11-16 16:55:38.045863] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:52.401 [2024-11-16 16:55:38.143714] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:52.401 [2024-11-16 16:55:38.143891] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:52.401 [2024-11-16 16:55:38.143911] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:52.401 [2024-11-16 16:55:38.143925] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:52.401 [2024-11-16 16:55:38.144019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:52.401 [2024-11-16 16:55:38.144078] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:52.401 [2024-11-16 16:55:38.144136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:52.401 [2024-11-16 16:55:38.144139] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:53.334 16:55:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:53.334 16:55:39 -- common/autotest_common.sh@862 -- # return 0 00:19:53.334 16:55:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:53.334 16:55:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:53.334 16:55:39 -- common/autotest_common.sh@10 -- # set +x 00:19:53.334 16:55:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:53.334 16:55:39 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:53.334 16:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.334 16:55:39 -- common/autotest_common.sh@10 -- # set +x 00:19:53.334 [2024-11-16 16:55:39.025314] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:53.334 16:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.334 16:55:39 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:53.334 16:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.334 16:55:39 -- common/autotest_common.sh@10 -- # set +x 00:19:53.334 Malloc0 00:19:53.334 16:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.334 16:55:39 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:53.334 16:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.334 16:55:39 -- common/autotest_common.sh@10 -- # set +x 00:19:53.334 16:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.334 16:55:39 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:53.334 16:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.334 16:55:39 -- common/autotest_common.sh@10 -- # set +x 00:19:53.334 16:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.334 16:55:39 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:53.334 16:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.334 16:55:39 -- common/autotest_common.sh@10 -- # set +x 00:19:53.334 [2024-11-16 16:55:39.076414] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:53.334 16:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.334 16:55:39 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:53.334 16:55:39 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:53.334 16:55:39 -- nvmf/common.sh@520 -- # config=() 00:19:53.334 16:55:39 -- nvmf/common.sh@520 -- # local subsystem config 00:19:53.334 16:55:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:53.334 16:55:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:53.334 { 00:19:53.334 "params": { 00:19:53.334 "name": "Nvme$subsystem", 00:19:53.334 "trtype": "$TEST_TRANSPORT", 00:19:53.334 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:53.334 "adrfam": "ipv4", 00:19:53.334 "trsvcid": "$NVMF_PORT", 00:19:53.334 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:53.335 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:53.335 "hdgst": ${hdgst:-false}, 00:19:53.335 "ddgst": ${ddgst:-false} 00:19:53.335 }, 00:19:53.335 "method": "bdev_nvme_attach_controller" 00:19:53.335 } 00:19:53.335 EOF 00:19:53.335 )") 00:19:53.335 16:55:39 -- nvmf/common.sh@542 -- # cat 00:19:53.592 16:55:39 -- nvmf/common.sh@544 -- # jq . 00:19:53.592 16:55:39 -- nvmf/common.sh@545 -- # IFS=, 00:19:53.592 16:55:39 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:53.592 "params": { 00:19:53.592 "name": "Nvme1", 00:19:53.592 "trtype": "tcp", 00:19:53.592 "traddr": "10.0.0.2", 00:19:53.592 "adrfam": "ipv4", 00:19:53.592 "trsvcid": "4420", 00:19:53.592 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:53.592 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:53.592 "hdgst": false, 00:19:53.592 "ddgst": false 00:19:53.592 }, 00:19:53.592 "method": "bdev_nvme_attach_controller" 00:19:53.592 }' 00:19:53.592 [2024-11-16 16:55:39.116230] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:53.592 [2024-11-16 16:55:39.116314] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1219654 ] 00:19:53.592 EAL: No free 2048 kB hugepages reported on node 1 00:19:53.592 [2024-11-16 16:55:39.177037] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:53.592 [2024-11-16 16:55:39.263738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:53.592 [2024-11-16 16:55:39.263792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:53.592 [2024-11-16 16:55:39.263795] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:53.850 [2024-11-16 16:55:39.428304] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:53.850 [2024-11-16 16:55:39.428364] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:53.850 I/O targets: 00:19:53.850 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:53.850 00:19:53.850 00:19:53.850 CUnit - A unit testing framework for C - Version 2.1-3 00:19:53.850 http://cunit.sourceforge.net/ 00:19:53.850 00:19:53.850 00:19:53.850 Suite: bdevio tests on: Nvme1n1 00:19:53.850 Test: blockdev write read block ...passed 00:19:53.850 Test: blockdev write zeroes read block ...passed 00:19:53.850 Test: blockdev write zeroes read no split ...passed 00:19:53.850 Test: blockdev write zeroes read split ...passed 00:19:53.850 Test: blockdev write zeroes read split partial ...passed 00:19:53.850 Test: blockdev reset ...[2024-11-16 16:55:39.544137] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:53.850 [2024-11-16 16:55:39.544244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f42e40 (9): Bad file descriptor 00:19:53.850 [2024-11-16 16:55:39.598056] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:53.850 passed 00:19:54.108 Test: blockdev write read 8 blocks ...passed 00:19:54.108 Test: blockdev write read size > 128k ...passed 00:19:54.108 Test: blockdev write read invalid size ...passed 00:19:54.108 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:54.108 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:54.108 Test: blockdev write read max offset ...passed 00:19:54.108 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:54.108 Test: blockdev writev readv 8 blocks ...passed 00:19:54.108 Test: blockdev writev readv 30 x 1block ...passed 00:19:54.108 Test: blockdev writev readv block ...passed 00:19:54.108 Test: blockdev writev readv size > 128k ...passed 00:19:54.108 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:54.108 Test: blockdev comparev and writev ...[2024-11-16 16:55:39.853792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.108 [2024-11-16 16:55:39.853830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:54.108 [2024-11-16 16:55:39.853854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.108 [2024-11-16 16:55:39.853872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:54.108 [2024-11-16 16:55:39.854232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.109 [2024-11-16 16:55:39.854256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:54.109 [2024-11-16 16:55:39.854288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.109 [2024-11-16 16:55:39.854305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:54.109 [2024-11-16 16:55:39.854648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.109 [2024-11-16 16:55:39.854672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:54.109 [2024-11-16 16:55:39.854694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.109 [2024-11-16 16:55:39.854710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:54.109 [2024-11-16 16:55:39.855048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.109 [2024-11-16 16:55:39.855072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:54.109 [2024-11-16 16:55:39.855093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:54.109 [2024-11-16 16:55:39.855114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:54.367 passed 00:19:54.367 Test: blockdev nvme passthru rw ...passed 00:19:54.367 Test: blockdev nvme passthru vendor specific ...[2024-11-16 16:55:39.936877] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:54.367 [2024-11-16 16:55:39.936905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:54.367 [2024-11-16 16:55:39.937060] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:54.367 [2024-11-16 16:55:39.937082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:54.367 [2024-11-16 16:55:39.937214] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:54.367 [2024-11-16 16:55:39.937237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:54.367 [2024-11-16 16:55:39.937386] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:54.367 [2024-11-16 16:55:39.937409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:54.367 passed 00:19:54.367 Test: blockdev nvme admin passthru ...passed 00:19:54.367 Test: blockdev copy ...passed 00:19:54.367 00:19:54.367 Run Summary: Type Total Ran Passed Failed Inactive 00:19:54.367 suites 1 1 n/a 0 0 00:19:54.367 tests 23 23 23 0 0 00:19:54.367 asserts 152 152 152 0 n/a 00:19:54.367 00:19:54.367 Elapsed time = 1.137 seconds 00:19:54.625 16:55:40 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:54.625 16:55:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.625 16:55:40 -- common/autotest_common.sh@10 -- # set +x 00:19:54.625 16:55:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.625 16:55:40 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:54.625 16:55:40 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:54.625 16:55:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:54.625 16:55:40 -- nvmf/common.sh@116 -- # sync 00:19:54.625 16:55:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:54.625 16:55:40 -- nvmf/common.sh@119 -- # set +e 00:19:54.625 16:55:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:54.625 16:55:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:54.625 rmmod nvme_tcp 00:19:54.625 rmmod nvme_fabrics 00:19:54.625 rmmod nvme_keyring 00:19:54.625 16:55:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:54.625 16:55:40 -- nvmf/common.sh@123 -- # set -e 00:19:54.625 16:55:40 -- nvmf/common.sh@124 -- # return 0 00:19:54.625 16:55:40 -- nvmf/common.sh@477 -- # '[' -n 1219493 ']' 00:19:54.625 16:55:40 -- nvmf/common.sh@478 -- # killprocess 1219493 00:19:54.625 16:55:40 -- common/autotest_common.sh@936 -- # '[' -z 1219493 ']' 00:19:54.625 16:55:40 -- common/autotest_common.sh@940 -- # kill -0 1219493 00:19:54.625 16:55:40 -- common/autotest_common.sh@941 -- # uname 00:19:54.625 16:55:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:54.625 16:55:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1219493 00:19:54.625 16:55:40 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:54.625 16:55:40 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:54.625 16:55:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1219493' 00:19:54.625 killing process with pid 1219493 00:19:54.625 16:55:40 -- common/autotest_common.sh@955 -- # kill 1219493 00:19:54.625 16:55:40 -- common/autotest_common.sh@960 -- # wait 1219493 00:19:54.884 16:55:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:54.884 16:55:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:54.884 16:55:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:54.884 16:55:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:54.884 16:55:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:54.884 16:55:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:54.884 16:55:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:54.884 16:55:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:57.417 16:55:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:57.417 00:19:57.417 real 0m7.013s 00:19:57.417 user 0m12.655s 00:19:57.417 sys 0m2.114s 00:19:57.417 16:55:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:57.417 16:55:42 -- common/autotest_common.sh@10 -- # set +x 00:19:57.417 ************************************ 00:19:57.417 END TEST nvmf_bdevio 00:19:57.417 ************************************ 00:19:57.417 16:55:42 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:19:57.417 16:55:42 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:57.418 16:55:42 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:19:57.418 16:55:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:57.418 16:55:42 -- common/autotest_common.sh@10 -- # set +x 00:19:57.418 ************************************ 00:19:57.418 START TEST nvmf_bdevio_no_huge 00:19:57.418 ************************************ 00:19:57.418 16:55:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:57.418 * Looking for test storage... 00:19:57.418 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:57.418 16:55:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:57.418 16:55:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:57.418 16:55:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:57.418 16:55:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:57.418 16:55:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:57.418 16:55:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:57.418 16:55:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:57.418 16:55:42 -- scripts/common.sh@335 -- # IFS=.-: 00:19:57.418 16:55:42 -- scripts/common.sh@335 -- # read -ra ver1 00:19:57.418 16:55:42 -- scripts/common.sh@336 -- # IFS=.-: 00:19:57.418 16:55:42 -- scripts/common.sh@336 -- # read -ra ver2 00:19:57.418 16:55:42 -- scripts/common.sh@337 -- # local 'op=<' 00:19:57.418 16:55:42 -- scripts/common.sh@339 -- # ver1_l=2 00:19:57.418 16:55:42 -- scripts/common.sh@340 -- # ver2_l=1 00:19:57.418 16:55:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:57.418 16:55:42 -- scripts/common.sh@343 -- # case "$op" in 00:19:57.418 16:55:42 -- scripts/common.sh@344 -- # : 1 00:19:57.418 16:55:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:57.418 16:55:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:57.418 16:55:42 -- scripts/common.sh@364 -- # decimal 1 00:19:57.418 16:55:42 -- scripts/common.sh@352 -- # local d=1 00:19:57.418 16:55:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:57.418 16:55:42 -- scripts/common.sh@354 -- # echo 1 00:19:57.418 16:55:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:57.418 16:55:42 -- scripts/common.sh@365 -- # decimal 2 00:19:57.418 16:55:42 -- scripts/common.sh@352 -- # local d=2 00:19:57.418 16:55:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:57.418 16:55:42 -- scripts/common.sh@354 -- # echo 2 00:19:57.418 16:55:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:57.418 16:55:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:57.418 16:55:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:57.418 16:55:42 -- scripts/common.sh@367 -- # return 0 00:19:57.418 16:55:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:57.418 16:55:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:57.418 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.418 --rc genhtml_branch_coverage=1 00:19:57.418 --rc genhtml_function_coverage=1 00:19:57.418 --rc genhtml_legend=1 00:19:57.418 --rc geninfo_all_blocks=1 00:19:57.418 --rc geninfo_unexecuted_blocks=1 00:19:57.418 00:19:57.418 ' 00:19:57.418 16:55:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:57.418 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.418 --rc genhtml_branch_coverage=1 00:19:57.418 --rc genhtml_function_coverage=1 00:19:57.418 --rc genhtml_legend=1 00:19:57.418 --rc geninfo_all_blocks=1 00:19:57.418 --rc geninfo_unexecuted_blocks=1 00:19:57.418 00:19:57.418 ' 00:19:57.418 16:55:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:57.418 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.418 --rc genhtml_branch_coverage=1 00:19:57.418 --rc genhtml_function_coverage=1 00:19:57.418 --rc genhtml_legend=1 00:19:57.418 --rc geninfo_all_blocks=1 00:19:57.418 --rc geninfo_unexecuted_blocks=1 00:19:57.418 00:19:57.418 ' 00:19:57.418 16:55:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:57.418 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.418 --rc genhtml_branch_coverage=1 00:19:57.418 --rc genhtml_function_coverage=1 00:19:57.418 --rc genhtml_legend=1 00:19:57.418 --rc geninfo_all_blocks=1 00:19:57.418 --rc geninfo_unexecuted_blocks=1 00:19:57.418 00:19:57.418 ' 00:19:57.418 16:55:42 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:57.418 16:55:42 -- nvmf/common.sh@7 -- # uname -s 00:19:57.418 16:55:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:57.418 16:55:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:57.418 16:55:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:57.418 16:55:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:57.418 16:55:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:57.418 16:55:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:57.418 16:55:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:57.418 16:55:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:57.418 16:55:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:57.418 16:55:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:57.418 16:55:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:57.418 16:55:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:57.418 16:55:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:57.418 16:55:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:57.418 16:55:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:57.418 16:55:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:57.418 16:55:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:57.418 16:55:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:57.418 16:55:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:57.418 16:55:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.418 16:55:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.418 16:55:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.418 16:55:42 -- paths/export.sh@5 -- # export PATH 00:19:57.418 16:55:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.418 16:55:42 -- nvmf/common.sh@46 -- # : 0 00:19:57.418 16:55:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:57.418 16:55:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:57.418 16:55:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:57.418 16:55:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:57.418 16:55:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:57.418 16:55:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:57.418 16:55:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:57.418 16:55:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:57.418 16:55:42 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:57.418 16:55:42 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:57.418 16:55:42 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:57.418 16:55:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:57.418 16:55:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:57.418 16:55:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:57.418 16:55:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:57.418 16:55:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:57.418 16:55:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:57.418 16:55:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:57.418 16:55:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:57.418 16:55:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:57.418 16:55:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:57.418 16:55:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:57.418 16:55:42 -- common/autotest_common.sh@10 -- # set +x 00:19:59.317 16:55:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:59.317 16:55:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:59.317 16:55:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:59.317 16:55:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:59.317 16:55:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:59.317 16:55:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:59.317 16:55:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:59.317 16:55:44 -- nvmf/common.sh@294 -- # net_devs=() 00:19:59.317 16:55:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:59.317 16:55:44 -- nvmf/common.sh@295 -- # e810=() 00:19:59.317 16:55:44 -- nvmf/common.sh@295 -- # local -ga e810 00:19:59.317 16:55:44 -- nvmf/common.sh@296 -- # x722=() 00:19:59.317 16:55:44 -- nvmf/common.sh@296 -- # local -ga x722 00:19:59.318 16:55:44 -- nvmf/common.sh@297 -- # mlx=() 00:19:59.318 16:55:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:59.318 16:55:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:59.318 16:55:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:59.318 16:55:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:59.318 16:55:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:59.318 16:55:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:59.318 16:55:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:59.318 16:55:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:59.318 16:55:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:59.318 16:55:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:59.318 16:55:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:59.318 16:55:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:59.318 16:55:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:59.318 16:55:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:59.318 16:55:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:59.318 16:55:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:59.318 16:55:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:59.318 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:59.318 16:55:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:59.318 16:55:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:59.318 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:59.318 16:55:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:59.318 16:55:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:59.318 16:55:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:59.318 16:55:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:59.318 16:55:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:59.318 16:55:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:59.318 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:59.318 16:55:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:59.318 16:55:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:59.318 16:55:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:59.318 16:55:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:59.318 16:55:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:59.318 16:55:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:59.318 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:59.318 16:55:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:59.318 16:55:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:59.318 16:55:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:59.318 16:55:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:59.318 16:55:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:59.318 16:55:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:59.318 16:55:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:59.318 16:55:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:59.318 16:55:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:59.318 16:55:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:59.318 16:55:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:59.318 16:55:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:59.318 16:55:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:59.318 16:55:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:59.318 16:55:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:59.318 16:55:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:59.318 16:55:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:59.318 16:55:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:59.318 16:55:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:59.318 16:55:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:59.318 16:55:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:59.318 16:55:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:59.318 16:55:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:59.318 16:55:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:59.318 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:59.318 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.211 ms 00:19:59.318 00:19:59.318 --- 10.0.0.2 ping statistics --- 00:19:59.318 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:59.318 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:19:59.318 16:55:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:59.318 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:59.318 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:19:59.318 00:19:59.318 --- 10.0.0.1 ping statistics --- 00:19:59.318 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:59.318 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:19:59.318 16:55:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:59.318 16:55:44 -- nvmf/common.sh@410 -- # return 0 00:19:59.318 16:55:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:59.318 16:55:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:59.318 16:55:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:59.318 16:55:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:59.318 16:55:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:59.318 16:55:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:59.318 16:55:44 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:59.318 16:55:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:59.318 16:55:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:59.318 16:55:44 -- common/autotest_common.sh@10 -- # set +x 00:19:59.318 16:55:44 -- nvmf/common.sh@469 -- # nvmfpid=1221743 00:19:59.318 16:55:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:59.318 16:55:44 -- nvmf/common.sh@470 -- # waitforlisten 1221743 00:19:59.318 16:55:44 -- common/autotest_common.sh@829 -- # '[' -z 1221743 ']' 00:19:59.318 16:55:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:59.318 16:55:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:59.318 16:55:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:59.318 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:59.318 16:55:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:59.318 16:55:44 -- common/autotest_common.sh@10 -- # set +x 00:19:59.318 [2024-11-16 16:55:44.965228] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:59.318 [2024-11-16 16:55:44.965318] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:59.318 [2024-11-16 16:55:45.035127] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:59.576 [2024-11-16 16:55:45.127855] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:59.576 [2024-11-16 16:55:45.128023] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:59.576 [2024-11-16 16:55:45.128043] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:59.576 [2024-11-16 16:55:45.128057] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:59.576 [2024-11-16 16:55:45.128144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:59.577 [2024-11-16 16:55:45.128202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:59.577 [2024-11-16 16:55:45.128256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:59.577 [2024-11-16 16:55:45.128258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:59.577 16:55:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:59.577 16:55:45 -- common/autotest_common.sh@862 -- # return 0 00:19:59.577 16:55:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:59.577 16:55:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:59.577 16:55:45 -- common/autotest_common.sh@10 -- # set +x 00:19:59.577 16:55:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:59.577 16:55:45 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:59.577 16:55:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.577 16:55:45 -- common/autotest_common.sh@10 -- # set +x 00:19:59.577 [2024-11-16 16:55:45.247719] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:59.577 16:55:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.577 16:55:45 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:59.577 16:55:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.577 16:55:45 -- common/autotest_common.sh@10 -- # set +x 00:19:59.577 Malloc0 00:19:59.577 16:55:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.577 16:55:45 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:59.577 16:55:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.577 16:55:45 -- common/autotest_common.sh@10 -- # set +x 00:19:59.577 16:55:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.577 16:55:45 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:59.577 16:55:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.577 16:55:45 -- common/autotest_common.sh@10 -- # set +x 00:19:59.577 16:55:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.577 16:55:45 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:59.577 16:55:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.577 16:55:45 -- common/autotest_common.sh@10 -- # set +x 00:19:59.577 [2024-11-16 16:55:45.285444] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:59.577 16:55:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.577 16:55:45 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:59.577 16:55:45 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:59.577 16:55:45 -- nvmf/common.sh@520 -- # config=() 00:19:59.577 16:55:45 -- nvmf/common.sh@520 -- # local subsystem config 00:19:59.577 16:55:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:59.577 16:55:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:59.577 { 00:19:59.577 "params": { 00:19:59.577 "name": "Nvme$subsystem", 00:19:59.577 "trtype": "$TEST_TRANSPORT", 00:19:59.577 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:59.577 "adrfam": "ipv4", 00:19:59.577 "trsvcid": "$NVMF_PORT", 00:19:59.577 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:59.577 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:59.577 "hdgst": ${hdgst:-false}, 00:19:59.577 "ddgst": ${ddgst:-false} 00:19:59.577 }, 00:19:59.577 "method": "bdev_nvme_attach_controller" 00:19:59.577 } 00:19:59.577 EOF 00:19:59.577 )") 00:19:59.577 16:55:45 -- nvmf/common.sh@542 -- # cat 00:19:59.577 16:55:45 -- nvmf/common.sh@544 -- # jq . 00:19:59.577 16:55:45 -- nvmf/common.sh@545 -- # IFS=, 00:19:59.577 16:55:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:59.577 "params": { 00:19:59.577 "name": "Nvme1", 00:19:59.577 "trtype": "tcp", 00:19:59.577 "traddr": "10.0.0.2", 00:19:59.577 "adrfam": "ipv4", 00:19:59.577 "trsvcid": "4420", 00:19:59.577 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:59.577 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:59.577 "hdgst": false, 00:19:59.577 "ddgst": false 00:19:59.577 }, 00:19:59.577 "method": "bdev_nvme_attach_controller" 00:19:59.577 }' 00:19:59.577 [2024-11-16 16:55:45.325355] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:59.577 [2024-11-16 16:55:45.325443] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid1221774 ] 00:19:59.835 [2024-11-16 16:55:45.384183] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:59.835 [2024-11-16 16:55:45.468247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:59.835 [2024-11-16 16:55:45.468301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:59.835 [2024-11-16 16:55:45.468303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:00.092 [2024-11-16 16:55:45.779370] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:00.092 [2024-11-16 16:55:45.779430] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:00.092 I/O targets: 00:20:00.092 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:00.092 00:20:00.092 00:20:00.092 CUnit - A unit testing framework for C - Version 2.1-3 00:20:00.092 http://cunit.sourceforge.net/ 00:20:00.092 00:20:00.092 00:20:00.092 Suite: bdevio tests on: Nvme1n1 00:20:00.092 Test: blockdev write read block ...passed 00:20:00.350 Test: blockdev write zeroes read block ...passed 00:20:00.350 Test: blockdev write zeroes read no split ...passed 00:20:00.350 Test: blockdev write zeroes read split ...passed 00:20:00.350 Test: blockdev write zeroes read split partial ...passed 00:20:00.350 Test: blockdev reset ...[2024-11-16 16:55:45.982987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:00.350 [2024-11-16 16:55:45.983094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6687c0 (9): Bad file descriptor 00:20:00.350 [2024-11-16 16:55:46.000322] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:00.350 passed 00:20:00.350 Test: blockdev write read 8 blocks ...passed 00:20:00.350 Test: blockdev write read size > 128k ...passed 00:20:00.350 Test: blockdev write read invalid size ...passed 00:20:00.350 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:00.350 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:00.350 Test: blockdev write read max offset ...passed 00:20:00.607 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:00.607 Test: blockdev writev readv 8 blocks ...passed 00:20:00.607 Test: blockdev writev readv 30 x 1block ...passed 00:20:00.607 Test: blockdev writev readv block ...passed 00:20:00.607 Test: blockdev writev readv size > 128k ...passed 00:20:00.607 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:00.607 Test: blockdev comparev and writev ...[2024-11-16 16:55:46.297818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.607 [2024-11-16 16:55:46.297857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:00.607 [2024-11-16 16:55:46.297881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.607 [2024-11-16 16:55:46.297898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:00.607 [2024-11-16 16:55:46.298215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.607 [2024-11-16 16:55:46.298239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:00.607 [2024-11-16 16:55:46.298261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.607 [2024-11-16 16:55:46.298276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:00.607 [2024-11-16 16:55:46.298572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.607 [2024-11-16 16:55:46.298594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:00.607 [2024-11-16 16:55:46.298626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.608 [2024-11-16 16:55:46.298645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:00.608 [2024-11-16 16:55:46.298936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.608 [2024-11-16 16:55:46.298959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:00.608 [2024-11-16 16:55:46.298979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.608 [2024-11-16 16:55:46.299002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:00.608 passed 00:20:00.866 Test: blockdev nvme passthru rw ...passed 00:20:00.866 Test: blockdev nvme passthru vendor specific ...[2024-11-16 16:55:46.381861] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:00.866 [2024-11-16 16:55:46.381889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:00.866 [2024-11-16 16:55:46.382033] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:00.866 [2024-11-16 16:55:46.382057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:00.866 [2024-11-16 16:55:46.382205] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:00.866 [2024-11-16 16:55:46.382227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:00.866 [2024-11-16 16:55:46.382371] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:00.866 [2024-11-16 16:55:46.382393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:00.866 passed 00:20:00.866 Test: blockdev nvme admin passthru ...passed 00:20:00.866 Test: blockdev copy ...passed 00:20:00.866 00:20:00.866 Run Summary: Type Total Ran Passed Failed Inactive 00:20:00.866 suites 1 1 n/a 0 0 00:20:00.866 tests 23 23 23 0 0 00:20:00.866 asserts 152 152 152 0 n/a 00:20:00.866 00:20:00.866 Elapsed time = 1.312 seconds 00:20:01.124 16:55:46 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:01.124 16:55:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:01.124 16:55:46 -- common/autotest_common.sh@10 -- # set +x 00:20:01.124 16:55:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:01.124 16:55:46 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:01.124 16:55:46 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:01.124 16:55:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:01.124 16:55:46 -- nvmf/common.sh@116 -- # sync 00:20:01.124 16:55:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:01.124 16:55:46 -- nvmf/common.sh@119 -- # set +e 00:20:01.124 16:55:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:01.124 16:55:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:01.124 rmmod nvme_tcp 00:20:01.124 rmmod nvme_fabrics 00:20:01.124 rmmod nvme_keyring 00:20:01.124 16:55:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:01.124 16:55:46 -- nvmf/common.sh@123 -- # set -e 00:20:01.124 16:55:46 -- nvmf/common.sh@124 -- # return 0 00:20:01.124 16:55:46 -- nvmf/common.sh@477 -- # '[' -n 1221743 ']' 00:20:01.124 16:55:46 -- nvmf/common.sh@478 -- # killprocess 1221743 00:20:01.124 16:55:46 -- common/autotest_common.sh@936 -- # '[' -z 1221743 ']' 00:20:01.124 16:55:46 -- common/autotest_common.sh@940 -- # kill -0 1221743 00:20:01.124 16:55:46 -- common/autotest_common.sh@941 -- # uname 00:20:01.124 16:55:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:01.124 16:55:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1221743 00:20:01.381 16:55:46 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:20:01.381 16:55:46 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:20:01.381 16:55:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1221743' 00:20:01.381 killing process with pid 1221743 00:20:01.381 16:55:46 -- common/autotest_common.sh@955 -- # kill 1221743 00:20:01.381 16:55:46 -- common/autotest_common.sh@960 -- # wait 1221743 00:20:01.640 16:55:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:01.640 16:55:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:01.640 16:55:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:01.640 16:55:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:01.640 16:55:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:01.640 16:55:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:01.640 16:55:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:01.640 16:55:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:04.175 16:55:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:04.175 00:20:04.175 real 0m6.680s 00:20:04.175 user 0m11.616s 00:20:04.175 sys 0m2.527s 00:20:04.175 16:55:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:04.175 16:55:49 -- common/autotest_common.sh@10 -- # set +x 00:20:04.175 ************************************ 00:20:04.175 END TEST nvmf_bdevio_no_huge 00:20:04.175 ************************************ 00:20:04.175 16:55:49 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:04.175 16:55:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:04.175 16:55:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:04.175 16:55:49 -- common/autotest_common.sh@10 -- # set +x 00:20:04.175 ************************************ 00:20:04.175 START TEST nvmf_tls 00:20:04.175 ************************************ 00:20:04.175 16:55:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:04.175 * Looking for test storage... 00:20:04.175 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:04.175 16:55:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:04.175 16:55:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:04.175 16:55:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:04.175 16:55:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:04.175 16:55:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:04.175 16:55:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:04.175 16:55:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:04.175 16:55:49 -- scripts/common.sh@335 -- # IFS=.-: 00:20:04.175 16:55:49 -- scripts/common.sh@335 -- # read -ra ver1 00:20:04.175 16:55:49 -- scripts/common.sh@336 -- # IFS=.-: 00:20:04.175 16:55:49 -- scripts/common.sh@336 -- # read -ra ver2 00:20:04.175 16:55:49 -- scripts/common.sh@337 -- # local 'op=<' 00:20:04.175 16:55:49 -- scripts/common.sh@339 -- # ver1_l=2 00:20:04.175 16:55:49 -- scripts/common.sh@340 -- # ver2_l=1 00:20:04.176 16:55:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:04.176 16:55:49 -- scripts/common.sh@343 -- # case "$op" in 00:20:04.176 16:55:49 -- scripts/common.sh@344 -- # : 1 00:20:04.176 16:55:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:04.176 16:55:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:04.176 16:55:49 -- scripts/common.sh@364 -- # decimal 1 00:20:04.176 16:55:49 -- scripts/common.sh@352 -- # local d=1 00:20:04.176 16:55:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:04.176 16:55:49 -- scripts/common.sh@354 -- # echo 1 00:20:04.176 16:55:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:04.176 16:55:49 -- scripts/common.sh@365 -- # decimal 2 00:20:04.176 16:55:49 -- scripts/common.sh@352 -- # local d=2 00:20:04.176 16:55:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:04.176 16:55:49 -- scripts/common.sh@354 -- # echo 2 00:20:04.176 16:55:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:04.176 16:55:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:04.176 16:55:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:04.176 16:55:49 -- scripts/common.sh@367 -- # return 0 00:20:04.176 16:55:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:04.176 16:55:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:04.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.176 --rc genhtml_branch_coverage=1 00:20:04.176 --rc genhtml_function_coverage=1 00:20:04.176 --rc genhtml_legend=1 00:20:04.176 --rc geninfo_all_blocks=1 00:20:04.176 --rc geninfo_unexecuted_blocks=1 00:20:04.176 00:20:04.176 ' 00:20:04.176 16:55:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:04.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.176 --rc genhtml_branch_coverage=1 00:20:04.176 --rc genhtml_function_coverage=1 00:20:04.176 --rc genhtml_legend=1 00:20:04.176 --rc geninfo_all_blocks=1 00:20:04.176 --rc geninfo_unexecuted_blocks=1 00:20:04.176 00:20:04.176 ' 00:20:04.176 16:55:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:04.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.176 --rc genhtml_branch_coverage=1 00:20:04.176 --rc genhtml_function_coverage=1 00:20:04.176 --rc genhtml_legend=1 00:20:04.176 --rc geninfo_all_blocks=1 00:20:04.176 --rc geninfo_unexecuted_blocks=1 00:20:04.176 00:20:04.176 ' 00:20:04.176 16:55:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:04.176 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.176 --rc genhtml_branch_coverage=1 00:20:04.176 --rc genhtml_function_coverage=1 00:20:04.177 --rc genhtml_legend=1 00:20:04.177 --rc geninfo_all_blocks=1 00:20:04.177 --rc geninfo_unexecuted_blocks=1 00:20:04.177 00:20:04.177 ' 00:20:04.177 16:55:49 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:04.177 16:55:49 -- nvmf/common.sh@7 -- # uname -s 00:20:04.177 16:55:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:04.177 16:55:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:04.177 16:55:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:04.177 16:55:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:04.177 16:55:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:04.177 16:55:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:04.177 16:55:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:04.177 16:55:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:04.177 16:55:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:04.177 16:55:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:04.177 16:55:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:04.177 16:55:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:04.177 16:55:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:04.177 16:55:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:04.177 16:55:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:04.177 16:55:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:04.177 16:55:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:04.177 16:55:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:04.177 16:55:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:04.177 16:55:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.177 16:55:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.177 16:55:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.177 16:55:49 -- paths/export.sh@5 -- # export PATH 00:20:04.178 16:55:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.178 16:55:49 -- nvmf/common.sh@46 -- # : 0 00:20:04.178 16:55:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:04.178 16:55:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:04.178 16:55:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:04.178 16:55:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:04.178 16:55:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:04.178 16:55:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:04.178 16:55:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:04.178 16:55:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:04.178 16:55:49 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:04.178 16:55:49 -- target/tls.sh@71 -- # nvmftestinit 00:20:04.178 16:55:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:04.178 16:55:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:04.178 16:55:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:04.178 16:55:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:04.178 16:55:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:04.178 16:55:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:04.178 16:55:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:04.178 16:55:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:04.178 16:55:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:04.178 16:55:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:04.178 16:55:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:04.178 16:55:49 -- common/autotest_common.sh@10 -- # set +x 00:20:06.079 16:55:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:06.079 16:55:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:06.079 16:55:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:06.079 16:55:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:06.079 16:55:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:06.079 16:55:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:06.079 16:55:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:06.079 16:55:51 -- nvmf/common.sh@294 -- # net_devs=() 00:20:06.079 16:55:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:06.079 16:55:51 -- nvmf/common.sh@295 -- # e810=() 00:20:06.079 16:55:51 -- nvmf/common.sh@295 -- # local -ga e810 00:20:06.079 16:55:51 -- nvmf/common.sh@296 -- # x722=() 00:20:06.079 16:55:51 -- nvmf/common.sh@296 -- # local -ga x722 00:20:06.079 16:55:51 -- nvmf/common.sh@297 -- # mlx=() 00:20:06.079 16:55:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:06.079 16:55:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:06.079 16:55:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:06.079 16:55:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:06.079 16:55:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:06.079 16:55:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:06.079 16:55:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:06.079 16:55:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:06.079 16:55:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:06.079 16:55:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:06.079 16:55:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:06.079 16:55:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:06.079 16:55:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:06.079 16:55:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:06.079 16:55:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:06.079 16:55:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:06.079 16:55:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:06.079 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:06.079 16:55:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:06.079 16:55:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:06.079 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:06.079 16:55:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:06.079 16:55:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:06.079 16:55:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:06.079 16:55:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:06.079 16:55:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:06.079 16:55:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:06.079 16:55:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:06.080 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:06.080 16:55:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:06.080 16:55:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:06.080 16:55:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:06.080 16:55:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:06.080 16:55:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:06.080 16:55:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:06.080 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:06.080 16:55:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:06.080 16:55:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:06.080 16:55:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:06.080 16:55:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:06.080 16:55:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:06.080 16:55:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:06.080 16:55:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:06.080 16:55:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:06.080 16:55:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:06.080 16:55:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:06.080 16:55:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:06.080 16:55:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:06.080 16:55:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:06.080 16:55:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:06.080 16:55:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:06.080 16:55:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:06.080 16:55:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:06.080 16:55:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:06.080 16:55:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:06.080 16:55:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:06.080 16:55:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:06.080 16:55:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:06.080 16:55:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:06.080 16:55:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:06.080 16:55:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:06.080 16:55:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:06.080 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:06.080 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:20:06.080 00:20:06.080 --- 10.0.0.2 ping statistics --- 00:20:06.080 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:06.080 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:20:06.080 16:55:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:06.080 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:06.080 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:20:06.080 00:20:06.080 --- 10.0.0.1 ping statistics --- 00:20:06.080 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:06.080 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:20:06.080 16:55:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:06.080 16:55:51 -- nvmf/common.sh@410 -- # return 0 00:20:06.080 16:55:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:06.080 16:55:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:06.080 16:55:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:06.080 16:55:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:06.080 16:55:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:06.080 16:55:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:06.080 16:55:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:06.080 16:55:51 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:20:06.080 16:55:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:06.080 16:55:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:06.080 16:55:51 -- common/autotest_common.sh@10 -- # set +x 00:20:06.080 16:55:51 -- nvmf/common.sh@469 -- # nvmfpid=1223995 00:20:06.080 16:55:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:20:06.080 16:55:51 -- nvmf/common.sh@470 -- # waitforlisten 1223995 00:20:06.080 16:55:51 -- common/autotest_common.sh@829 -- # '[' -z 1223995 ']' 00:20:06.080 16:55:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:06.080 16:55:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:06.080 16:55:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:06.080 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:06.080 16:55:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:06.080 16:55:51 -- common/autotest_common.sh@10 -- # set +x 00:20:06.339 [2024-11-16 16:55:51.859468] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:06.339 [2024-11-16 16:55:51.859549] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:06.339 EAL: No free 2048 kB hugepages reported on node 1 00:20:06.339 [2024-11-16 16:55:51.930344] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:06.339 [2024-11-16 16:55:52.019019] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:06.339 [2024-11-16 16:55:52.019204] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:06.339 [2024-11-16 16:55:52.019226] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:06.339 [2024-11-16 16:55:52.019242] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:06.339 [2024-11-16 16:55:52.019280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:06.339 16:55:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:06.339 16:55:52 -- common/autotest_common.sh@862 -- # return 0 00:20:06.339 16:55:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:06.339 16:55:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:06.339 16:55:52 -- common/autotest_common.sh@10 -- # set +x 00:20:06.597 16:55:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:06.597 16:55:52 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:20:06.597 16:55:52 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:20:06.597 true 00:20:06.855 16:55:52 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:06.855 16:55:52 -- target/tls.sh@82 -- # jq -r .tls_version 00:20:07.113 16:55:52 -- target/tls.sh@82 -- # version=0 00:20:07.113 16:55:52 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:20:07.113 16:55:52 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:07.371 16:55:52 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:07.371 16:55:52 -- target/tls.sh@90 -- # jq -r .tls_version 00:20:07.629 16:55:53 -- target/tls.sh@90 -- # version=13 00:20:07.629 16:55:53 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:20:07.629 16:55:53 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:20:07.629 16:55:53 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:07.629 16:55:53 -- target/tls.sh@98 -- # jq -r .tls_version 00:20:07.887 16:55:53 -- target/tls.sh@98 -- # version=7 00:20:07.887 16:55:53 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:20:07.887 16:55:53 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:07.887 16:55:53 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:20:08.145 16:55:53 -- target/tls.sh@105 -- # ktls=false 00:20:08.145 16:55:53 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:20:08.145 16:55:53 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:20:08.403 16:55:54 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:08.403 16:55:54 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:20:08.661 16:55:54 -- target/tls.sh@113 -- # ktls=true 00:20:08.661 16:55:54 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:20:08.661 16:55:54 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:20:08.919 16:55:54 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:08.919 16:55:54 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:20:09.178 16:55:54 -- target/tls.sh@121 -- # ktls=false 00:20:09.178 16:55:54 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:20:09.178 16:55:54 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:20:09.178 16:55:54 -- target/tls.sh@49 -- # local key hash crc 00:20:09.178 16:55:54 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:20:09.178 16:55:54 -- target/tls.sh@51 -- # hash=01 00:20:09.178 16:55:54 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:20:09.178 16:55:54 -- target/tls.sh@52 -- # gzip -1 -c 00:20:09.178 16:55:54 -- target/tls.sh@52 -- # tail -c8 00:20:09.178 16:55:54 -- target/tls.sh@52 -- # head -c 4 00:20:09.178 16:55:54 -- target/tls.sh@52 -- # crc='p$H�' 00:20:09.178 16:55:54 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:09.178 16:55:54 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:20:09.178 16:55:54 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:09.178 16:55:54 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:09.178 16:55:54 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:20:09.178 16:55:54 -- target/tls.sh@49 -- # local key hash crc 00:20:09.178 16:55:54 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:20:09.178 16:55:54 -- target/tls.sh@51 -- # hash=01 00:20:09.178 16:55:54 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:20:09.178 16:55:54 -- target/tls.sh@52 -- # gzip -1 -c 00:20:09.178 16:55:54 -- target/tls.sh@52 -- # tail -c8 00:20:09.178 16:55:54 -- target/tls.sh@52 -- # head -c 4 00:20:09.178 16:55:54 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:20:09.437 16:55:54 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:09.437 16:55:54 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:20:09.437 16:55:54 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:09.437 16:55:54 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:09.437 16:55:54 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:09.437 16:55:54 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:09.437 16:55:54 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:09.437 16:55:54 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:09.437 16:55:54 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:09.437 16:55:54 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:09.437 16:55:54 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:09.437 16:55:55 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:20:10.004 16:55:55 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:10.004 16:55:55 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:10.004 16:55:55 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:10.263 [2024-11-16 16:55:55.771270] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:10.263 16:55:55 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:10.521 16:55:56 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:10.521 [2024-11-16 16:55:56.268649] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:10.521 [2024-11-16 16:55:56.268896] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:10.779 16:55:56 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:10.779 malloc0 00:20:11.038 16:55:56 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:11.296 16:55:56 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:11.554 16:55:57 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:11.554 EAL: No free 2048 kB hugepages reported on node 1 00:20:21.588 Initializing NVMe Controllers 00:20:21.588 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:20:21.588 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:21.588 Initialization complete. Launching workers. 00:20:21.588 ======================================================== 00:20:21.588 Latency(us) 00:20:21.588 Device Information : IOPS MiB/s Average min max 00:20:21.588 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7781.40 30.40 8227.20 1162.44 9375.86 00:20:21.588 ======================================================== 00:20:21.588 Total : 7781.40 30.40 8227.20 1162.44 9375.86 00:20:21.588 00:20:21.588 16:56:07 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:21.588 16:56:07 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:21.588 16:56:07 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:21.588 16:56:07 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:21.588 16:56:07 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:21.588 16:56:07 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:21.588 16:56:07 -- target/tls.sh@28 -- # bdevperf_pid=1225836 00:20:21.588 16:56:07 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:21.588 16:56:07 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:21.588 16:56:07 -- target/tls.sh@31 -- # waitforlisten 1225836 /var/tmp/bdevperf.sock 00:20:21.588 16:56:07 -- common/autotest_common.sh@829 -- # '[' -z 1225836 ']' 00:20:21.588 16:56:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:21.588 16:56:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:21.588 16:56:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:21.588 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:21.588 16:56:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:21.588 16:56:07 -- common/autotest_common.sh@10 -- # set +x 00:20:21.588 [2024-11-16 16:56:07.191453] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:21.588 [2024-11-16 16:56:07.191547] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1225836 ] 00:20:21.588 EAL: No free 2048 kB hugepages reported on node 1 00:20:21.588 [2024-11-16 16:56:07.253423] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:21.845 [2024-11-16 16:56:07.340974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:22.411 16:56:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:22.411 16:56:08 -- common/autotest_common.sh@862 -- # return 0 00:20:22.411 16:56:08 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:22.976 [2024-11-16 16:56:08.445166] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:22.976 TLSTESTn1 00:20:22.976 16:56:08 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:22.976 Running I/O for 10 seconds... 00:20:32.943 00:20:32.943 Latency(us) 00:20:32.943 [2024-11-16T15:56:18.693Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:32.943 [2024-11-16T15:56:18.693Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:32.943 Verification LBA range: start 0x0 length 0x2000 00:20:32.943 TLSTESTn1 : 10.02 4656.54 18.19 0.00 0.00 27451.39 4417.61 52040.44 00:20:32.943 [2024-11-16T15:56:18.693Z] =================================================================================================================== 00:20:32.943 [2024-11-16T15:56:18.693Z] Total : 4656.54 18.19 0.00 0.00 27451.39 4417.61 52040.44 00:20:32.943 0 00:20:33.201 16:56:18 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:33.201 16:56:18 -- target/tls.sh@45 -- # killprocess 1225836 00:20:33.201 16:56:18 -- common/autotest_common.sh@936 -- # '[' -z 1225836 ']' 00:20:33.201 16:56:18 -- common/autotest_common.sh@940 -- # kill -0 1225836 00:20:33.201 16:56:18 -- common/autotest_common.sh@941 -- # uname 00:20:33.201 16:56:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:33.201 16:56:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1225836 00:20:33.201 16:56:18 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:33.201 16:56:18 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:33.201 16:56:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1225836' 00:20:33.201 killing process with pid 1225836 00:20:33.201 16:56:18 -- common/autotest_common.sh@955 -- # kill 1225836 00:20:33.201 Received shutdown signal, test time was about 10.000000 seconds 00:20:33.201 00:20:33.202 Latency(us) 00:20:33.202 [2024-11-16T15:56:18.952Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:33.202 [2024-11-16T15:56:18.952Z] =================================================================================================================== 00:20:33.202 [2024-11-16T15:56:18.952Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:33.202 16:56:18 -- common/autotest_common.sh@960 -- # wait 1225836 00:20:33.460 16:56:18 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:33.460 16:56:18 -- common/autotest_common.sh@650 -- # local es=0 00:20:33.460 16:56:18 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:33.460 16:56:18 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:33.460 16:56:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:33.460 16:56:18 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:33.460 16:56:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:33.460 16:56:18 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:33.460 16:56:18 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:33.460 16:56:18 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:33.460 16:56:18 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:33.460 16:56:18 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:33.460 16:56:18 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:33.460 16:56:18 -- target/tls.sh@28 -- # bdevperf_pid=1227318 00:20:33.460 16:56:18 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:33.460 16:56:18 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:33.460 16:56:18 -- target/tls.sh@31 -- # waitforlisten 1227318 /var/tmp/bdevperf.sock 00:20:33.460 16:56:18 -- common/autotest_common.sh@829 -- # '[' -z 1227318 ']' 00:20:33.460 16:56:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:33.460 16:56:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:33.460 16:56:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:33.460 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:33.460 16:56:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:33.460 16:56:18 -- common/autotest_common.sh@10 -- # set +x 00:20:33.460 [2024-11-16 16:56:19.012033] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:33.460 [2024-11-16 16:56:19.012121] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1227318 ] 00:20:33.460 EAL: No free 2048 kB hugepages reported on node 1 00:20:33.460 [2024-11-16 16:56:19.069097] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:33.460 [2024-11-16 16:56:19.148566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:34.393 16:56:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:34.393 16:56:19 -- common/autotest_common.sh@862 -- # return 0 00:20:34.394 16:56:19 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:34.652 [2024-11-16 16:56:20.256408] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:34.652 [2024-11-16 16:56:20.265650] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:34.652 [2024-11-16 16:56:20.266315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22ac840 (107): Transport endpoint is not connected 00:20:34.652 [2024-11-16 16:56:20.267305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22ac840 (9): Bad file descriptor 00:20:34.652 [2024-11-16 16:56:20.268305] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:34.652 [2024-11-16 16:56:20.268327] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:34.652 [2024-11-16 16:56:20.268342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:34.652 request: 00:20:34.652 { 00:20:34.652 "name": "TLSTEST", 00:20:34.652 "trtype": "tcp", 00:20:34.652 "traddr": "10.0.0.2", 00:20:34.652 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:34.652 "adrfam": "ipv4", 00:20:34.652 "trsvcid": "4420", 00:20:34.652 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:34.652 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:34.652 "method": "bdev_nvme_attach_controller", 00:20:34.652 "req_id": 1 00:20:34.652 } 00:20:34.652 Got JSON-RPC error response 00:20:34.652 response: 00:20:34.652 { 00:20:34.652 "code": -32602, 00:20:34.652 "message": "Invalid parameters" 00:20:34.652 } 00:20:34.652 16:56:20 -- target/tls.sh@36 -- # killprocess 1227318 00:20:34.652 16:56:20 -- common/autotest_common.sh@936 -- # '[' -z 1227318 ']' 00:20:34.652 16:56:20 -- common/autotest_common.sh@940 -- # kill -0 1227318 00:20:34.652 16:56:20 -- common/autotest_common.sh@941 -- # uname 00:20:34.652 16:56:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:34.652 16:56:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1227318 00:20:34.652 16:56:20 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:34.652 16:56:20 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:34.652 16:56:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1227318' 00:20:34.652 killing process with pid 1227318 00:20:34.652 16:56:20 -- common/autotest_common.sh@955 -- # kill 1227318 00:20:34.652 Received shutdown signal, test time was about 10.000000 seconds 00:20:34.652 00:20:34.652 Latency(us) 00:20:34.652 [2024-11-16T15:56:20.402Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:34.652 [2024-11-16T15:56:20.402Z] =================================================================================================================== 00:20:34.652 [2024-11-16T15:56:20.402Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:34.652 16:56:20 -- common/autotest_common.sh@960 -- # wait 1227318 00:20:34.911 16:56:20 -- target/tls.sh@37 -- # return 1 00:20:34.911 16:56:20 -- common/autotest_common.sh@653 -- # es=1 00:20:34.911 16:56:20 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:34.911 16:56:20 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:34.911 16:56:20 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:34.911 16:56:20 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:34.911 16:56:20 -- common/autotest_common.sh@650 -- # local es=0 00:20:34.911 16:56:20 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:34.911 16:56:20 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:34.911 16:56:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:34.911 16:56:20 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:34.911 16:56:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:34.911 16:56:20 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:34.911 16:56:20 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:34.911 16:56:20 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:34.911 16:56:20 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:34.911 16:56:20 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:34.911 16:56:20 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:34.911 16:56:20 -- target/tls.sh@28 -- # bdevperf_pid=1227475 00:20:34.911 16:56:20 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:34.911 16:56:20 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:34.911 16:56:20 -- target/tls.sh@31 -- # waitforlisten 1227475 /var/tmp/bdevperf.sock 00:20:34.911 16:56:20 -- common/autotest_common.sh@829 -- # '[' -z 1227475 ']' 00:20:34.911 16:56:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:34.911 16:56:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:34.911 16:56:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:34.911 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:34.911 16:56:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:34.911 16:56:20 -- common/autotest_common.sh@10 -- # set +x 00:20:34.911 [2024-11-16 16:56:20.597273] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:34.911 [2024-11-16 16:56:20.597369] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1227475 ] 00:20:34.911 EAL: No free 2048 kB hugepages reported on node 1 00:20:35.170 [2024-11-16 16:56:20.663770] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:35.170 [2024-11-16 16:56:20.753504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:36.104 16:56:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:36.104 16:56:21 -- common/autotest_common.sh@862 -- # return 0 00:20:36.104 16:56:21 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:36.104 [2024-11-16 16:56:21.815516] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:36.104 [2024-11-16 16:56:21.820747] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:36.104 [2024-11-16 16:56:21.820781] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:36.104 [2024-11-16 16:56:21.820822] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:36.104 [2024-11-16 16:56:21.821361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a23840 (107): Transport endpoint is not connected 00:20:36.104 [2024-11-16 16:56:21.822339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a23840 (9): Bad file descriptor 00:20:36.104 [2024-11-16 16:56:21.823337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:36.104 [2024-11-16 16:56:21.823359] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:36.104 [2024-11-16 16:56:21.823374] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:36.104 request: 00:20:36.104 { 00:20:36.104 "name": "TLSTEST", 00:20:36.104 "trtype": "tcp", 00:20:36.104 "traddr": "10.0.0.2", 00:20:36.104 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:36.104 "adrfam": "ipv4", 00:20:36.104 "trsvcid": "4420", 00:20:36.104 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:36.104 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:36.104 "method": "bdev_nvme_attach_controller", 00:20:36.104 "req_id": 1 00:20:36.104 } 00:20:36.104 Got JSON-RPC error response 00:20:36.104 response: 00:20:36.104 { 00:20:36.104 "code": -32602, 00:20:36.104 "message": "Invalid parameters" 00:20:36.104 } 00:20:36.104 16:56:21 -- target/tls.sh@36 -- # killprocess 1227475 00:20:36.104 16:56:21 -- common/autotest_common.sh@936 -- # '[' -z 1227475 ']' 00:20:36.104 16:56:21 -- common/autotest_common.sh@940 -- # kill -0 1227475 00:20:36.104 16:56:21 -- common/autotest_common.sh@941 -- # uname 00:20:36.104 16:56:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:36.104 16:56:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1227475 00:20:36.366 16:56:21 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:36.366 16:56:21 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:36.366 16:56:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1227475' 00:20:36.366 killing process with pid 1227475 00:20:36.366 16:56:21 -- common/autotest_common.sh@955 -- # kill 1227475 00:20:36.366 Received shutdown signal, test time was about 10.000000 seconds 00:20:36.366 00:20:36.366 Latency(us) 00:20:36.366 [2024-11-16T15:56:22.116Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:36.366 [2024-11-16T15:56:22.116Z] =================================================================================================================== 00:20:36.366 [2024-11-16T15:56:22.116Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:36.366 16:56:21 -- common/autotest_common.sh@960 -- # wait 1227475 00:20:36.366 16:56:22 -- target/tls.sh@37 -- # return 1 00:20:36.366 16:56:22 -- common/autotest_common.sh@653 -- # es=1 00:20:36.366 16:56:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:36.366 16:56:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:36.366 16:56:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:36.366 16:56:22 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:36.366 16:56:22 -- common/autotest_common.sh@650 -- # local es=0 00:20:36.366 16:56:22 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:36.366 16:56:22 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:36.366 16:56:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:36.366 16:56:22 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:36.366 16:56:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:36.366 16:56:22 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:36.366 16:56:22 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:36.366 16:56:22 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:36.366 16:56:22 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:36.366 16:56:22 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:36.366 16:56:22 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:36.366 16:56:22 -- target/tls.sh@28 -- # bdevperf_pid=1227749 00:20:36.366 16:56:22 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:36.366 16:56:22 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:36.366 16:56:22 -- target/tls.sh@31 -- # waitforlisten 1227749 /var/tmp/bdevperf.sock 00:20:36.366 16:56:22 -- common/autotest_common.sh@829 -- # '[' -z 1227749 ']' 00:20:36.366 16:56:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:36.366 16:56:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:36.366 16:56:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:36.366 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:36.366 16:56:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:36.366 16:56:22 -- common/autotest_common.sh@10 -- # set +x 00:20:36.625 [2024-11-16 16:56:22.134667] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:36.625 [2024-11-16 16:56:22.134757] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1227749 ] 00:20:36.625 EAL: No free 2048 kB hugepages reported on node 1 00:20:36.625 [2024-11-16 16:56:22.190867] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:36.625 [2024-11-16 16:56:22.269903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:37.559 16:56:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:37.559 16:56:23 -- common/autotest_common.sh@862 -- # return 0 00:20:37.559 16:56:23 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:37.817 [2024-11-16 16:56:23.348836] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:37.817 [2024-11-16 16:56:23.353946] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:37.817 [2024-11-16 16:56:23.353979] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:37.817 [2024-11-16 16:56:23.354053] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:37.817 [2024-11-16 16:56:23.354561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdd3840 (107): Transport endpoint is not connected 00:20:37.817 [2024-11-16 16:56:23.355551] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdd3840 (9): Bad file descriptor 00:20:37.817 [2024-11-16 16:56:23.356550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:37.817 [2024-11-16 16:56:23.356571] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:37.817 [2024-11-16 16:56:23.356586] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:37.817 request: 00:20:37.817 { 00:20:37.817 "name": "TLSTEST", 00:20:37.817 "trtype": "tcp", 00:20:37.817 "traddr": "10.0.0.2", 00:20:37.817 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:37.817 "adrfam": "ipv4", 00:20:37.817 "trsvcid": "4420", 00:20:37.817 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:37.817 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:37.817 "method": "bdev_nvme_attach_controller", 00:20:37.817 "req_id": 1 00:20:37.817 } 00:20:37.817 Got JSON-RPC error response 00:20:37.817 response: 00:20:37.817 { 00:20:37.817 "code": -32602, 00:20:37.817 "message": "Invalid parameters" 00:20:37.817 } 00:20:37.817 16:56:23 -- target/tls.sh@36 -- # killprocess 1227749 00:20:37.817 16:56:23 -- common/autotest_common.sh@936 -- # '[' -z 1227749 ']' 00:20:37.817 16:56:23 -- common/autotest_common.sh@940 -- # kill -0 1227749 00:20:37.817 16:56:23 -- common/autotest_common.sh@941 -- # uname 00:20:37.817 16:56:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:37.817 16:56:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1227749 00:20:37.817 16:56:23 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:37.817 16:56:23 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:37.817 16:56:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1227749' 00:20:37.817 killing process with pid 1227749 00:20:37.817 16:56:23 -- common/autotest_common.sh@955 -- # kill 1227749 00:20:37.817 Received shutdown signal, test time was about 10.000000 seconds 00:20:37.817 00:20:37.817 Latency(us) 00:20:37.817 [2024-11-16T15:56:23.567Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:37.817 [2024-11-16T15:56:23.567Z] =================================================================================================================== 00:20:37.817 [2024-11-16T15:56:23.567Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:37.817 16:56:23 -- common/autotest_common.sh@960 -- # wait 1227749 00:20:38.076 16:56:23 -- target/tls.sh@37 -- # return 1 00:20:38.076 16:56:23 -- common/autotest_common.sh@653 -- # es=1 00:20:38.076 16:56:23 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:38.076 16:56:23 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:38.076 16:56:23 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:38.076 16:56:23 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:38.076 16:56:23 -- common/autotest_common.sh@650 -- # local es=0 00:20:38.076 16:56:23 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:38.076 16:56:23 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:38.076 16:56:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:38.076 16:56:23 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:38.076 16:56:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:38.076 16:56:23 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:38.076 16:56:23 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:38.076 16:56:23 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:38.076 16:56:23 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:38.076 16:56:23 -- target/tls.sh@23 -- # psk= 00:20:38.076 16:56:23 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:38.076 16:56:23 -- target/tls.sh@28 -- # bdevperf_pid=1227894 00:20:38.076 16:56:23 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:38.076 16:56:23 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:38.076 16:56:23 -- target/tls.sh@31 -- # waitforlisten 1227894 /var/tmp/bdevperf.sock 00:20:38.076 16:56:23 -- common/autotest_common.sh@829 -- # '[' -z 1227894 ']' 00:20:38.076 16:56:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:38.076 16:56:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:38.076 16:56:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:38.076 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:38.076 16:56:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:38.076 16:56:23 -- common/autotest_common.sh@10 -- # set +x 00:20:38.076 [2024-11-16 16:56:23.681203] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:38.076 [2024-11-16 16:56:23.681273] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1227894 ] 00:20:38.076 EAL: No free 2048 kB hugepages reported on node 1 00:20:38.076 [2024-11-16 16:56:23.738185] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:38.076 [2024-11-16 16:56:23.818277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:39.009 16:56:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:39.009 16:56:24 -- common/autotest_common.sh@862 -- # return 0 00:20:39.009 16:56:24 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:39.267 [2024-11-16 16:56:24.967642] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:39.267 [2024-11-16 16:56:24.968973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1706dd0 (9): Bad file descriptor 00:20:39.267 [2024-11-16 16:56:24.969969] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:39.267 [2024-11-16 16:56:24.969993] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:39.267 [2024-11-16 16:56:24.970008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:39.267 request: 00:20:39.267 { 00:20:39.267 "name": "TLSTEST", 00:20:39.267 "trtype": "tcp", 00:20:39.267 "traddr": "10.0.0.2", 00:20:39.267 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:39.267 "adrfam": "ipv4", 00:20:39.267 "trsvcid": "4420", 00:20:39.267 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:39.267 "method": "bdev_nvme_attach_controller", 00:20:39.267 "req_id": 1 00:20:39.267 } 00:20:39.267 Got JSON-RPC error response 00:20:39.267 response: 00:20:39.267 { 00:20:39.267 "code": -32602, 00:20:39.267 "message": "Invalid parameters" 00:20:39.267 } 00:20:39.267 16:56:24 -- target/tls.sh@36 -- # killprocess 1227894 00:20:39.267 16:56:24 -- common/autotest_common.sh@936 -- # '[' -z 1227894 ']' 00:20:39.267 16:56:24 -- common/autotest_common.sh@940 -- # kill -0 1227894 00:20:39.267 16:56:24 -- common/autotest_common.sh@941 -- # uname 00:20:39.267 16:56:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:39.267 16:56:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1227894 00:20:39.525 16:56:25 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:39.525 16:56:25 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:39.525 16:56:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1227894' 00:20:39.525 killing process with pid 1227894 00:20:39.525 16:56:25 -- common/autotest_common.sh@955 -- # kill 1227894 00:20:39.525 Received shutdown signal, test time was about 10.000000 seconds 00:20:39.525 00:20:39.525 Latency(us) 00:20:39.525 [2024-11-16T15:56:25.275Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:39.525 [2024-11-16T15:56:25.275Z] =================================================================================================================== 00:20:39.525 [2024-11-16T15:56:25.275Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:39.525 16:56:25 -- common/autotest_common.sh@960 -- # wait 1227894 00:20:39.525 16:56:25 -- target/tls.sh@37 -- # return 1 00:20:39.525 16:56:25 -- common/autotest_common.sh@653 -- # es=1 00:20:39.525 16:56:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:39.525 16:56:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:39.525 16:56:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:39.525 16:56:25 -- target/tls.sh@167 -- # killprocess 1223995 00:20:39.525 16:56:25 -- common/autotest_common.sh@936 -- # '[' -z 1223995 ']' 00:20:39.525 16:56:25 -- common/autotest_common.sh@940 -- # kill -0 1223995 00:20:39.525 16:56:25 -- common/autotest_common.sh@941 -- # uname 00:20:39.525 16:56:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:39.525 16:56:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1223995 00:20:39.784 16:56:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:39.784 16:56:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:39.784 16:56:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1223995' 00:20:39.784 killing process with pid 1223995 00:20:39.784 16:56:25 -- common/autotest_common.sh@955 -- # kill 1223995 00:20:39.784 16:56:25 -- common/autotest_common.sh@960 -- # wait 1223995 00:20:39.784 16:56:25 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:39.784 16:56:25 -- target/tls.sh@49 -- # local key hash crc 00:20:39.784 16:56:25 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:39.784 16:56:25 -- target/tls.sh@51 -- # hash=02 00:20:39.784 16:56:25 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:39.784 16:56:25 -- target/tls.sh@52 -- # gzip -1 -c 00:20:39.784 16:56:25 -- target/tls.sh@52 -- # head -c 4 00:20:39.784 16:56:25 -- target/tls.sh@52 -- # tail -c8 00:20:39.784 16:56:25 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:39.784 16:56:25 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:39.784 16:56:25 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:40.042 16:56:25 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:40.042 16:56:25 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:40.042 16:56:25 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:40.042 16:56:25 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:40.042 16:56:25 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:40.042 16:56:25 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:40.042 16:56:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:40.042 16:56:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:40.042 16:56:25 -- common/autotest_common.sh@10 -- # set +x 00:20:40.042 16:56:25 -- nvmf/common.sh@469 -- # nvmfpid=1228188 00:20:40.042 16:56:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:40.042 16:56:25 -- nvmf/common.sh@470 -- # waitforlisten 1228188 00:20:40.042 16:56:25 -- common/autotest_common.sh@829 -- # '[' -z 1228188 ']' 00:20:40.042 16:56:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:40.042 16:56:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:40.042 16:56:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:40.042 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:40.042 16:56:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:40.042 16:56:25 -- common/autotest_common.sh@10 -- # set +x 00:20:40.042 [2024-11-16 16:56:25.589102] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:40.042 [2024-11-16 16:56:25.589197] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:40.042 EAL: No free 2048 kB hugepages reported on node 1 00:20:40.042 [2024-11-16 16:56:25.656063] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:40.042 [2024-11-16 16:56:25.741647] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:40.042 [2024-11-16 16:56:25.741828] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:40.042 [2024-11-16 16:56:25.741850] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:40.042 [2024-11-16 16:56:25.741865] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:40.042 [2024-11-16 16:56:25.741894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:40.976 16:56:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:40.976 16:56:26 -- common/autotest_common.sh@862 -- # return 0 00:20:40.976 16:56:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:40.976 16:56:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:40.976 16:56:26 -- common/autotest_common.sh@10 -- # set +x 00:20:40.976 16:56:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:40.976 16:56:26 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:40.976 16:56:26 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:40.976 16:56:26 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:41.234 [2024-11-16 16:56:26.889948] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:41.234 16:56:26 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:41.492 16:56:27 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:41.749 [2024-11-16 16:56:27.463477] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:41.749 [2024-11-16 16:56:27.463759] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:41.749 16:56:27 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:42.006 malloc0 00:20:42.006 16:56:27 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:42.264 16:56:27 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:42.521 16:56:28 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:42.521 16:56:28 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:42.521 16:56:28 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:42.521 16:56:28 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:42.521 16:56:28 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:42.521 16:56:28 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:42.521 16:56:28 -- target/tls.sh@28 -- # bdevperf_pid=1228493 00:20:42.521 16:56:28 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:42.521 16:56:28 -- target/tls.sh@31 -- # waitforlisten 1228493 /var/tmp/bdevperf.sock 00:20:42.521 16:56:28 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:42.521 16:56:28 -- common/autotest_common.sh@829 -- # '[' -z 1228493 ']' 00:20:42.521 16:56:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:42.521 16:56:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:42.522 16:56:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:42.522 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:42.522 16:56:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:42.522 16:56:28 -- common/autotest_common.sh@10 -- # set +x 00:20:42.780 [2024-11-16 16:56:28.286962] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:42.780 [2024-11-16 16:56:28.287041] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1228493 ] 00:20:42.780 EAL: No free 2048 kB hugepages reported on node 1 00:20:42.780 [2024-11-16 16:56:28.347213] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:42.780 [2024-11-16 16:56:28.429136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:43.712 16:56:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:43.712 16:56:29 -- common/autotest_common.sh@862 -- # return 0 00:20:43.712 16:56:29 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:43.712 [2024-11-16 16:56:29.460902] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:43.970 TLSTESTn1 00:20:43.970 16:56:29 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:43.970 Running I/O for 10 seconds... 00:20:56.164 00:20:56.164 Latency(us) 00:20:56.164 [2024-11-16T15:56:41.914Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:56.164 [2024-11-16T15:56:41.914Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:56.164 Verification LBA range: start 0x0 length 0x2000 00:20:56.164 TLSTESTn1 : 10.03 4576.17 17.88 0.00 0.00 27926.73 4878.79 82332.63 00:20:56.164 [2024-11-16T15:56:41.914Z] =================================================================================================================== 00:20:56.164 [2024-11-16T15:56:41.914Z] Total : 4576.17 17.88 0.00 0.00 27926.73 4878.79 82332.63 00:20:56.164 0 00:20:56.164 16:56:39 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:56.164 16:56:39 -- target/tls.sh@45 -- # killprocess 1228493 00:20:56.164 16:56:39 -- common/autotest_common.sh@936 -- # '[' -z 1228493 ']' 00:20:56.164 16:56:39 -- common/autotest_common.sh@940 -- # kill -0 1228493 00:20:56.164 16:56:39 -- common/autotest_common.sh@941 -- # uname 00:20:56.164 16:56:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:56.164 16:56:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1228493 00:20:56.164 16:56:39 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:56.164 16:56:39 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:56.164 16:56:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1228493' 00:20:56.164 killing process with pid 1228493 00:20:56.164 16:56:39 -- common/autotest_common.sh@955 -- # kill 1228493 00:20:56.164 Received shutdown signal, test time was about 10.000000 seconds 00:20:56.164 00:20:56.164 Latency(us) 00:20:56.164 [2024-11-16T15:56:41.914Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:56.164 [2024-11-16T15:56:41.914Z] =================================================================================================================== 00:20:56.164 [2024-11-16T15:56:41.914Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:56.164 16:56:39 -- common/autotest_common.sh@960 -- # wait 1228493 00:20:56.164 16:56:39 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:56.164 16:56:39 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:56.164 16:56:39 -- common/autotest_common.sh@650 -- # local es=0 00:20:56.164 16:56:39 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:56.164 16:56:39 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:56.164 16:56:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:56.164 16:56:39 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:56.164 16:56:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:56.164 16:56:39 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:56.164 16:56:39 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:56.164 16:56:39 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:56.164 16:56:39 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:56.164 16:56:39 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:56.164 16:56:39 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:56.164 16:56:39 -- target/tls.sh@28 -- # bdevperf_pid=1229860 00:20:56.164 16:56:39 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:56.164 16:56:39 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:56.164 16:56:39 -- target/tls.sh@31 -- # waitforlisten 1229860 /var/tmp/bdevperf.sock 00:20:56.164 16:56:39 -- common/autotest_common.sh@829 -- # '[' -z 1229860 ']' 00:20:56.164 16:56:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:56.164 16:56:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:56.164 16:56:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:56.164 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:56.164 16:56:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:56.164 16:56:39 -- common/autotest_common.sh@10 -- # set +x 00:20:56.164 [2024-11-16 16:56:40.026144] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:56.164 [2024-11-16 16:56:40.026241] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1229860 ] 00:20:56.164 EAL: No free 2048 kB hugepages reported on node 1 00:20:56.164 [2024-11-16 16:56:40.086843] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:56.164 [2024-11-16 16:56:40.173240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:56.164 16:56:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:56.164 16:56:41 -- common/autotest_common.sh@862 -- # return 0 00:20:56.164 16:56:41 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:56.164 [2024-11-16 16:56:41.243160] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:56.165 [2024-11-16 16:56:41.243216] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:56.165 request: 00:20:56.165 { 00:20:56.165 "name": "TLSTEST", 00:20:56.165 "trtype": "tcp", 00:20:56.165 "traddr": "10.0.0.2", 00:20:56.165 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:56.165 "adrfam": "ipv4", 00:20:56.165 "trsvcid": "4420", 00:20:56.165 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:56.165 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:56.165 "method": "bdev_nvme_attach_controller", 00:20:56.165 "req_id": 1 00:20:56.165 } 00:20:56.165 Got JSON-RPC error response 00:20:56.165 response: 00:20:56.165 { 00:20:56.165 "code": -22, 00:20:56.165 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:56.165 } 00:20:56.165 16:56:41 -- target/tls.sh@36 -- # killprocess 1229860 00:20:56.165 16:56:41 -- common/autotest_common.sh@936 -- # '[' -z 1229860 ']' 00:20:56.165 16:56:41 -- common/autotest_common.sh@940 -- # kill -0 1229860 00:20:56.165 16:56:41 -- common/autotest_common.sh@941 -- # uname 00:20:56.165 16:56:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:56.165 16:56:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1229860 00:20:56.165 16:56:41 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:56.165 16:56:41 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:56.165 16:56:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1229860' 00:20:56.165 killing process with pid 1229860 00:20:56.165 16:56:41 -- common/autotest_common.sh@955 -- # kill 1229860 00:20:56.165 Received shutdown signal, test time was about 10.000000 seconds 00:20:56.165 00:20:56.165 Latency(us) 00:20:56.165 [2024-11-16T15:56:41.915Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:56.165 [2024-11-16T15:56:41.915Z] =================================================================================================================== 00:20:56.165 [2024-11-16T15:56:41.915Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:56.165 16:56:41 -- common/autotest_common.sh@960 -- # wait 1229860 00:20:56.165 16:56:41 -- target/tls.sh@37 -- # return 1 00:20:56.165 16:56:41 -- common/autotest_common.sh@653 -- # es=1 00:20:56.165 16:56:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:56.165 16:56:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:56.165 16:56:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:56.165 16:56:41 -- target/tls.sh@183 -- # killprocess 1228188 00:20:56.165 16:56:41 -- common/autotest_common.sh@936 -- # '[' -z 1228188 ']' 00:20:56.165 16:56:41 -- common/autotest_common.sh@940 -- # kill -0 1228188 00:20:56.165 16:56:41 -- common/autotest_common.sh@941 -- # uname 00:20:56.165 16:56:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:56.165 16:56:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1228188 00:20:56.165 16:56:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:56.165 16:56:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:56.165 16:56:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1228188' 00:20:56.165 killing process with pid 1228188 00:20:56.165 16:56:41 -- common/autotest_common.sh@955 -- # kill 1228188 00:20:56.165 16:56:41 -- common/autotest_common.sh@960 -- # wait 1228188 00:20:56.165 16:56:41 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:56.165 16:56:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:56.165 16:56:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:56.165 16:56:41 -- common/autotest_common.sh@10 -- # set +x 00:20:56.165 16:56:41 -- nvmf/common.sh@469 -- # nvmfpid=1230140 00:20:56.165 16:56:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:56.165 16:56:41 -- nvmf/common.sh@470 -- # waitforlisten 1230140 00:20:56.165 16:56:41 -- common/autotest_common.sh@829 -- # '[' -z 1230140 ']' 00:20:56.165 16:56:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:56.165 16:56:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:56.165 16:56:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:56.165 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:56.165 16:56:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:56.165 16:56:41 -- common/autotest_common.sh@10 -- # set +x 00:20:56.165 [2024-11-16 16:56:41.858069] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:56.165 [2024-11-16 16:56:41.858161] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:56.165 EAL: No free 2048 kB hugepages reported on node 1 00:20:56.423 [2024-11-16 16:56:41.925452] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:56.423 [2024-11-16 16:56:42.010638] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:56.423 [2024-11-16 16:56:42.010817] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:56.423 [2024-11-16 16:56:42.010838] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:56.423 [2024-11-16 16:56:42.010863] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:56.423 [2024-11-16 16:56:42.010895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:57.356 16:56:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:57.356 16:56:42 -- common/autotest_common.sh@862 -- # return 0 00:20:57.356 16:56:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:57.356 16:56:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:57.356 16:56:42 -- common/autotest_common.sh@10 -- # set +x 00:20:57.356 16:56:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:57.356 16:56:42 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:57.356 16:56:42 -- common/autotest_common.sh@650 -- # local es=0 00:20:57.356 16:56:42 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:57.356 16:56:42 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:20:57.356 16:56:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:57.356 16:56:42 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:20:57.356 16:56:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:57.356 16:56:42 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:57.356 16:56:42 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:57.356 16:56:42 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:57.356 [2024-11-16 16:56:43.050243] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:57.356 16:56:43 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:57.613 16:56:43 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:57.871 [2024-11-16 16:56:43.543602] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:57.871 [2024-11-16 16:56:43.543911] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:57.871 16:56:43 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:58.130 malloc0 00:20:58.130 16:56:43 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:58.387 16:56:44 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:58.644 [2024-11-16 16:56:44.289416] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:58.644 [2024-11-16 16:56:44.289458] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:58.644 [2024-11-16 16:56:44.289492] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:58.644 request: 00:20:58.644 { 00:20:58.644 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:58.644 "host": "nqn.2016-06.io.spdk:host1", 00:20:58.644 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:58.644 "method": "nvmf_subsystem_add_host", 00:20:58.644 "req_id": 1 00:20:58.644 } 00:20:58.644 Got JSON-RPC error response 00:20:58.644 response: 00:20:58.644 { 00:20:58.644 "code": -32603, 00:20:58.644 "message": "Internal error" 00:20:58.644 } 00:20:58.644 16:56:44 -- common/autotest_common.sh@653 -- # es=1 00:20:58.644 16:56:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:58.644 16:56:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:58.644 16:56:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:58.644 16:56:44 -- target/tls.sh@189 -- # killprocess 1230140 00:20:58.644 16:56:44 -- common/autotest_common.sh@936 -- # '[' -z 1230140 ']' 00:20:58.644 16:56:44 -- common/autotest_common.sh@940 -- # kill -0 1230140 00:20:58.644 16:56:44 -- common/autotest_common.sh@941 -- # uname 00:20:58.644 16:56:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:58.644 16:56:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1230140 00:20:58.644 16:56:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:58.644 16:56:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:58.644 16:56:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1230140' 00:20:58.644 killing process with pid 1230140 00:20:58.644 16:56:44 -- common/autotest_common.sh@955 -- # kill 1230140 00:20:58.644 16:56:44 -- common/autotest_common.sh@960 -- # wait 1230140 00:20:58.902 16:56:44 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:58.902 16:56:44 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:20:58.902 16:56:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:58.902 16:56:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:58.902 16:56:44 -- common/autotest_common.sh@10 -- # set +x 00:20:58.902 16:56:44 -- nvmf/common.sh@469 -- # nvmfpid=1230495 00:20:58.902 16:56:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:58.902 16:56:44 -- nvmf/common.sh@470 -- # waitforlisten 1230495 00:20:58.902 16:56:44 -- common/autotest_common.sh@829 -- # '[' -z 1230495 ']' 00:20:58.902 16:56:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:58.902 16:56:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:58.902 16:56:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:58.902 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:58.902 16:56:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:58.902 16:56:44 -- common/autotest_common.sh@10 -- # set +x 00:20:58.902 [2024-11-16 16:56:44.630954] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:58.902 [2024-11-16 16:56:44.631040] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:59.160 EAL: No free 2048 kB hugepages reported on node 1 00:20:59.160 [2024-11-16 16:56:44.698682] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:59.160 [2024-11-16 16:56:44.786150] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:59.160 [2024-11-16 16:56:44.786329] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:59.160 [2024-11-16 16:56:44.786350] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:59.160 [2024-11-16 16:56:44.786365] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:59.160 [2024-11-16 16:56:44.786396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:00.094 16:56:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:00.094 16:56:45 -- common/autotest_common.sh@862 -- # return 0 00:21:00.094 16:56:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:00.094 16:56:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:00.094 16:56:45 -- common/autotest_common.sh@10 -- # set +x 00:21:00.094 16:56:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:00.094 16:56:45 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:00.094 16:56:45 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:00.094 16:56:45 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:00.352 [2024-11-16 16:56:45.847146] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:00.352 16:56:45 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:00.610 16:56:46 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:00.610 [2024-11-16 16:56:46.352516] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:00.610 [2024-11-16 16:56:46.352845] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:00.869 16:56:46 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:00.869 malloc0 00:21:01.127 16:56:46 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:01.388 16:56:46 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:01.647 16:56:47 -- target/tls.sh@197 -- # bdevperf_pid=1230875 00:21:01.647 16:56:47 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:01.647 16:56:47 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:01.647 16:56:47 -- target/tls.sh@200 -- # waitforlisten 1230875 /var/tmp/bdevperf.sock 00:21:01.647 16:56:47 -- common/autotest_common.sh@829 -- # '[' -z 1230875 ']' 00:21:01.647 16:56:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:01.647 16:56:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:01.647 16:56:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:01.647 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:01.647 16:56:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:01.647 16:56:47 -- common/autotest_common.sh@10 -- # set +x 00:21:01.647 [2024-11-16 16:56:47.175926] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:01.647 [2024-11-16 16:56:47.176012] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1230875 ] 00:21:01.647 EAL: No free 2048 kB hugepages reported on node 1 00:21:01.647 [2024-11-16 16:56:47.233304] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:01.647 [2024-11-16 16:56:47.316832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:02.579 16:56:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:02.579 16:56:48 -- common/autotest_common.sh@862 -- # return 0 00:21:02.579 16:56:48 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:02.837 [2024-11-16 16:56:48.444725] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:02.837 TLSTESTn1 00:21:02.837 16:56:48 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:21:03.403 16:56:48 -- target/tls.sh@205 -- # tgtconf='{ 00:21:03.403 "subsystems": [ 00:21:03.403 { 00:21:03.403 "subsystem": "iobuf", 00:21:03.403 "config": [ 00:21:03.403 { 00:21:03.403 "method": "iobuf_set_options", 00:21:03.403 "params": { 00:21:03.403 "small_pool_count": 8192, 00:21:03.403 "large_pool_count": 1024, 00:21:03.403 "small_bufsize": 8192, 00:21:03.403 "large_bufsize": 135168 00:21:03.403 } 00:21:03.403 } 00:21:03.403 ] 00:21:03.403 }, 00:21:03.403 { 00:21:03.403 "subsystem": "sock", 00:21:03.403 "config": [ 00:21:03.403 { 00:21:03.403 "method": "sock_impl_set_options", 00:21:03.403 "params": { 00:21:03.403 "impl_name": "posix", 00:21:03.403 "recv_buf_size": 2097152, 00:21:03.403 "send_buf_size": 2097152, 00:21:03.403 "enable_recv_pipe": true, 00:21:03.403 "enable_quickack": false, 00:21:03.403 "enable_placement_id": 0, 00:21:03.403 "enable_zerocopy_send_server": true, 00:21:03.403 "enable_zerocopy_send_client": false, 00:21:03.403 "zerocopy_threshold": 0, 00:21:03.403 "tls_version": 0, 00:21:03.403 "enable_ktls": false 00:21:03.403 } 00:21:03.403 }, 00:21:03.403 { 00:21:03.403 "method": "sock_impl_set_options", 00:21:03.403 "params": { 00:21:03.403 "impl_name": "ssl", 00:21:03.403 "recv_buf_size": 4096, 00:21:03.403 "send_buf_size": 4096, 00:21:03.403 "enable_recv_pipe": true, 00:21:03.403 "enable_quickack": false, 00:21:03.403 "enable_placement_id": 0, 00:21:03.403 "enable_zerocopy_send_server": true, 00:21:03.403 "enable_zerocopy_send_client": false, 00:21:03.403 "zerocopy_threshold": 0, 00:21:03.403 "tls_version": 0, 00:21:03.403 "enable_ktls": false 00:21:03.403 } 00:21:03.403 } 00:21:03.403 ] 00:21:03.403 }, 00:21:03.403 { 00:21:03.403 "subsystem": "vmd", 00:21:03.403 "config": [] 00:21:03.403 }, 00:21:03.403 { 00:21:03.403 "subsystem": "accel", 00:21:03.403 "config": [ 00:21:03.403 { 00:21:03.403 "method": "accel_set_options", 00:21:03.403 "params": { 00:21:03.403 "small_cache_size": 128, 00:21:03.403 "large_cache_size": 16, 00:21:03.403 "task_count": 2048, 00:21:03.403 "sequence_count": 2048, 00:21:03.403 "buf_count": 2048 00:21:03.403 } 00:21:03.403 } 00:21:03.403 ] 00:21:03.403 }, 00:21:03.403 { 00:21:03.403 "subsystem": "bdev", 00:21:03.403 "config": [ 00:21:03.403 { 00:21:03.403 "method": "bdev_set_options", 00:21:03.403 "params": { 00:21:03.403 "bdev_io_pool_size": 65535, 00:21:03.403 "bdev_io_cache_size": 256, 00:21:03.403 "bdev_auto_examine": true, 00:21:03.403 "iobuf_small_cache_size": 128, 00:21:03.403 "iobuf_large_cache_size": 16 00:21:03.403 } 00:21:03.403 }, 00:21:03.403 { 00:21:03.403 "method": "bdev_raid_set_options", 00:21:03.403 "params": { 00:21:03.403 "process_window_size_kb": 1024 00:21:03.403 } 00:21:03.403 }, 00:21:03.403 { 00:21:03.403 "method": "bdev_iscsi_set_options", 00:21:03.403 "params": { 00:21:03.403 "timeout_sec": 30 00:21:03.403 } 00:21:03.403 }, 00:21:03.403 { 00:21:03.403 "method": "bdev_nvme_set_options", 00:21:03.403 "params": { 00:21:03.403 "action_on_timeout": "none", 00:21:03.403 "timeout_us": 0, 00:21:03.403 "timeout_admin_us": 0, 00:21:03.403 "keep_alive_timeout_ms": 10000, 00:21:03.403 "transport_retry_count": 4, 00:21:03.403 "arbitration_burst": 0, 00:21:03.403 "low_priority_weight": 0, 00:21:03.403 "medium_priority_weight": 0, 00:21:03.403 "high_priority_weight": 0, 00:21:03.403 "nvme_adminq_poll_period_us": 10000, 00:21:03.403 "nvme_ioq_poll_period_us": 0, 00:21:03.403 "io_queue_requests": 0, 00:21:03.403 "delay_cmd_submit": true, 00:21:03.403 "bdev_retry_count": 3, 00:21:03.403 "transport_ack_timeout": 0, 00:21:03.403 "ctrlr_loss_timeout_sec": 0, 00:21:03.403 "reconnect_delay_sec": 0, 00:21:03.403 "fast_io_fail_timeout_sec": 0, 00:21:03.403 "generate_uuids": false, 00:21:03.403 "transport_tos": 0, 00:21:03.403 "io_path_stat": false, 00:21:03.403 "allow_accel_sequence": false 00:21:03.403 } 00:21:03.403 }, 00:21:03.403 { 00:21:03.403 "method": "bdev_nvme_set_hotplug", 00:21:03.403 "params": { 00:21:03.403 "period_us": 100000, 00:21:03.403 "enable": false 00:21:03.403 } 00:21:03.403 }, 00:21:03.403 { 00:21:03.403 "method": "bdev_malloc_create", 00:21:03.403 "params": { 00:21:03.403 "name": "malloc0", 00:21:03.403 "num_blocks": 8192, 00:21:03.403 "block_size": 4096, 00:21:03.404 "physical_block_size": 4096, 00:21:03.404 "uuid": "5e66570c-ca91-4431-838c-98cd551259b1", 00:21:03.404 "optimal_io_boundary": 0 00:21:03.404 } 00:21:03.404 }, 00:21:03.404 { 00:21:03.404 "method": "bdev_wait_for_examine" 00:21:03.404 } 00:21:03.404 ] 00:21:03.404 }, 00:21:03.404 { 00:21:03.404 "subsystem": "nbd", 00:21:03.404 "config": [] 00:21:03.404 }, 00:21:03.404 { 00:21:03.404 "subsystem": "scheduler", 00:21:03.404 "config": [ 00:21:03.404 { 00:21:03.404 "method": "framework_set_scheduler", 00:21:03.404 "params": { 00:21:03.404 "name": "static" 00:21:03.404 } 00:21:03.404 } 00:21:03.404 ] 00:21:03.404 }, 00:21:03.404 { 00:21:03.404 "subsystem": "nvmf", 00:21:03.404 "config": [ 00:21:03.404 { 00:21:03.404 "method": "nvmf_set_config", 00:21:03.404 "params": { 00:21:03.404 "discovery_filter": "match_any", 00:21:03.404 "admin_cmd_passthru": { 00:21:03.404 "identify_ctrlr": false 00:21:03.404 } 00:21:03.404 } 00:21:03.404 }, 00:21:03.404 { 00:21:03.404 "method": "nvmf_set_max_subsystems", 00:21:03.404 "params": { 00:21:03.404 "max_subsystems": 1024 00:21:03.404 } 00:21:03.404 }, 00:21:03.404 { 00:21:03.404 "method": "nvmf_set_crdt", 00:21:03.404 "params": { 00:21:03.404 "crdt1": 0, 00:21:03.404 "crdt2": 0, 00:21:03.404 "crdt3": 0 00:21:03.404 } 00:21:03.404 }, 00:21:03.404 { 00:21:03.404 "method": "nvmf_create_transport", 00:21:03.404 "params": { 00:21:03.404 "trtype": "TCP", 00:21:03.404 "max_queue_depth": 128, 00:21:03.404 "max_io_qpairs_per_ctrlr": 127, 00:21:03.404 "in_capsule_data_size": 4096, 00:21:03.404 "max_io_size": 131072, 00:21:03.404 "io_unit_size": 131072, 00:21:03.404 "max_aq_depth": 128, 00:21:03.404 "num_shared_buffers": 511, 00:21:03.404 "buf_cache_size": 4294967295, 00:21:03.404 "dif_insert_or_strip": false, 00:21:03.404 "zcopy": false, 00:21:03.404 "c2h_success": false, 00:21:03.404 "sock_priority": 0, 00:21:03.404 "abort_timeout_sec": 1 00:21:03.404 } 00:21:03.404 }, 00:21:03.404 { 00:21:03.404 "method": "nvmf_create_subsystem", 00:21:03.404 "params": { 00:21:03.404 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:03.404 "allow_any_host": false, 00:21:03.404 "serial_number": "SPDK00000000000001", 00:21:03.404 "model_number": "SPDK bdev Controller", 00:21:03.404 "max_namespaces": 10, 00:21:03.404 "min_cntlid": 1, 00:21:03.404 "max_cntlid": 65519, 00:21:03.404 "ana_reporting": false 00:21:03.404 } 00:21:03.404 }, 00:21:03.404 { 00:21:03.404 "method": "nvmf_subsystem_add_host", 00:21:03.404 "params": { 00:21:03.404 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:03.404 "host": "nqn.2016-06.io.spdk:host1", 00:21:03.404 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:03.404 } 00:21:03.404 }, 00:21:03.404 { 00:21:03.404 "method": "nvmf_subsystem_add_ns", 00:21:03.404 "params": { 00:21:03.404 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:03.404 "namespace": { 00:21:03.404 "nsid": 1, 00:21:03.404 "bdev_name": "malloc0", 00:21:03.404 "nguid": "5E66570CCA914431838C98CD551259B1", 00:21:03.404 "uuid": "5e66570c-ca91-4431-838c-98cd551259b1" 00:21:03.404 } 00:21:03.404 } 00:21:03.404 }, 00:21:03.404 { 00:21:03.404 "method": "nvmf_subsystem_add_listener", 00:21:03.404 "params": { 00:21:03.404 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:03.404 "listen_address": { 00:21:03.404 "trtype": "TCP", 00:21:03.404 "adrfam": "IPv4", 00:21:03.404 "traddr": "10.0.0.2", 00:21:03.404 "trsvcid": "4420" 00:21:03.404 }, 00:21:03.404 "secure_channel": true 00:21:03.404 } 00:21:03.404 } 00:21:03.404 ] 00:21:03.404 } 00:21:03.404 ] 00:21:03.404 }' 00:21:03.404 16:56:48 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:21:03.661 16:56:49 -- target/tls.sh@206 -- # bdevperfconf='{ 00:21:03.661 "subsystems": [ 00:21:03.661 { 00:21:03.661 "subsystem": "iobuf", 00:21:03.661 "config": [ 00:21:03.661 { 00:21:03.661 "method": "iobuf_set_options", 00:21:03.661 "params": { 00:21:03.661 "small_pool_count": 8192, 00:21:03.661 "large_pool_count": 1024, 00:21:03.661 "small_bufsize": 8192, 00:21:03.661 "large_bufsize": 135168 00:21:03.661 } 00:21:03.661 } 00:21:03.661 ] 00:21:03.661 }, 00:21:03.661 { 00:21:03.661 "subsystem": "sock", 00:21:03.661 "config": [ 00:21:03.661 { 00:21:03.661 "method": "sock_impl_set_options", 00:21:03.661 "params": { 00:21:03.661 "impl_name": "posix", 00:21:03.661 "recv_buf_size": 2097152, 00:21:03.661 "send_buf_size": 2097152, 00:21:03.661 "enable_recv_pipe": true, 00:21:03.661 "enable_quickack": false, 00:21:03.661 "enable_placement_id": 0, 00:21:03.661 "enable_zerocopy_send_server": true, 00:21:03.661 "enable_zerocopy_send_client": false, 00:21:03.661 "zerocopy_threshold": 0, 00:21:03.661 "tls_version": 0, 00:21:03.661 "enable_ktls": false 00:21:03.661 } 00:21:03.661 }, 00:21:03.661 { 00:21:03.661 "method": "sock_impl_set_options", 00:21:03.661 "params": { 00:21:03.661 "impl_name": "ssl", 00:21:03.661 "recv_buf_size": 4096, 00:21:03.661 "send_buf_size": 4096, 00:21:03.661 "enable_recv_pipe": true, 00:21:03.661 "enable_quickack": false, 00:21:03.661 "enable_placement_id": 0, 00:21:03.661 "enable_zerocopy_send_server": true, 00:21:03.661 "enable_zerocopy_send_client": false, 00:21:03.661 "zerocopy_threshold": 0, 00:21:03.661 "tls_version": 0, 00:21:03.661 "enable_ktls": false 00:21:03.661 } 00:21:03.661 } 00:21:03.661 ] 00:21:03.661 }, 00:21:03.661 { 00:21:03.661 "subsystem": "vmd", 00:21:03.661 "config": [] 00:21:03.662 }, 00:21:03.662 { 00:21:03.662 "subsystem": "accel", 00:21:03.662 "config": [ 00:21:03.662 { 00:21:03.662 "method": "accel_set_options", 00:21:03.662 "params": { 00:21:03.662 "small_cache_size": 128, 00:21:03.662 "large_cache_size": 16, 00:21:03.662 "task_count": 2048, 00:21:03.662 "sequence_count": 2048, 00:21:03.662 "buf_count": 2048 00:21:03.662 } 00:21:03.662 } 00:21:03.662 ] 00:21:03.662 }, 00:21:03.662 { 00:21:03.662 "subsystem": "bdev", 00:21:03.662 "config": [ 00:21:03.662 { 00:21:03.662 "method": "bdev_set_options", 00:21:03.662 "params": { 00:21:03.662 "bdev_io_pool_size": 65535, 00:21:03.662 "bdev_io_cache_size": 256, 00:21:03.662 "bdev_auto_examine": true, 00:21:03.662 "iobuf_small_cache_size": 128, 00:21:03.662 "iobuf_large_cache_size": 16 00:21:03.662 } 00:21:03.662 }, 00:21:03.662 { 00:21:03.662 "method": "bdev_raid_set_options", 00:21:03.662 "params": { 00:21:03.662 "process_window_size_kb": 1024 00:21:03.662 } 00:21:03.662 }, 00:21:03.662 { 00:21:03.662 "method": "bdev_iscsi_set_options", 00:21:03.662 "params": { 00:21:03.662 "timeout_sec": 30 00:21:03.662 } 00:21:03.662 }, 00:21:03.662 { 00:21:03.662 "method": "bdev_nvme_set_options", 00:21:03.662 "params": { 00:21:03.662 "action_on_timeout": "none", 00:21:03.662 "timeout_us": 0, 00:21:03.662 "timeout_admin_us": 0, 00:21:03.662 "keep_alive_timeout_ms": 10000, 00:21:03.662 "transport_retry_count": 4, 00:21:03.662 "arbitration_burst": 0, 00:21:03.662 "low_priority_weight": 0, 00:21:03.662 "medium_priority_weight": 0, 00:21:03.662 "high_priority_weight": 0, 00:21:03.662 "nvme_adminq_poll_period_us": 10000, 00:21:03.662 "nvme_ioq_poll_period_us": 0, 00:21:03.662 "io_queue_requests": 512, 00:21:03.662 "delay_cmd_submit": true, 00:21:03.662 "bdev_retry_count": 3, 00:21:03.662 "transport_ack_timeout": 0, 00:21:03.662 "ctrlr_loss_timeout_sec": 0, 00:21:03.662 "reconnect_delay_sec": 0, 00:21:03.662 "fast_io_fail_timeout_sec": 0, 00:21:03.662 "generate_uuids": false, 00:21:03.662 "transport_tos": 0, 00:21:03.662 "io_path_stat": false, 00:21:03.662 "allow_accel_sequence": false 00:21:03.662 } 00:21:03.662 }, 00:21:03.662 { 00:21:03.662 "method": "bdev_nvme_attach_controller", 00:21:03.662 "params": { 00:21:03.662 "name": "TLSTEST", 00:21:03.662 "trtype": "TCP", 00:21:03.662 "adrfam": "IPv4", 00:21:03.662 "traddr": "10.0.0.2", 00:21:03.662 "trsvcid": "4420", 00:21:03.662 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:03.662 "prchk_reftag": false, 00:21:03.662 "prchk_guard": false, 00:21:03.662 "ctrlr_loss_timeout_sec": 0, 00:21:03.662 "reconnect_delay_sec": 0, 00:21:03.662 "fast_io_fail_timeout_sec": 0, 00:21:03.662 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:03.662 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:03.662 "hdgst": false, 00:21:03.662 "ddgst": false 00:21:03.662 } 00:21:03.662 }, 00:21:03.662 { 00:21:03.662 "method": "bdev_nvme_set_hotplug", 00:21:03.662 "params": { 00:21:03.662 "period_us": 100000, 00:21:03.662 "enable": false 00:21:03.662 } 00:21:03.662 }, 00:21:03.662 { 00:21:03.662 "method": "bdev_wait_for_examine" 00:21:03.662 } 00:21:03.662 ] 00:21:03.662 }, 00:21:03.662 { 00:21:03.662 "subsystem": "nbd", 00:21:03.662 "config": [] 00:21:03.662 } 00:21:03.662 ] 00:21:03.662 }' 00:21:03.662 16:56:49 -- target/tls.sh@208 -- # killprocess 1230875 00:21:03.662 16:56:49 -- common/autotest_common.sh@936 -- # '[' -z 1230875 ']' 00:21:03.662 16:56:49 -- common/autotest_common.sh@940 -- # kill -0 1230875 00:21:03.662 16:56:49 -- common/autotest_common.sh@941 -- # uname 00:21:03.662 16:56:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:03.662 16:56:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1230875 00:21:03.662 16:56:49 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:03.662 16:56:49 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:03.662 16:56:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1230875' 00:21:03.662 killing process with pid 1230875 00:21:03.662 16:56:49 -- common/autotest_common.sh@955 -- # kill 1230875 00:21:03.662 Received shutdown signal, test time was about 10.000000 seconds 00:21:03.662 00:21:03.662 Latency(us) 00:21:03.662 [2024-11-16T15:56:49.412Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:03.662 [2024-11-16T15:56:49.412Z] =================================================================================================================== 00:21:03.662 [2024-11-16T15:56:49.412Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:03.662 16:56:49 -- common/autotest_common.sh@960 -- # wait 1230875 00:21:03.922 16:56:49 -- target/tls.sh@209 -- # killprocess 1230495 00:21:03.922 16:56:49 -- common/autotest_common.sh@936 -- # '[' -z 1230495 ']' 00:21:03.922 16:56:49 -- common/autotest_common.sh@940 -- # kill -0 1230495 00:21:03.922 16:56:49 -- common/autotest_common.sh@941 -- # uname 00:21:03.922 16:56:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:03.922 16:56:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1230495 00:21:03.922 16:56:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:03.922 16:56:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:03.922 16:56:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1230495' 00:21:03.922 killing process with pid 1230495 00:21:03.922 16:56:49 -- common/autotest_common.sh@955 -- # kill 1230495 00:21:03.922 16:56:49 -- common/autotest_common.sh@960 -- # wait 1230495 00:21:04.211 16:56:49 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:21:04.211 16:56:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:04.211 16:56:49 -- target/tls.sh@212 -- # echo '{ 00:21:04.211 "subsystems": [ 00:21:04.211 { 00:21:04.211 "subsystem": "iobuf", 00:21:04.211 "config": [ 00:21:04.211 { 00:21:04.211 "method": "iobuf_set_options", 00:21:04.211 "params": { 00:21:04.211 "small_pool_count": 8192, 00:21:04.211 "large_pool_count": 1024, 00:21:04.211 "small_bufsize": 8192, 00:21:04.211 "large_bufsize": 135168 00:21:04.211 } 00:21:04.211 } 00:21:04.211 ] 00:21:04.211 }, 00:21:04.211 { 00:21:04.211 "subsystem": "sock", 00:21:04.211 "config": [ 00:21:04.211 { 00:21:04.211 "method": "sock_impl_set_options", 00:21:04.211 "params": { 00:21:04.211 "impl_name": "posix", 00:21:04.211 "recv_buf_size": 2097152, 00:21:04.211 "send_buf_size": 2097152, 00:21:04.211 "enable_recv_pipe": true, 00:21:04.211 "enable_quickack": false, 00:21:04.211 "enable_placement_id": 0, 00:21:04.211 "enable_zerocopy_send_server": true, 00:21:04.211 "enable_zerocopy_send_client": false, 00:21:04.211 "zerocopy_threshold": 0, 00:21:04.211 "tls_version": 0, 00:21:04.211 "enable_ktls": false 00:21:04.211 } 00:21:04.211 }, 00:21:04.211 { 00:21:04.211 "method": "sock_impl_set_options", 00:21:04.211 "params": { 00:21:04.211 "impl_name": "ssl", 00:21:04.211 "recv_buf_size": 4096, 00:21:04.211 "send_buf_size": 4096, 00:21:04.211 "enable_recv_pipe": true, 00:21:04.211 "enable_quickack": false, 00:21:04.211 "enable_placement_id": 0, 00:21:04.211 "enable_zerocopy_send_server": true, 00:21:04.211 "enable_zerocopy_send_client": false, 00:21:04.211 "zerocopy_threshold": 0, 00:21:04.211 "tls_version": 0, 00:21:04.211 "enable_ktls": false 00:21:04.211 } 00:21:04.211 } 00:21:04.211 ] 00:21:04.211 }, 00:21:04.211 { 00:21:04.211 "subsystem": "vmd", 00:21:04.211 "config": [] 00:21:04.211 }, 00:21:04.211 { 00:21:04.211 "subsystem": "accel", 00:21:04.211 "config": [ 00:21:04.211 { 00:21:04.211 "method": "accel_set_options", 00:21:04.211 "params": { 00:21:04.211 "small_cache_size": 128, 00:21:04.211 "large_cache_size": 16, 00:21:04.211 "task_count": 2048, 00:21:04.211 "sequence_count": 2048, 00:21:04.211 "buf_count": 2048 00:21:04.211 } 00:21:04.211 } 00:21:04.211 ] 00:21:04.211 }, 00:21:04.211 { 00:21:04.211 "subsystem": "bdev", 00:21:04.211 "config": [ 00:21:04.211 { 00:21:04.211 "method": "bdev_set_options", 00:21:04.211 "params": { 00:21:04.211 "bdev_io_pool_size": 65535, 00:21:04.211 "bdev_io_cache_size": 256, 00:21:04.211 "bdev_auto_examine": true, 00:21:04.211 "iobuf_small_cache_size": 128, 00:21:04.211 "iobuf_large_cache_size": 16 00:21:04.211 } 00:21:04.211 }, 00:21:04.211 { 00:21:04.212 "method": "bdev_raid_set_options", 00:21:04.212 "params": { 00:21:04.212 "process_window_size_kb": 1024 00:21:04.212 } 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "method": "bdev_iscsi_set_options", 00:21:04.212 "params": { 00:21:04.212 "timeout_sec": 30 00:21:04.212 } 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "method": "bdev_nvme_set_options", 00:21:04.212 "params": { 00:21:04.212 "action_on_timeout": "none", 00:21:04.212 "timeout_us": 0, 00:21:04.212 "timeout_admin_us": 0, 00:21:04.212 "keep_alive_timeout_ms": 10000, 00:21:04.212 "transport_retry_count": 4, 00:21:04.212 "arbitration_burst": 0, 00:21:04.212 "low_priority_weight": 0, 00:21:04.212 "medium_priority_weight": 0, 00:21:04.212 "high_priority_weight": 0, 00:21:04.212 "nvme_adminq_poll_period_us": 10000, 00:21:04.212 "nvme_ioq_poll_period_us": 0, 00:21:04.212 "io_queue_requests": 0, 00:21:04.212 "delay_cmd_submit": true, 00:21:04.212 "bdev_retry_count": 3, 00:21:04.212 "transport_ack_timeout": 0, 00:21:04.212 "ctrlr_loss_timeout_sec": 0, 00:21:04.212 "reconnect_delay_sec": 0, 00:21:04.212 "fast_io_fail_timeout_sec": 0, 00:21:04.212 "generate_uuids": false, 00:21:04.212 "transport_tos": 0, 00:21:04.212 "io_path_stat": false, 00:21:04.212 "allow_accel_sequence": false 00:21:04.212 } 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "method": "bdev_nvme_set_hotplug", 00:21:04.212 "params": { 00:21:04.212 "period_us": 100000, 00:21:04.212 "enable": false 00:21:04.212 } 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "method": "bdev_malloc_create", 00:21:04.212 "params": { 00:21:04.212 "name": "malloc0", 00:21:04.212 "num_blocks": 8192, 00:21:04.212 "block_size": 4096, 00:21:04.212 "physical_block_size": 4096, 00:21:04.212 "uuid": "5e66570c-ca91-4431-838c-98cd551259b1", 00:21:04.212 "optimal_io_boundary": 0 00:21:04.212 } 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "method": "bdev_wait_for_examine" 00:21:04.212 } 00:21:04.212 ] 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "subsystem": "nbd", 00:21:04.212 "config": [] 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "subsystem": "scheduler", 00:21:04.212 "config": [ 00:21:04.212 { 00:21:04.212 "method": "framework_set_scheduler", 00:21:04.212 "params": { 00:21:04.212 "name": "static" 00:21:04.212 } 00:21:04.212 } 00:21:04.212 ] 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "subsystem": "nvmf", 00:21:04.212 "config": [ 00:21:04.212 { 00:21:04.212 "method": "nvmf_set_config", 00:21:04.212 "params": { 00:21:04.212 "discovery_filter": "match_any", 00:21:04.212 "admin_cmd_passthru": { 00:21:04.212 "identify_ctrlr": false 00:21:04.212 } 00:21:04.212 } 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "method": "nvmf_set_max_subsystems", 00:21:04.212 "params": { 00:21:04.212 "max_subsystems": 1024 00:21:04.212 } 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "method": "nvmf_set_crdt", 00:21:04.212 "params": { 00:21:04.212 "crdt1": 0, 00:21:04.212 "crdt2": 0, 00:21:04.212 "crdt3": 0 00:21:04.212 } 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "method": "nvmf_create_transport", 00:21:04.212 "params": { 00:21:04.212 "trtype": "TCP", 00:21:04.212 "max_queue_depth": 128, 00:21:04.212 "max_io_qpairs_per_ctrlr": 127, 00:21:04.212 "in_capsule_data_size": 4096, 00:21:04.212 "max_io_size": 131072, 00:21:04.212 "io_unit_size": 131072, 00:21:04.212 "max_aq_depth": 128, 00:21:04.212 "num_shared_buffers": 511, 00:21:04.212 "buf_cache_size": 4294967295, 00:21:04.212 "dif_insert_or_strip": false, 00:21:04.212 "zcopy": false, 00:21:04.212 "c2h_success": false, 00:21:04.212 "sock_priority": 0, 00:21:04.212 "abort_timeout_sec": 1 00:21:04.212 } 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "method": "nvmf_create_subsystem", 00:21:04.212 "params": { 00:21:04.212 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.212 "allow_any_host": false, 00:21:04.212 "serial_number": "SPDK00000000000001", 00:21:04.212 "model_number": "SPDK bdev Controller", 00:21:04.212 "max_namespaces": 10, 00:21:04.212 "min_cntlid": 1, 00:21:04.212 "max_cntlid": 65519, 00:21:04.212 "ana_reporting": false 00:21:04.212 } 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "method": "nvmf_subsystem_add_host", 00:21:04.212 "params": { 00:21:04.212 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.212 "host": "nqn.2016-06.io.spdk:host1", 00:21:04.212 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:04.212 } 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "method": "nvmf_subsystem_add_ns", 00:21:04.212 "params": { 00:21:04.212 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.212 "namespace": { 00:21:04.212 "nsid": 1, 00:21:04.212 "bdev_name": "malloc0", 00:21:04.212 "nguid": "5E66570CCA914431838C98CD551259B1", 00:21:04.212 "uuid": "5e66570c-ca91-4431-838c-98cd551259b1" 00:21:04.212 } 00:21:04.212 } 00:21:04.212 }, 00:21:04.212 { 00:21:04.212 "method": "nvmf_subsystem_add_listener", 00:21:04.212 "params": { 00:21:04.212 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.212 "listen_address": { 00:21:04.212 "trtype": "TCP", 00:21:04.212 "adrfam": "IPv4", 00:21:04.212 "traddr": "10.0.0.2", 00:21:04.212 "trsvcid": "4420" 00:21:04.212 }, 00:21:04.212 "secure_channel": true 00:21:04.212 } 00:21:04.212 } 00:21:04.212 ] 00:21:04.212 } 00:21:04.212 ] 00:21:04.212 }' 00:21:04.212 16:56:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:04.212 16:56:49 -- common/autotest_common.sh@10 -- # set +x 00:21:04.212 16:56:49 -- nvmf/common.sh@469 -- # nvmfpid=1231170 00:21:04.212 16:56:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:21:04.212 16:56:49 -- nvmf/common.sh@470 -- # waitforlisten 1231170 00:21:04.212 16:56:49 -- common/autotest_common.sh@829 -- # '[' -z 1231170 ']' 00:21:04.212 16:56:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:04.212 16:56:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:04.212 16:56:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:04.212 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:04.212 16:56:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:04.212 16:56:49 -- common/autotest_common.sh@10 -- # set +x 00:21:04.212 [2024-11-16 16:56:49.789831] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:04.212 [2024-11-16 16:56:49.789920] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:04.212 EAL: No free 2048 kB hugepages reported on node 1 00:21:04.212 [2024-11-16 16:56:49.856679] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:04.212 [2024-11-16 16:56:49.941489] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:04.213 [2024-11-16 16:56:49.941681] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:04.213 [2024-11-16 16:56:49.941705] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:04.213 [2024-11-16 16:56:49.941721] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:04.213 [2024-11-16 16:56:49.941750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:04.490 [2024-11-16 16:56:50.169830] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:04.490 [2024-11-16 16:56:50.201835] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:04.490 [2024-11-16 16:56:50.202168] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:05.057 16:56:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:05.057 16:56:50 -- common/autotest_common.sh@862 -- # return 0 00:21:05.057 16:56:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:05.057 16:56:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:05.057 16:56:50 -- common/autotest_common.sh@10 -- # set +x 00:21:05.057 16:56:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:05.057 16:56:50 -- target/tls.sh@216 -- # bdevperf_pid=1231330 00:21:05.057 16:56:50 -- target/tls.sh@217 -- # waitforlisten 1231330 /var/tmp/bdevperf.sock 00:21:05.057 16:56:50 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:21:05.057 16:56:50 -- common/autotest_common.sh@829 -- # '[' -z 1231330 ']' 00:21:05.057 16:56:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:05.057 16:56:50 -- target/tls.sh@213 -- # echo '{ 00:21:05.057 "subsystems": [ 00:21:05.057 { 00:21:05.057 "subsystem": "iobuf", 00:21:05.057 "config": [ 00:21:05.057 { 00:21:05.057 "method": "iobuf_set_options", 00:21:05.057 "params": { 00:21:05.057 "small_pool_count": 8192, 00:21:05.057 "large_pool_count": 1024, 00:21:05.057 "small_bufsize": 8192, 00:21:05.057 "large_bufsize": 135168 00:21:05.057 } 00:21:05.057 } 00:21:05.057 ] 00:21:05.057 }, 00:21:05.057 { 00:21:05.057 "subsystem": "sock", 00:21:05.057 "config": [ 00:21:05.057 { 00:21:05.057 "method": "sock_impl_set_options", 00:21:05.057 "params": { 00:21:05.057 "impl_name": "posix", 00:21:05.057 "recv_buf_size": 2097152, 00:21:05.057 "send_buf_size": 2097152, 00:21:05.057 "enable_recv_pipe": true, 00:21:05.057 "enable_quickack": false, 00:21:05.057 "enable_placement_id": 0, 00:21:05.057 "enable_zerocopy_send_server": true, 00:21:05.057 "enable_zerocopy_send_client": false, 00:21:05.057 "zerocopy_threshold": 0, 00:21:05.057 "tls_version": 0, 00:21:05.057 "enable_ktls": false 00:21:05.057 } 00:21:05.057 }, 00:21:05.057 { 00:21:05.057 "method": "sock_impl_set_options", 00:21:05.057 "params": { 00:21:05.057 "impl_name": "ssl", 00:21:05.057 "recv_buf_size": 4096, 00:21:05.057 "send_buf_size": 4096, 00:21:05.057 "enable_recv_pipe": true, 00:21:05.057 "enable_quickack": false, 00:21:05.057 "enable_placement_id": 0, 00:21:05.057 "enable_zerocopy_send_server": true, 00:21:05.057 "enable_zerocopy_send_client": false, 00:21:05.057 "zerocopy_threshold": 0, 00:21:05.057 "tls_version": 0, 00:21:05.057 "enable_ktls": false 00:21:05.057 } 00:21:05.057 } 00:21:05.057 ] 00:21:05.057 }, 00:21:05.057 { 00:21:05.057 "subsystem": "vmd", 00:21:05.057 "config": [] 00:21:05.057 }, 00:21:05.057 { 00:21:05.057 "subsystem": "accel", 00:21:05.057 "config": [ 00:21:05.057 { 00:21:05.057 "method": "accel_set_options", 00:21:05.057 "params": { 00:21:05.057 "small_cache_size": 128, 00:21:05.057 "large_cache_size": 16, 00:21:05.057 "task_count": 2048, 00:21:05.057 "sequence_count": 2048, 00:21:05.057 "buf_count": 2048 00:21:05.057 } 00:21:05.057 } 00:21:05.057 ] 00:21:05.057 }, 00:21:05.057 { 00:21:05.057 "subsystem": "bdev", 00:21:05.057 "config": [ 00:21:05.057 { 00:21:05.057 "method": "bdev_set_options", 00:21:05.057 "params": { 00:21:05.057 "bdev_io_pool_size": 65535, 00:21:05.057 "bdev_io_cache_size": 256, 00:21:05.057 "bdev_auto_examine": true, 00:21:05.057 "iobuf_small_cache_size": 128, 00:21:05.057 "iobuf_large_cache_size": 16 00:21:05.057 } 00:21:05.057 }, 00:21:05.057 { 00:21:05.057 "method": "bdev_raid_set_options", 00:21:05.057 "params": { 00:21:05.057 "process_window_size_kb": 1024 00:21:05.057 } 00:21:05.057 }, 00:21:05.057 { 00:21:05.057 "method": "bdev_iscsi_set_options", 00:21:05.057 "params": { 00:21:05.057 "timeout_sec": 30 00:21:05.057 } 00:21:05.057 }, 00:21:05.057 { 00:21:05.057 "method": "bdev_nvme_set_options", 00:21:05.057 "params": { 00:21:05.057 "action_on_timeout": "none", 00:21:05.057 "timeout_us": 0, 00:21:05.057 "timeout_admin_us": 0, 00:21:05.057 "keep_alive_timeout_ms": 10000, 00:21:05.058 "transport_retry_count": 4, 00:21:05.058 "arbitration_burst": 0, 00:21:05.058 "low_priority_weight": 0, 00:21:05.058 "medium_priority_weight": 0, 00:21:05.058 "high_priority_weight": 0, 00:21:05.058 "nvme_adminq_poll_period_us": 10000, 00:21:05.058 "nvme_ioq_poll_period_us": 0, 00:21:05.058 "io_queue_requests": 512, 00:21:05.058 "delay_cmd_submit": true, 00:21:05.058 "bdev_retry_count": 3, 00:21:05.058 "transport_ack_timeout": 0, 00:21:05.058 "ctrlr_loss_timeout_sec": 0, 00:21:05.058 "reconnect_delay_sec": 0, 00:21:05.058 "fast_io_fail_timeout_sec": 0, 00:21:05.058 "generate_uuids": false, 00:21:05.058 "transport_tos": 0, 00:21:05.058 "io_path_stat": false, 00:21:05.058 "allow_accel_sequence": false 00:21:05.058 } 00:21:05.058 }, 00:21:05.058 { 00:21:05.058 "method": "bdev_nvme_attach_controller", 00:21:05.058 "params": { 00:21:05.058 "name": "TLSTEST", 00:21:05.058 "trtype": "TCP", 00:21:05.058 "adrfam": "IPv4", 00:21:05.058 "traddr": "10.0.0.2", 00:21:05.058 "trsvcid": "4420", 00:21:05.058 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:05.058 "prchk_reftag": false, 00:21:05.058 "prchk_guard": false, 00:21:05.058 "ctrlr_loss_timeout_sec": 0, 00:21:05.058 "reconnect_delay_sec": 0, 00:21:05.058 "fast_io_fail_timeout_sec": 0, 00:21:05.058 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:05.058 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:05.058 "hdgst": false, 00:21:05.058 "ddgst": false 00:21:05.058 } 00:21:05.058 }, 00:21:05.058 { 00:21:05.058 "method": "bdev_nvme_set_hotplug", 00:21:05.058 "params": { 00:21:05.058 "period_us": 100000, 00:21:05.058 "enable": false 00:21:05.058 } 00:21:05.058 }, 00:21:05.058 { 00:21:05.058 "method": "bdev_wait_for_examine" 00:21:05.058 } 00:21:05.058 ] 00:21:05.058 }, 00:21:05.058 { 00:21:05.058 "subsystem": "nbd", 00:21:05.058 "config": [] 00:21:05.058 } 00:21:05.058 ] 00:21:05.058 }' 00:21:05.058 16:56:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:05.058 16:56:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:05.058 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:05.058 16:56:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:05.058 16:56:50 -- common/autotest_common.sh@10 -- # set +x 00:21:05.058 [2024-11-16 16:56:50.799068] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:05.058 [2024-11-16 16:56:50.799140] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1231330 ] 00:21:05.317 EAL: No free 2048 kB hugepages reported on node 1 00:21:05.317 [2024-11-16 16:56:50.856529] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:05.317 [2024-11-16 16:56:50.945740] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:05.575 [2024-11-16 16:56:51.105463] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:06.140 16:56:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:06.140 16:56:51 -- common/autotest_common.sh@862 -- # return 0 00:21:06.140 16:56:51 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:06.399 Running I/O for 10 seconds... 00:21:16.364 00:21:16.364 Latency(us) 00:21:16.364 [2024-11-16T15:57:02.114Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:16.364 [2024-11-16T15:57:02.114Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:16.364 Verification LBA range: start 0x0 length 0x2000 00:21:16.364 TLSTESTn1 : 10.01 4583.51 17.90 0.00 0.00 27887.60 3106.89 51263.72 00:21:16.364 [2024-11-16T15:57:02.114Z] =================================================================================================================== 00:21:16.364 [2024-11-16T15:57:02.115Z] Total : 4583.51 17.90 0.00 0.00 27887.60 3106.89 51263.72 00:21:16.365 0 00:21:16.365 16:57:01 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:16.365 16:57:01 -- target/tls.sh@223 -- # killprocess 1231330 00:21:16.365 16:57:02 -- common/autotest_common.sh@936 -- # '[' -z 1231330 ']' 00:21:16.365 16:57:02 -- common/autotest_common.sh@940 -- # kill -0 1231330 00:21:16.365 16:57:02 -- common/autotest_common.sh@941 -- # uname 00:21:16.365 16:57:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:16.365 16:57:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1231330 00:21:16.365 16:57:02 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:16.365 16:57:02 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:16.365 16:57:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1231330' 00:21:16.365 killing process with pid 1231330 00:21:16.365 16:57:02 -- common/autotest_common.sh@955 -- # kill 1231330 00:21:16.365 Received shutdown signal, test time was about 10.000000 seconds 00:21:16.365 00:21:16.365 Latency(us) 00:21:16.365 [2024-11-16T15:57:02.115Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:16.365 [2024-11-16T15:57:02.115Z] =================================================================================================================== 00:21:16.365 [2024-11-16T15:57:02.115Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:16.365 16:57:02 -- common/autotest_common.sh@960 -- # wait 1231330 00:21:16.622 16:57:02 -- target/tls.sh@224 -- # killprocess 1231170 00:21:16.622 16:57:02 -- common/autotest_common.sh@936 -- # '[' -z 1231170 ']' 00:21:16.622 16:57:02 -- common/autotest_common.sh@940 -- # kill -0 1231170 00:21:16.622 16:57:02 -- common/autotest_common.sh@941 -- # uname 00:21:16.622 16:57:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:16.622 16:57:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1231170 00:21:16.622 16:57:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:16.622 16:57:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:16.622 16:57:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1231170' 00:21:16.622 killing process with pid 1231170 00:21:16.622 16:57:02 -- common/autotest_common.sh@955 -- # kill 1231170 00:21:16.622 16:57:02 -- common/autotest_common.sh@960 -- # wait 1231170 00:21:16.881 16:57:02 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:21:16.881 16:57:02 -- target/tls.sh@227 -- # cleanup 00:21:16.881 16:57:02 -- target/tls.sh@15 -- # process_shm --id 0 00:21:16.881 16:57:02 -- common/autotest_common.sh@806 -- # type=--id 00:21:16.881 16:57:02 -- common/autotest_common.sh@807 -- # id=0 00:21:16.881 16:57:02 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:16.881 16:57:02 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:16.881 16:57:02 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:16.881 16:57:02 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:16.881 16:57:02 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:16.881 16:57:02 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:16.881 nvmf_trace.0 00:21:16.881 16:57:02 -- common/autotest_common.sh@821 -- # return 0 00:21:16.881 16:57:02 -- target/tls.sh@16 -- # killprocess 1231330 00:21:16.881 16:57:02 -- common/autotest_common.sh@936 -- # '[' -z 1231330 ']' 00:21:16.881 16:57:02 -- common/autotest_common.sh@940 -- # kill -0 1231330 00:21:16.881 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1231330) - No such process 00:21:16.881 16:57:02 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1231330 is not found' 00:21:16.881 Process with pid 1231330 is not found 00:21:16.881 16:57:02 -- target/tls.sh@17 -- # nvmftestfini 00:21:16.881 16:57:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:16.881 16:57:02 -- nvmf/common.sh@116 -- # sync 00:21:16.881 16:57:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:16.881 16:57:02 -- nvmf/common.sh@119 -- # set +e 00:21:16.881 16:57:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:16.881 16:57:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:16.881 rmmod nvme_tcp 00:21:16.881 rmmod nvme_fabrics 00:21:17.140 rmmod nvme_keyring 00:21:17.140 16:57:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:17.140 16:57:02 -- nvmf/common.sh@123 -- # set -e 00:21:17.140 16:57:02 -- nvmf/common.sh@124 -- # return 0 00:21:17.140 16:57:02 -- nvmf/common.sh@477 -- # '[' -n 1231170 ']' 00:21:17.140 16:57:02 -- nvmf/common.sh@478 -- # killprocess 1231170 00:21:17.140 16:57:02 -- common/autotest_common.sh@936 -- # '[' -z 1231170 ']' 00:21:17.140 16:57:02 -- common/autotest_common.sh@940 -- # kill -0 1231170 00:21:17.140 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1231170) - No such process 00:21:17.140 16:57:02 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1231170 is not found' 00:21:17.140 Process with pid 1231170 is not found 00:21:17.140 16:57:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:17.140 16:57:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:17.140 16:57:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:17.140 16:57:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:17.140 16:57:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:17.140 16:57:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:17.140 16:57:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:17.140 16:57:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:19.046 16:57:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:19.046 16:57:04 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:19.046 00:21:19.046 real 1m15.363s 00:21:19.046 user 2m3.041s 00:21:19.046 sys 0m22.633s 00:21:19.046 16:57:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:19.046 16:57:04 -- common/autotest_common.sh@10 -- # set +x 00:21:19.046 ************************************ 00:21:19.046 END TEST nvmf_tls 00:21:19.046 ************************************ 00:21:19.046 16:57:04 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:19.046 16:57:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:19.046 16:57:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:19.046 16:57:04 -- common/autotest_common.sh@10 -- # set +x 00:21:19.046 ************************************ 00:21:19.046 START TEST nvmf_fips 00:21:19.046 ************************************ 00:21:19.046 16:57:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:19.046 * Looking for test storage... 00:21:19.046 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:21:19.046 16:57:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:19.046 16:57:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:19.046 16:57:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:19.305 16:57:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:19.305 16:57:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:19.305 16:57:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:19.305 16:57:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:19.305 16:57:04 -- scripts/common.sh@335 -- # IFS=.-: 00:21:19.305 16:57:04 -- scripts/common.sh@335 -- # read -ra ver1 00:21:19.305 16:57:04 -- scripts/common.sh@336 -- # IFS=.-: 00:21:19.305 16:57:04 -- scripts/common.sh@336 -- # read -ra ver2 00:21:19.305 16:57:04 -- scripts/common.sh@337 -- # local 'op=<' 00:21:19.305 16:57:04 -- scripts/common.sh@339 -- # ver1_l=2 00:21:19.305 16:57:04 -- scripts/common.sh@340 -- # ver2_l=1 00:21:19.305 16:57:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:19.305 16:57:04 -- scripts/common.sh@343 -- # case "$op" in 00:21:19.305 16:57:04 -- scripts/common.sh@344 -- # : 1 00:21:19.305 16:57:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:19.305 16:57:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:19.305 16:57:04 -- scripts/common.sh@364 -- # decimal 1 00:21:19.305 16:57:04 -- scripts/common.sh@352 -- # local d=1 00:21:19.305 16:57:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:19.305 16:57:04 -- scripts/common.sh@354 -- # echo 1 00:21:19.305 16:57:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:19.305 16:57:04 -- scripts/common.sh@365 -- # decimal 2 00:21:19.305 16:57:04 -- scripts/common.sh@352 -- # local d=2 00:21:19.305 16:57:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:19.305 16:57:04 -- scripts/common.sh@354 -- # echo 2 00:21:19.305 16:57:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:19.305 16:57:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:19.305 16:57:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:19.306 16:57:04 -- scripts/common.sh@367 -- # return 0 00:21:19.306 16:57:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:19.306 16:57:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:19.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:19.306 --rc genhtml_branch_coverage=1 00:21:19.306 --rc genhtml_function_coverage=1 00:21:19.306 --rc genhtml_legend=1 00:21:19.306 --rc geninfo_all_blocks=1 00:21:19.306 --rc geninfo_unexecuted_blocks=1 00:21:19.306 00:21:19.306 ' 00:21:19.306 16:57:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:19.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:19.306 --rc genhtml_branch_coverage=1 00:21:19.306 --rc genhtml_function_coverage=1 00:21:19.306 --rc genhtml_legend=1 00:21:19.306 --rc geninfo_all_blocks=1 00:21:19.306 --rc geninfo_unexecuted_blocks=1 00:21:19.306 00:21:19.306 ' 00:21:19.306 16:57:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:19.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:19.306 --rc genhtml_branch_coverage=1 00:21:19.306 --rc genhtml_function_coverage=1 00:21:19.306 --rc genhtml_legend=1 00:21:19.306 --rc geninfo_all_blocks=1 00:21:19.306 --rc geninfo_unexecuted_blocks=1 00:21:19.306 00:21:19.306 ' 00:21:19.306 16:57:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:19.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:19.306 --rc genhtml_branch_coverage=1 00:21:19.306 --rc genhtml_function_coverage=1 00:21:19.306 --rc genhtml_legend=1 00:21:19.306 --rc geninfo_all_blocks=1 00:21:19.306 --rc geninfo_unexecuted_blocks=1 00:21:19.306 00:21:19.306 ' 00:21:19.306 16:57:04 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:19.306 16:57:04 -- nvmf/common.sh@7 -- # uname -s 00:21:19.306 16:57:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:19.306 16:57:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:19.306 16:57:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:19.306 16:57:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:19.306 16:57:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:19.306 16:57:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:19.306 16:57:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:19.306 16:57:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:19.306 16:57:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:19.306 16:57:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:19.306 16:57:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:19.306 16:57:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:19.306 16:57:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:19.306 16:57:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:19.306 16:57:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:19.306 16:57:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:19.306 16:57:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:19.306 16:57:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:19.306 16:57:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:19.306 16:57:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:19.306 16:57:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:19.306 16:57:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:19.306 16:57:04 -- paths/export.sh@5 -- # export PATH 00:21:19.306 16:57:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:19.306 16:57:04 -- nvmf/common.sh@46 -- # : 0 00:21:19.306 16:57:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:19.306 16:57:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:19.306 16:57:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:19.306 16:57:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:19.306 16:57:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:19.306 16:57:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:19.306 16:57:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:19.306 16:57:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:19.306 16:57:04 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:19.306 16:57:04 -- fips/fips.sh@89 -- # check_openssl_version 00:21:19.306 16:57:04 -- fips/fips.sh@83 -- # local target=3.0.0 00:21:19.306 16:57:04 -- fips/fips.sh@85 -- # openssl version 00:21:19.306 16:57:04 -- fips/fips.sh@85 -- # awk '{print $2}' 00:21:19.306 16:57:04 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:21:19.306 16:57:04 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:21:19.306 16:57:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:19.306 16:57:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:19.306 16:57:04 -- scripts/common.sh@335 -- # IFS=.-: 00:21:19.306 16:57:04 -- scripts/common.sh@335 -- # read -ra ver1 00:21:19.306 16:57:04 -- scripts/common.sh@336 -- # IFS=.-: 00:21:19.306 16:57:04 -- scripts/common.sh@336 -- # read -ra ver2 00:21:19.306 16:57:04 -- scripts/common.sh@337 -- # local 'op=>=' 00:21:19.306 16:57:04 -- scripts/common.sh@339 -- # ver1_l=3 00:21:19.306 16:57:04 -- scripts/common.sh@340 -- # ver2_l=3 00:21:19.306 16:57:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:19.306 16:57:04 -- scripts/common.sh@343 -- # case "$op" in 00:21:19.306 16:57:04 -- scripts/common.sh@347 -- # : 1 00:21:19.306 16:57:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:19.306 16:57:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:19.306 16:57:04 -- scripts/common.sh@364 -- # decimal 3 00:21:19.306 16:57:04 -- scripts/common.sh@352 -- # local d=3 00:21:19.306 16:57:04 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:19.306 16:57:04 -- scripts/common.sh@354 -- # echo 3 00:21:19.306 16:57:04 -- scripts/common.sh@364 -- # ver1[v]=3 00:21:19.306 16:57:04 -- scripts/common.sh@365 -- # decimal 3 00:21:19.306 16:57:04 -- scripts/common.sh@352 -- # local d=3 00:21:19.306 16:57:04 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:19.306 16:57:04 -- scripts/common.sh@354 -- # echo 3 00:21:19.306 16:57:04 -- scripts/common.sh@365 -- # ver2[v]=3 00:21:19.306 16:57:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:19.306 16:57:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:19.306 16:57:04 -- scripts/common.sh@363 -- # (( v++ )) 00:21:19.306 16:57:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:19.306 16:57:04 -- scripts/common.sh@364 -- # decimal 1 00:21:19.306 16:57:04 -- scripts/common.sh@352 -- # local d=1 00:21:19.306 16:57:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:19.306 16:57:04 -- scripts/common.sh@354 -- # echo 1 00:21:19.306 16:57:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:19.306 16:57:04 -- scripts/common.sh@365 -- # decimal 0 00:21:19.306 16:57:04 -- scripts/common.sh@352 -- # local d=0 00:21:19.306 16:57:04 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:21:19.306 16:57:04 -- scripts/common.sh@354 -- # echo 0 00:21:19.306 16:57:04 -- scripts/common.sh@365 -- # ver2[v]=0 00:21:19.306 16:57:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:19.306 16:57:04 -- scripts/common.sh@366 -- # return 0 00:21:19.306 16:57:04 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:21:19.306 16:57:04 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:21:19.306 16:57:04 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:21:19.306 16:57:04 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:21:19.307 16:57:04 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:21:19.307 16:57:04 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:21:19.307 16:57:04 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:21:19.307 16:57:04 -- fips/fips.sh@113 -- # build_openssl_config 00:21:19.307 16:57:04 -- fips/fips.sh@37 -- # cat 00:21:19.307 16:57:04 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:21:19.307 16:57:04 -- fips/fips.sh@58 -- # cat - 00:21:19.307 16:57:04 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:21:19.307 16:57:04 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:21:19.307 16:57:04 -- fips/fips.sh@116 -- # mapfile -t providers 00:21:19.307 16:57:04 -- fips/fips.sh@116 -- # openssl list -providers 00:21:19.307 16:57:04 -- fips/fips.sh@116 -- # grep name 00:21:19.307 16:57:04 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:21:19.307 16:57:04 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:21:19.307 16:57:04 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:21:19.307 16:57:04 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:21:19.307 16:57:04 -- fips/fips.sh@127 -- # : 00:21:19.307 16:57:04 -- common/autotest_common.sh@650 -- # local es=0 00:21:19.307 16:57:04 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:21:19.307 16:57:04 -- common/autotest_common.sh@638 -- # local arg=openssl 00:21:19.307 16:57:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:19.307 16:57:04 -- common/autotest_common.sh@642 -- # type -t openssl 00:21:19.307 16:57:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:19.307 16:57:04 -- common/autotest_common.sh@644 -- # type -P openssl 00:21:19.307 16:57:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:19.307 16:57:04 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:21:19.307 16:57:04 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:21:19.307 16:57:04 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:21:19.307 Error setting digest 00:21:19.307 4082E0306E7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:21:19.307 4082E0306E7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:21:19.307 16:57:05 -- common/autotest_common.sh@653 -- # es=1 00:21:19.307 16:57:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:19.307 16:57:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:19.307 16:57:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:19.307 16:57:05 -- fips/fips.sh@130 -- # nvmftestinit 00:21:19.307 16:57:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:19.307 16:57:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:19.307 16:57:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:19.307 16:57:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:19.307 16:57:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:19.307 16:57:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:19.307 16:57:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:19.307 16:57:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:19.307 16:57:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:19.307 16:57:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:19.307 16:57:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:19.307 16:57:05 -- common/autotest_common.sh@10 -- # set +x 00:21:21.839 16:57:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:21.839 16:57:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:21.839 16:57:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:21.839 16:57:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:21.839 16:57:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:21.839 16:57:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:21.839 16:57:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:21.839 16:57:07 -- nvmf/common.sh@294 -- # net_devs=() 00:21:21.839 16:57:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:21.839 16:57:07 -- nvmf/common.sh@295 -- # e810=() 00:21:21.839 16:57:07 -- nvmf/common.sh@295 -- # local -ga e810 00:21:21.839 16:57:07 -- nvmf/common.sh@296 -- # x722=() 00:21:21.839 16:57:07 -- nvmf/common.sh@296 -- # local -ga x722 00:21:21.839 16:57:07 -- nvmf/common.sh@297 -- # mlx=() 00:21:21.839 16:57:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:21.839 16:57:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:21.839 16:57:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:21.839 16:57:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:21.839 16:57:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:21.839 16:57:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:21.839 16:57:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:21.839 16:57:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:21.839 16:57:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:21.839 16:57:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:21.839 16:57:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:21.839 16:57:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:21.839 16:57:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:21.839 16:57:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:21.839 16:57:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:21.839 16:57:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:21.839 16:57:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:21.839 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:21.839 16:57:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:21.839 16:57:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:21.839 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:21.839 16:57:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:21.839 16:57:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:21.839 16:57:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:21.839 16:57:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:21.839 16:57:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:21.839 16:57:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:21.839 16:57:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:21.839 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:21.839 16:57:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:21.839 16:57:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:21.839 16:57:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:21.839 16:57:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:21.839 16:57:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:21.839 16:57:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:21.839 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:21.839 16:57:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:21.839 16:57:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:21.839 16:57:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:21.839 16:57:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:21.840 16:57:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:21.840 16:57:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:21.840 16:57:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:21.840 16:57:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:21.840 16:57:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:21.840 16:57:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:21.840 16:57:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:21.840 16:57:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:21.840 16:57:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:21.840 16:57:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:21.840 16:57:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:21.840 16:57:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:21.840 16:57:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:21.840 16:57:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:21.840 16:57:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:21.840 16:57:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:21.840 16:57:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:21.840 16:57:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:21.840 16:57:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:21.840 16:57:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:21.840 16:57:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:21.840 16:57:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:21.840 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:21.840 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.175 ms 00:21:21.840 00:21:21.840 --- 10.0.0.2 ping statistics --- 00:21:21.840 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:21.840 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:21:21.840 16:57:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:21.840 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:21.840 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:21:21.840 00:21:21.840 --- 10.0.0.1 ping statistics --- 00:21:21.840 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:21.840 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:21:21.840 16:57:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:21.840 16:57:07 -- nvmf/common.sh@410 -- # return 0 00:21:21.840 16:57:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:21.840 16:57:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:21.840 16:57:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:21.840 16:57:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:21.840 16:57:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:21.840 16:57:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:21.840 16:57:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:21.840 16:57:07 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:21:21.840 16:57:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:21.840 16:57:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:21.840 16:57:07 -- common/autotest_common.sh@10 -- # set +x 00:21:21.840 16:57:07 -- nvmf/common.sh@469 -- # nvmfpid=1234874 00:21:21.840 16:57:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:21.840 16:57:07 -- nvmf/common.sh@470 -- # waitforlisten 1234874 00:21:21.840 16:57:07 -- common/autotest_common.sh@829 -- # '[' -z 1234874 ']' 00:21:21.840 16:57:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:21.840 16:57:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:21.840 16:57:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:21.840 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:21.840 16:57:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:21.840 16:57:07 -- common/autotest_common.sh@10 -- # set +x 00:21:21.840 [2024-11-16 16:57:07.280980] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:21.840 [2024-11-16 16:57:07.281076] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:21.840 EAL: No free 2048 kB hugepages reported on node 1 00:21:21.840 [2024-11-16 16:57:07.349139] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:21.840 [2024-11-16 16:57:07.435808] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:21.840 [2024-11-16 16:57:07.435993] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:21.840 [2024-11-16 16:57:07.436011] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:21.840 [2024-11-16 16:57:07.436024] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:21.840 [2024-11-16 16:57:07.436053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:22.774 16:57:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:22.774 16:57:08 -- common/autotest_common.sh@862 -- # return 0 00:21:22.774 16:57:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:22.774 16:57:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:22.774 16:57:08 -- common/autotest_common.sh@10 -- # set +x 00:21:22.774 16:57:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:22.774 16:57:08 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:21:22.774 16:57:08 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:22.774 16:57:08 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:22.774 16:57:08 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:22.774 16:57:08 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:22.774 16:57:08 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:22.774 16:57:08 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:22.774 16:57:08 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:22.774 [2024-11-16 16:57:08.519065] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:23.033 [2024-11-16 16:57:08.535081] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:23.033 [2024-11-16 16:57:08.535336] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:23.033 malloc0 00:21:23.033 16:57:08 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:23.033 16:57:08 -- fips/fips.sh@147 -- # bdevperf_pid=1235476 00:21:23.033 16:57:08 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:23.033 16:57:08 -- fips/fips.sh@148 -- # waitforlisten 1235476 /var/tmp/bdevperf.sock 00:21:23.033 16:57:08 -- common/autotest_common.sh@829 -- # '[' -z 1235476 ']' 00:21:23.033 16:57:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:23.033 16:57:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:23.033 16:57:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:23.033 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:23.033 16:57:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:23.033 16:57:08 -- common/autotest_common.sh@10 -- # set +x 00:21:23.033 [2024-11-16 16:57:08.654215] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:23.033 [2024-11-16 16:57:08.654307] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1235476 ] 00:21:23.033 EAL: No free 2048 kB hugepages reported on node 1 00:21:23.033 [2024-11-16 16:57:08.715517] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:23.291 [2024-11-16 16:57:08.799203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:24.224 16:57:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:24.224 16:57:09 -- common/autotest_common.sh@862 -- # return 0 00:21:24.224 16:57:09 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:24.224 [2024-11-16 16:57:09.840993] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:24.224 TLSTESTn1 00:21:24.224 16:57:09 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:24.483 Running I/O for 10 seconds... 00:21:34.452 00:21:34.452 Latency(us) 00:21:34.452 [2024-11-16T15:57:20.202Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:34.452 [2024-11-16T15:57:20.202Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:34.452 Verification LBA range: start 0x0 length 0x2000 00:21:34.452 TLSTESTn1 : 10.02 4656.47 18.19 0.00 0.00 27447.16 5558.42 43302.31 00:21:34.452 [2024-11-16T15:57:20.202Z] =================================================================================================================== 00:21:34.452 [2024-11-16T15:57:20.202Z] Total : 4656.47 18.19 0.00 0.00 27447.16 5558.42 43302.31 00:21:34.452 0 00:21:34.452 16:57:20 -- fips/fips.sh@1 -- # cleanup 00:21:34.452 16:57:20 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:34.452 16:57:20 -- common/autotest_common.sh@806 -- # type=--id 00:21:34.452 16:57:20 -- common/autotest_common.sh@807 -- # id=0 00:21:34.452 16:57:20 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:34.452 16:57:20 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:34.452 16:57:20 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:34.452 16:57:20 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:34.452 16:57:20 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:34.452 16:57:20 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:34.452 nvmf_trace.0 00:21:34.452 16:57:20 -- common/autotest_common.sh@821 -- # return 0 00:21:34.452 16:57:20 -- fips/fips.sh@16 -- # killprocess 1235476 00:21:34.452 16:57:20 -- common/autotest_common.sh@936 -- # '[' -z 1235476 ']' 00:21:34.452 16:57:20 -- common/autotest_common.sh@940 -- # kill -0 1235476 00:21:34.452 16:57:20 -- common/autotest_common.sh@941 -- # uname 00:21:34.452 16:57:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:34.452 16:57:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1235476 00:21:34.452 16:57:20 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:34.452 16:57:20 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:34.452 16:57:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1235476' 00:21:34.452 killing process with pid 1235476 00:21:34.452 16:57:20 -- common/autotest_common.sh@955 -- # kill 1235476 00:21:34.452 Received shutdown signal, test time was about 10.000000 seconds 00:21:34.452 00:21:34.452 Latency(us) 00:21:34.452 [2024-11-16T15:57:20.202Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:34.452 [2024-11-16T15:57:20.202Z] =================================================================================================================== 00:21:34.452 [2024-11-16T15:57:20.202Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:34.452 16:57:20 -- common/autotest_common.sh@960 -- # wait 1235476 00:21:34.710 16:57:20 -- fips/fips.sh@17 -- # nvmftestfini 00:21:34.710 16:57:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:34.710 16:57:20 -- nvmf/common.sh@116 -- # sync 00:21:34.710 16:57:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:34.710 16:57:20 -- nvmf/common.sh@119 -- # set +e 00:21:34.711 16:57:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:34.711 16:57:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:34.711 rmmod nvme_tcp 00:21:34.711 rmmod nvme_fabrics 00:21:34.711 rmmod nvme_keyring 00:21:34.969 16:57:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:34.969 16:57:20 -- nvmf/common.sh@123 -- # set -e 00:21:34.969 16:57:20 -- nvmf/common.sh@124 -- # return 0 00:21:34.969 16:57:20 -- nvmf/common.sh@477 -- # '[' -n 1234874 ']' 00:21:34.969 16:57:20 -- nvmf/common.sh@478 -- # killprocess 1234874 00:21:34.969 16:57:20 -- common/autotest_common.sh@936 -- # '[' -z 1234874 ']' 00:21:34.969 16:57:20 -- common/autotest_common.sh@940 -- # kill -0 1234874 00:21:34.969 16:57:20 -- common/autotest_common.sh@941 -- # uname 00:21:34.969 16:57:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:34.969 16:57:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1234874 00:21:34.969 16:57:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:34.969 16:57:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:34.969 16:57:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1234874' 00:21:34.969 killing process with pid 1234874 00:21:34.969 16:57:20 -- common/autotest_common.sh@955 -- # kill 1234874 00:21:34.969 16:57:20 -- common/autotest_common.sh@960 -- # wait 1234874 00:21:35.228 16:57:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:35.228 16:57:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:35.228 16:57:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:35.228 16:57:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:35.228 16:57:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:35.228 16:57:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:35.228 16:57:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:35.228 16:57:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:37.134 16:57:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:37.134 16:57:22 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:37.134 00:21:37.134 real 0m18.081s 00:21:37.134 user 0m23.794s 00:21:37.134 sys 0m5.685s 00:21:37.134 16:57:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:37.134 16:57:22 -- common/autotest_common.sh@10 -- # set +x 00:21:37.134 ************************************ 00:21:37.134 END TEST nvmf_fips 00:21:37.134 ************************************ 00:21:37.134 16:57:22 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:37.134 16:57:22 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:37.134 16:57:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:37.134 16:57:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:37.134 16:57:22 -- common/autotest_common.sh@10 -- # set +x 00:21:37.134 ************************************ 00:21:37.134 START TEST nvmf_fuzz 00:21:37.134 ************************************ 00:21:37.134 16:57:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:37.134 * Looking for test storage... 00:21:37.134 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:37.134 16:57:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:37.134 16:57:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:37.134 16:57:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:37.393 16:57:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:37.393 16:57:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:37.393 16:57:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:37.393 16:57:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:37.393 16:57:22 -- scripts/common.sh@335 -- # IFS=.-: 00:21:37.393 16:57:22 -- scripts/common.sh@335 -- # read -ra ver1 00:21:37.393 16:57:22 -- scripts/common.sh@336 -- # IFS=.-: 00:21:37.393 16:57:22 -- scripts/common.sh@336 -- # read -ra ver2 00:21:37.393 16:57:22 -- scripts/common.sh@337 -- # local 'op=<' 00:21:37.393 16:57:22 -- scripts/common.sh@339 -- # ver1_l=2 00:21:37.393 16:57:22 -- scripts/common.sh@340 -- # ver2_l=1 00:21:37.393 16:57:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:37.393 16:57:22 -- scripts/common.sh@343 -- # case "$op" in 00:21:37.393 16:57:22 -- scripts/common.sh@344 -- # : 1 00:21:37.393 16:57:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:37.393 16:57:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:37.393 16:57:22 -- scripts/common.sh@364 -- # decimal 1 00:21:37.393 16:57:22 -- scripts/common.sh@352 -- # local d=1 00:21:37.393 16:57:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:37.393 16:57:22 -- scripts/common.sh@354 -- # echo 1 00:21:37.393 16:57:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:37.393 16:57:22 -- scripts/common.sh@365 -- # decimal 2 00:21:37.393 16:57:22 -- scripts/common.sh@352 -- # local d=2 00:21:37.393 16:57:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:37.393 16:57:22 -- scripts/common.sh@354 -- # echo 2 00:21:37.393 16:57:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:37.393 16:57:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:37.393 16:57:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:37.393 16:57:22 -- scripts/common.sh@367 -- # return 0 00:21:37.393 16:57:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:37.393 16:57:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:37.393 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:37.393 --rc genhtml_branch_coverage=1 00:21:37.393 --rc genhtml_function_coverage=1 00:21:37.393 --rc genhtml_legend=1 00:21:37.393 --rc geninfo_all_blocks=1 00:21:37.393 --rc geninfo_unexecuted_blocks=1 00:21:37.393 00:21:37.393 ' 00:21:37.393 16:57:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:37.393 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:37.393 --rc genhtml_branch_coverage=1 00:21:37.393 --rc genhtml_function_coverage=1 00:21:37.393 --rc genhtml_legend=1 00:21:37.393 --rc geninfo_all_blocks=1 00:21:37.393 --rc geninfo_unexecuted_blocks=1 00:21:37.393 00:21:37.393 ' 00:21:37.393 16:57:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:37.393 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:37.393 --rc genhtml_branch_coverage=1 00:21:37.393 --rc genhtml_function_coverage=1 00:21:37.393 --rc genhtml_legend=1 00:21:37.393 --rc geninfo_all_blocks=1 00:21:37.393 --rc geninfo_unexecuted_blocks=1 00:21:37.393 00:21:37.393 ' 00:21:37.393 16:57:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:37.393 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:37.393 --rc genhtml_branch_coverage=1 00:21:37.393 --rc genhtml_function_coverage=1 00:21:37.393 --rc genhtml_legend=1 00:21:37.393 --rc geninfo_all_blocks=1 00:21:37.393 --rc geninfo_unexecuted_blocks=1 00:21:37.393 00:21:37.393 ' 00:21:37.393 16:57:22 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:37.393 16:57:22 -- nvmf/common.sh@7 -- # uname -s 00:21:37.393 16:57:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:37.393 16:57:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:37.393 16:57:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:37.393 16:57:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:37.393 16:57:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:37.393 16:57:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:37.393 16:57:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:37.393 16:57:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:37.393 16:57:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:37.393 16:57:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:37.393 16:57:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:37.393 16:57:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:37.393 16:57:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:37.393 16:57:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:37.393 16:57:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:37.393 16:57:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:37.393 16:57:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:37.393 16:57:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:37.393 16:57:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:37.393 16:57:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:37.393 16:57:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:37.393 16:57:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:37.393 16:57:22 -- paths/export.sh@5 -- # export PATH 00:21:37.393 16:57:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:37.393 16:57:22 -- nvmf/common.sh@46 -- # : 0 00:21:37.393 16:57:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:37.393 16:57:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:37.393 16:57:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:37.393 16:57:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:37.393 16:57:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:37.393 16:57:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:37.393 16:57:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:37.393 16:57:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:37.393 16:57:22 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:37.393 16:57:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:37.393 16:57:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:37.393 16:57:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:37.393 16:57:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:37.393 16:57:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:37.393 16:57:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:37.393 16:57:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:37.393 16:57:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:37.393 16:57:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:37.393 16:57:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:37.393 16:57:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:37.393 16:57:22 -- common/autotest_common.sh@10 -- # set +x 00:21:39.296 16:57:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:39.296 16:57:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:39.296 16:57:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:39.296 16:57:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:39.296 16:57:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:39.296 16:57:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:39.296 16:57:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:39.296 16:57:25 -- nvmf/common.sh@294 -- # net_devs=() 00:21:39.296 16:57:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:39.296 16:57:25 -- nvmf/common.sh@295 -- # e810=() 00:21:39.296 16:57:25 -- nvmf/common.sh@295 -- # local -ga e810 00:21:39.296 16:57:25 -- nvmf/common.sh@296 -- # x722=() 00:21:39.296 16:57:25 -- nvmf/common.sh@296 -- # local -ga x722 00:21:39.296 16:57:25 -- nvmf/common.sh@297 -- # mlx=() 00:21:39.296 16:57:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:39.296 16:57:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:39.296 16:57:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:39.296 16:57:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:39.296 16:57:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:39.296 16:57:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:39.296 16:57:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:39.296 16:57:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:39.296 16:57:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:39.555 16:57:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:39.555 16:57:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:39.555 16:57:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:39.555 16:57:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:39.555 16:57:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:39.555 16:57:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:39.555 16:57:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:39.555 16:57:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:39.555 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:39.555 16:57:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:39.555 16:57:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:39.555 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:39.555 16:57:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:39.555 16:57:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:39.555 16:57:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:39.555 16:57:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:39.555 16:57:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:39.555 16:57:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:39.555 16:57:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:39.555 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:39.555 16:57:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:39.555 16:57:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:39.555 16:57:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:39.555 16:57:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:39.555 16:57:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:39.555 16:57:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:39.555 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:39.556 16:57:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:39.556 16:57:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:39.556 16:57:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:39.556 16:57:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:39.556 16:57:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:39.556 16:57:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:39.556 16:57:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:39.556 16:57:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:39.556 16:57:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:39.556 16:57:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:39.556 16:57:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:39.556 16:57:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:39.556 16:57:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:39.556 16:57:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:39.556 16:57:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:39.556 16:57:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:39.556 16:57:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:39.556 16:57:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:39.556 16:57:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:39.556 16:57:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:39.556 16:57:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:39.556 16:57:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:39.556 16:57:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:39.556 16:57:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:39.556 16:57:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:39.556 16:57:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:39.556 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:39.556 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.211 ms 00:21:39.556 00:21:39.556 --- 10.0.0.2 ping statistics --- 00:21:39.556 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:39.556 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:21:39.556 16:57:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:39.556 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:39.556 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:21:39.556 00:21:39.556 --- 10.0.0.1 ping statistics --- 00:21:39.556 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:39.556 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:21:39.556 16:57:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:39.556 16:57:25 -- nvmf/common.sh@410 -- # return 0 00:21:39.556 16:57:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:39.556 16:57:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:39.556 16:57:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:39.556 16:57:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:39.556 16:57:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:39.556 16:57:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:39.556 16:57:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:39.556 16:57:25 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=1238889 00:21:39.556 16:57:25 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:39.556 16:57:25 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:39.556 16:57:25 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 1238889 00:21:39.556 16:57:25 -- common/autotest_common.sh@829 -- # '[' -z 1238889 ']' 00:21:39.556 16:57:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:39.556 16:57:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:39.556 16:57:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:39.556 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:39.556 16:57:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:39.556 16:57:25 -- common/autotest_common.sh@10 -- # set +x 00:21:40.512 16:57:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:40.512 16:57:26 -- common/autotest_common.sh@862 -- # return 0 00:21:40.512 16:57:26 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:40.512 16:57:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.512 16:57:26 -- common/autotest_common.sh@10 -- # set +x 00:21:40.771 16:57:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.771 16:57:26 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:40.771 16:57:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.771 16:57:26 -- common/autotest_common.sh@10 -- # set +x 00:21:40.771 Malloc0 00:21:40.771 16:57:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.771 16:57:26 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:40.771 16:57:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.771 16:57:26 -- common/autotest_common.sh@10 -- # set +x 00:21:40.771 16:57:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.771 16:57:26 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:40.771 16:57:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.771 16:57:26 -- common/autotest_common.sh@10 -- # set +x 00:21:40.771 16:57:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.771 16:57:26 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:40.771 16:57:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.771 16:57:26 -- common/autotest_common.sh@10 -- # set +x 00:21:40.771 16:57:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.771 16:57:26 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:40.771 16:57:26 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:22:12.838 Fuzzing completed. Shutting down the fuzz application 00:22:12.838 00:22:12.838 Dumping successful admin opcodes: 00:22:12.838 8, 9, 10, 24, 00:22:12.838 Dumping successful io opcodes: 00:22:12.838 0, 9, 00:22:12.838 NS: 0x200003aeff00 I/O qp, Total commands completed: 462248, total successful commands: 2673, random_seed: 1778400320 00:22:12.838 NS: 0x200003aeff00 admin qp, Total commands completed: 56352, total successful commands: 447, random_seed: 1354939584 00:22:12.839 16:57:56 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:22:12.839 Fuzzing completed. Shutting down the fuzz application 00:22:12.839 00:22:12.839 Dumping successful admin opcodes: 00:22:12.839 24, 00:22:12.839 Dumping successful io opcodes: 00:22:12.839 00:22:12.839 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 3627994040 00:22:12.839 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 3628129232 00:22:12.839 16:57:58 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:12.839 16:57:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.839 16:57:58 -- common/autotest_common.sh@10 -- # set +x 00:22:12.839 16:57:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.839 16:57:58 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:22:12.839 16:57:58 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:22:12.839 16:57:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:12.839 16:57:58 -- nvmf/common.sh@116 -- # sync 00:22:12.839 16:57:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:12.839 16:57:58 -- nvmf/common.sh@119 -- # set +e 00:22:12.839 16:57:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:12.839 16:57:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:12.839 rmmod nvme_tcp 00:22:12.839 rmmod nvme_fabrics 00:22:12.839 rmmod nvme_keyring 00:22:12.839 16:57:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:12.839 16:57:58 -- nvmf/common.sh@123 -- # set -e 00:22:12.839 16:57:58 -- nvmf/common.sh@124 -- # return 0 00:22:12.839 16:57:58 -- nvmf/common.sh@477 -- # '[' -n 1238889 ']' 00:22:12.839 16:57:58 -- nvmf/common.sh@478 -- # killprocess 1238889 00:22:12.839 16:57:58 -- common/autotest_common.sh@936 -- # '[' -z 1238889 ']' 00:22:12.839 16:57:58 -- common/autotest_common.sh@940 -- # kill -0 1238889 00:22:12.839 16:57:58 -- common/autotest_common.sh@941 -- # uname 00:22:12.839 16:57:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:12.839 16:57:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1238889 00:22:12.839 16:57:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:12.839 16:57:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:12.839 16:57:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1238889' 00:22:12.839 killing process with pid 1238889 00:22:12.839 16:57:58 -- common/autotest_common.sh@955 -- # kill 1238889 00:22:12.839 16:57:58 -- common/autotest_common.sh@960 -- # wait 1238889 00:22:13.098 16:57:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:13.098 16:57:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:13.098 16:57:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:13.098 16:57:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:13.098 16:57:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:13.098 16:57:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:13.098 16:57:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:13.098 16:57:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:15.003 16:58:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:15.003 16:58:00 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:22:15.263 00:22:15.263 real 0m37.946s 00:22:15.263 user 0m52.188s 00:22:15.263 sys 0m14.989s 00:22:15.263 16:58:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:15.263 16:58:00 -- common/autotest_common.sh@10 -- # set +x 00:22:15.263 ************************************ 00:22:15.263 END TEST nvmf_fuzz 00:22:15.263 ************************************ 00:22:15.263 16:58:00 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:15.263 16:58:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:15.263 16:58:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:15.263 16:58:00 -- common/autotest_common.sh@10 -- # set +x 00:22:15.263 ************************************ 00:22:15.263 START TEST nvmf_multiconnection 00:22:15.263 ************************************ 00:22:15.263 16:58:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:15.263 * Looking for test storage... 00:22:15.263 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:15.263 16:58:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:15.263 16:58:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:15.263 16:58:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:15.263 16:58:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:15.263 16:58:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:15.263 16:58:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:15.263 16:58:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:15.263 16:58:00 -- scripts/common.sh@335 -- # IFS=.-: 00:22:15.263 16:58:00 -- scripts/common.sh@335 -- # read -ra ver1 00:22:15.263 16:58:00 -- scripts/common.sh@336 -- # IFS=.-: 00:22:15.263 16:58:00 -- scripts/common.sh@336 -- # read -ra ver2 00:22:15.263 16:58:00 -- scripts/common.sh@337 -- # local 'op=<' 00:22:15.263 16:58:00 -- scripts/common.sh@339 -- # ver1_l=2 00:22:15.263 16:58:00 -- scripts/common.sh@340 -- # ver2_l=1 00:22:15.263 16:58:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:15.263 16:58:00 -- scripts/common.sh@343 -- # case "$op" in 00:22:15.263 16:58:00 -- scripts/common.sh@344 -- # : 1 00:22:15.263 16:58:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:15.263 16:58:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:15.263 16:58:00 -- scripts/common.sh@364 -- # decimal 1 00:22:15.263 16:58:00 -- scripts/common.sh@352 -- # local d=1 00:22:15.263 16:58:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:15.263 16:58:00 -- scripts/common.sh@354 -- # echo 1 00:22:15.263 16:58:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:15.263 16:58:00 -- scripts/common.sh@365 -- # decimal 2 00:22:15.263 16:58:00 -- scripts/common.sh@352 -- # local d=2 00:22:15.263 16:58:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:15.263 16:58:00 -- scripts/common.sh@354 -- # echo 2 00:22:15.263 16:58:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:15.263 16:58:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:15.263 16:58:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:15.263 16:58:00 -- scripts/common.sh@367 -- # return 0 00:22:15.263 16:58:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:15.263 16:58:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:15.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.263 --rc genhtml_branch_coverage=1 00:22:15.263 --rc genhtml_function_coverage=1 00:22:15.263 --rc genhtml_legend=1 00:22:15.263 --rc geninfo_all_blocks=1 00:22:15.263 --rc geninfo_unexecuted_blocks=1 00:22:15.263 00:22:15.263 ' 00:22:15.263 16:58:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:15.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.263 --rc genhtml_branch_coverage=1 00:22:15.263 --rc genhtml_function_coverage=1 00:22:15.263 --rc genhtml_legend=1 00:22:15.263 --rc geninfo_all_blocks=1 00:22:15.263 --rc geninfo_unexecuted_blocks=1 00:22:15.263 00:22:15.263 ' 00:22:15.263 16:58:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:15.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.263 --rc genhtml_branch_coverage=1 00:22:15.263 --rc genhtml_function_coverage=1 00:22:15.263 --rc genhtml_legend=1 00:22:15.263 --rc geninfo_all_blocks=1 00:22:15.263 --rc geninfo_unexecuted_blocks=1 00:22:15.263 00:22:15.263 ' 00:22:15.263 16:58:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:15.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.263 --rc genhtml_branch_coverage=1 00:22:15.263 --rc genhtml_function_coverage=1 00:22:15.263 --rc genhtml_legend=1 00:22:15.263 --rc geninfo_all_blocks=1 00:22:15.263 --rc geninfo_unexecuted_blocks=1 00:22:15.263 00:22:15.263 ' 00:22:15.263 16:58:00 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:15.263 16:58:00 -- nvmf/common.sh@7 -- # uname -s 00:22:15.263 16:58:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:15.263 16:58:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:15.263 16:58:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:15.263 16:58:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:15.263 16:58:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:15.263 16:58:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:15.263 16:58:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:15.263 16:58:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:15.263 16:58:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:15.263 16:58:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:15.263 16:58:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:15.263 16:58:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:15.263 16:58:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:15.263 16:58:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:15.263 16:58:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:15.263 16:58:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:15.263 16:58:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:15.263 16:58:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:15.263 16:58:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:15.263 16:58:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.263 16:58:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.264 16:58:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.264 16:58:00 -- paths/export.sh@5 -- # export PATH 00:22:15.264 16:58:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.264 16:58:00 -- nvmf/common.sh@46 -- # : 0 00:22:15.264 16:58:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:15.264 16:58:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:15.264 16:58:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:15.264 16:58:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:15.264 16:58:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:15.264 16:58:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:15.264 16:58:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:15.264 16:58:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:15.264 16:58:00 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:15.264 16:58:00 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:15.264 16:58:00 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:22:15.264 16:58:00 -- target/multiconnection.sh@16 -- # nvmftestinit 00:22:15.264 16:58:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:15.264 16:58:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:15.264 16:58:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:15.264 16:58:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:15.264 16:58:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:15.264 16:58:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:15.264 16:58:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:15.264 16:58:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:15.264 16:58:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:15.264 16:58:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:15.264 16:58:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:15.264 16:58:00 -- common/autotest_common.sh@10 -- # set +x 00:22:17.222 16:58:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:17.222 16:58:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:17.222 16:58:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:17.222 16:58:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:17.222 16:58:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:17.222 16:58:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:17.222 16:58:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:17.222 16:58:02 -- nvmf/common.sh@294 -- # net_devs=() 00:22:17.222 16:58:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:17.222 16:58:02 -- nvmf/common.sh@295 -- # e810=() 00:22:17.222 16:58:02 -- nvmf/common.sh@295 -- # local -ga e810 00:22:17.222 16:58:02 -- nvmf/common.sh@296 -- # x722=() 00:22:17.222 16:58:02 -- nvmf/common.sh@296 -- # local -ga x722 00:22:17.222 16:58:02 -- nvmf/common.sh@297 -- # mlx=() 00:22:17.222 16:58:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:17.222 16:58:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:17.222 16:58:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:17.223 16:58:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:17.223 16:58:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:17.223 16:58:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:17.223 16:58:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:17.223 16:58:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:17.223 16:58:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:17.223 16:58:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:17.223 16:58:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:17.223 16:58:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:17.223 16:58:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:17.223 16:58:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:17.223 16:58:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:17.223 16:58:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.223 16:58:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:17.223 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:17.223 16:58:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.223 16:58:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:17.223 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:17.223 16:58:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:17.223 16:58:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.223 16:58:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.223 16:58:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.223 16:58:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.223 16:58:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:17.223 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:17.223 16:58:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.223 16:58:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.223 16:58:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.223 16:58:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.223 16:58:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.223 16:58:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:17.223 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:17.223 16:58:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.223 16:58:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:17.223 16:58:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:17.223 16:58:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:17.223 16:58:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:17.223 16:58:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:17.223 16:58:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:17.223 16:58:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:17.223 16:58:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:17.223 16:58:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:17.223 16:58:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:17.223 16:58:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:17.223 16:58:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:17.223 16:58:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:17.223 16:58:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:17.223 16:58:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:17.223 16:58:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:17.223 16:58:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:17.223 16:58:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:17.223 16:58:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:17.223 16:58:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:17.223 16:58:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:17.223 16:58:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:17.482 16:58:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:17.482 16:58:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:17.482 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:17.482 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.131 ms 00:22:17.482 00:22:17.482 --- 10.0.0.2 ping statistics --- 00:22:17.482 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:17.482 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:22:17.482 16:58:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:17.482 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:17.482 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:22:17.482 00:22:17.482 --- 10.0.0.1 ping statistics --- 00:22:17.482 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:17.482 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:22:17.482 16:58:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:17.482 16:58:02 -- nvmf/common.sh@410 -- # return 0 00:22:17.482 16:58:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:17.482 16:58:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:17.482 16:58:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:17.482 16:58:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:17.482 16:58:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:17.482 16:58:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:17.482 16:58:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:17.482 16:58:02 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:22:17.482 16:58:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:17.482 16:58:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:17.482 16:58:02 -- common/autotest_common.sh@10 -- # set +x 00:22:17.482 16:58:02 -- nvmf/common.sh@469 -- # nvmfpid=1244900 00:22:17.482 16:58:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:17.482 16:58:02 -- nvmf/common.sh@470 -- # waitforlisten 1244900 00:22:17.482 16:58:02 -- common/autotest_common.sh@829 -- # '[' -z 1244900 ']' 00:22:17.482 16:58:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:17.482 16:58:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:17.482 16:58:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:17.482 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:17.482 16:58:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:17.482 16:58:02 -- common/autotest_common.sh@10 -- # set +x 00:22:17.482 [2024-11-16 16:58:03.034167] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:22:17.482 [2024-11-16 16:58:03.034240] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:17.482 EAL: No free 2048 kB hugepages reported on node 1 00:22:17.482 [2024-11-16 16:58:03.104113] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:17.482 [2024-11-16 16:58:03.197347] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:17.482 [2024-11-16 16:58:03.197525] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:17.482 [2024-11-16 16:58:03.197542] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:17.482 [2024-11-16 16:58:03.197554] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:17.482 [2024-11-16 16:58:03.197639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:17.482 [2024-11-16 16:58:03.197667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:17.482 [2024-11-16 16:58:03.197732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:17.482 [2024-11-16 16:58:03.197735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:18.417 16:58:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:18.417 16:58:04 -- common/autotest_common.sh@862 -- # return 0 00:22:18.417 16:58:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:18.417 16:58:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:18.417 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.417 16:58:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:18.417 16:58:04 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:18.417 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.417 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.417 [2024-11-16 16:58:04.092419] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:18.417 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.417 16:58:04 -- target/multiconnection.sh@21 -- # seq 1 11 00:22:18.417 16:58:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.417 16:58:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:18.417 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.417 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.417 Malloc1 00:22:18.417 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.417 16:58:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:22:18.417 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.417 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.417 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.417 16:58:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:18.417 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.417 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.417 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.417 16:58:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:18.417 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.417 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.417 [2024-11-16 16:58:04.149663] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:18.417 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.417 16:58:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.417 16:58:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:22:18.417 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.417 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.676 Malloc2 00:22:18.676 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.676 16:58:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:22:18.676 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.676 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.676 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.676 16:58:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:22:18.676 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.676 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.676 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.676 16:58:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:18.676 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.676 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.676 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.676 16:58:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.676 16:58:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:22:18.676 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.676 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.676 Malloc3 00:22:18.676 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.676 16:58:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:22:18.676 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.676 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.676 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.676 16:58:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:22:18.676 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.676 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.676 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.676 16:58:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.677 16:58:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 Malloc4 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.677 16:58:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 Malloc5 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.677 16:58:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 Malloc6 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.677 16:58:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 Malloc7 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.677 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.677 16:58:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:22:18.677 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.677 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.936 16:58:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 Malloc8 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.936 16:58:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 Malloc9 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.936 16:58:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 Malloc10 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.936 16:58:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 Malloc11 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:22:18.936 16:58:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.936 16:58:04 -- common/autotest_common.sh@10 -- # set +x 00:22:18.936 16:58:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.936 16:58:04 -- target/multiconnection.sh@28 -- # seq 1 11 00:22:18.936 16:58:04 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.936 16:58:04 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:19.869 16:58:05 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:22:19.869 16:58:05 -- common/autotest_common.sh@1187 -- # local i=0 00:22:19.869 16:58:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:19.869 16:58:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:19.869 16:58:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:21.767 16:58:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:21.767 16:58:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:21.767 16:58:07 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:22:21.767 16:58:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:21.767 16:58:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:21.767 16:58:07 -- common/autotest_common.sh@1197 -- # return 0 00:22:21.767 16:58:07 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:21.767 16:58:07 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:22.333 16:58:08 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:22.333 16:58:08 -- common/autotest_common.sh@1187 -- # local i=0 00:22:22.333 16:58:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:22.333 16:58:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:22.333 16:58:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:24.860 16:58:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:24.860 16:58:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:24.860 16:58:10 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:22:24.860 16:58:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:24.860 16:58:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:24.860 16:58:10 -- common/autotest_common.sh@1197 -- # return 0 00:22:24.860 16:58:10 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:24.860 16:58:10 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:25.118 16:58:10 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:25.118 16:58:10 -- common/autotest_common.sh@1187 -- # local i=0 00:22:25.118 16:58:10 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:25.118 16:58:10 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:25.118 16:58:10 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:27.018 16:58:12 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:27.018 16:58:12 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:27.018 16:58:12 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:22:27.018 16:58:12 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:27.018 16:58:12 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:27.018 16:58:12 -- common/autotest_common.sh@1197 -- # return 0 00:22:27.018 16:58:12 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:27.018 16:58:12 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:27.951 16:58:13 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:27.951 16:58:13 -- common/autotest_common.sh@1187 -- # local i=0 00:22:27.951 16:58:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:27.951 16:58:13 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:27.951 16:58:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:29.849 16:58:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:29.849 16:58:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:29.849 16:58:15 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:22:29.849 16:58:15 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:29.849 16:58:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:29.849 16:58:15 -- common/autotest_common.sh@1197 -- # return 0 00:22:29.849 16:58:15 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.849 16:58:15 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:30.782 16:58:16 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:30.782 16:58:16 -- common/autotest_common.sh@1187 -- # local i=0 00:22:30.782 16:58:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:30.782 16:58:16 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:30.782 16:58:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:32.681 16:58:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:32.681 16:58:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:32.681 16:58:18 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:22:32.681 16:58:18 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:32.681 16:58:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:32.681 16:58:18 -- common/autotest_common.sh@1197 -- # return 0 00:22:32.681 16:58:18 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:32.681 16:58:18 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:33.624 16:58:19 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:33.624 16:58:19 -- common/autotest_common.sh@1187 -- # local i=0 00:22:33.624 16:58:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:33.624 16:58:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:33.624 16:58:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:35.522 16:58:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:35.522 16:58:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:35.522 16:58:21 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:35.522 16:58:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:35.522 16:58:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:35.522 16:58:21 -- common/autotest_common.sh@1197 -- # return 0 00:22:35.522 16:58:21 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:35.522 16:58:21 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:36.088 16:58:21 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:36.088 16:58:21 -- common/autotest_common.sh@1187 -- # local i=0 00:22:36.088 16:58:21 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:36.089 16:58:21 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:36.089 16:58:21 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:37.988 16:58:23 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:37.988 16:58:23 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:37.988 16:58:23 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:37.988 16:58:23 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:37.988 16:58:23 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:37.988 16:58:23 -- common/autotest_common.sh@1197 -- # return 0 00:22:37.988 16:58:23 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:37.988 16:58:23 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:38.922 16:58:24 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:38.922 16:58:24 -- common/autotest_common.sh@1187 -- # local i=0 00:22:38.922 16:58:24 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:38.922 16:58:24 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:38.922 16:58:24 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:40.871 16:58:26 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:40.871 16:58:26 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:40.871 16:58:26 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:22:40.872 16:58:26 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:40.872 16:58:26 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:40.872 16:58:26 -- common/autotest_common.sh@1197 -- # return 0 00:22:40.872 16:58:26 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.872 16:58:26 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:41.805 16:58:27 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:41.805 16:58:27 -- common/autotest_common.sh@1187 -- # local i=0 00:22:41.805 16:58:27 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:41.805 16:58:27 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:41.805 16:58:27 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:43.702 16:58:29 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:43.702 16:58:29 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:43.702 16:58:29 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:22:43.702 16:58:29 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:43.702 16:58:29 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:43.702 16:58:29 -- common/autotest_common.sh@1197 -- # return 0 00:22:43.702 16:58:29 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:43.702 16:58:29 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:44.635 16:58:30 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:44.635 16:58:30 -- common/autotest_common.sh@1187 -- # local i=0 00:22:44.635 16:58:30 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:44.635 16:58:30 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:44.635 16:58:30 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:46.534 16:58:32 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:46.535 16:58:32 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:46.535 16:58:32 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:22:46.535 16:58:32 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:46.535 16:58:32 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:46.535 16:58:32 -- common/autotest_common.sh@1197 -- # return 0 00:22:46.535 16:58:32 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:46.535 16:58:32 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:47.470 16:58:33 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:47.470 16:58:33 -- common/autotest_common.sh@1187 -- # local i=0 00:22:47.470 16:58:33 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:47.470 16:58:33 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:47.470 16:58:33 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:49.368 16:58:35 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:49.368 16:58:35 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:49.368 16:58:35 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:22:49.368 16:58:35 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:49.368 16:58:35 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:49.368 16:58:35 -- common/autotest_common.sh@1197 -- # return 0 00:22:49.368 16:58:35 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:49.368 [global] 00:22:49.368 thread=1 00:22:49.368 invalidate=1 00:22:49.368 rw=read 00:22:49.368 time_based=1 00:22:49.368 runtime=10 00:22:49.368 ioengine=libaio 00:22:49.368 direct=1 00:22:49.368 bs=262144 00:22:49.368 iodepth=64 00:22:49.368 norandommap=1 00:22:49.368 numjobs=1 00:22:49.368 00:22:49.368 [job0] 00:22:49.368 filename=/dev/nvme0n1 00:22:49.368 [job1] 00:22:49.368 filename=/dev/nvme10n1 00:22:49.368 [job2] 00:22:49.368 filename=/dev/nvme1n1 00:22:49.368 [job3] 00:22:49.368 filename=/dev/nvme2n1 00:22:49.368 [job4] 00:22:49.368 filename=/dev/nvme3n1 00:22:49.368 [job5] 00:22:49.368 filename=/dev/nvme4n1 00:22:49.368 [job6] 00:22:49.368 filename=/dev/nvme5n1 00:22:49.368 [job7] 00:22:49.368 filename=/dev/nvme6n1 00:22:49.368 [job8] 00:22:49.368 filename=/dev/nvme7n1 00:22:49.368 [job9] 00:22:49.368 filename=/dev/nvme8n1 00:22:49.368 [job10] 00:22:49.368 filename=/dev/nvme9n1 00:22:49.626 Could not set queue depth (nvme0n1) 00:22:49.626 Could not set queue depth (nvme10n1) 00:22:49.626 Could not set queue depth (nvme1n1) 00:22:49.626 Could not set queue depth (nvme2n1) 00:22:49.626 Could not set queue depth (nvme3n1) 00:22:49.626 Could not set queue depth (nvme4n1) 00:22:49.626 Could not set queue depth (nvme5n1) 00:22:49.626 Could not set queue depth (nvme6n1) 00:22:49.626 Could not set queue depth (nvme7n1) 00:22:49.626 Could not set queue depth (nvme8n1) 00:22:49.626 Could not set queue depth (nvme9n1) 00:22:49.883 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.883 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.883 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.883 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.883 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.883 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.883 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.883 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.883 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.883 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.883 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.883 fio-3.35 00:22:49.883 Starting 11 threads 00:23:02.098 00:23:02.098 job0: (groupid=0, jobs=1): err= 0: pid=1249272: Sat Nov 16 16:58:45 2024 00:23:02.098 read: IOPS=397, BW=99.4MiB/s (104MB/s)(1005MiB/10104msec) 00:23:02.098 slat (usec): min=12, max=63616, avg=2246.04, stdev=6461.24 00:23:02.098 clat (msec): min=47, max=265, avg=158.57, stdev=24.58 00:23:02.098 lat (msec): min=47, max=265, avg=160.82, stdev=25.05 00:23:02.098 clat percentiles (msec): 00:23:02.098 | 1.00th=[ 105], 5.00th=[ 120], 10.00th=[ 128], 20.00th=[ 138], 00:23:02.098 | 30.00th=[ 146], 40.00th=[ 155], 50.00th=[ 159], 60.00th=[ 165], 00:23:02.098 | 70.00th=[ 171], 80.00th=[ 180], 90.00th=[ 190], 95.00th=[ 199], 00:23:02.098 | 99.00th=[ 215], 99.50th=[ 226], 99.90th=[ 236], 99.95th=[ 236], 00:23:02.098 | 99.99th=[ 266] 00:23:02.098 bw ( KiB/s): min=87552, max=125952, per=5.29%, avg=101204.65, stdev=10573.68, samples=20 00:23:02.098 iops : min= 342, max= 492, avg=395.25, stdev=41.33, samples=20 00:23:02.098 lat (msec) : 50=0.07%, 100=0.82%, 250=99.08%, 500=0.02% 00:23:02.098 cpu : usr=0.33%, sys=1.39%, ctx=794, majf=0, minf=4097 00:23:02.098 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:23:02.098 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.098 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.098 issued rwts: total=4018,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.098 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.098 job1: (groupid=0, jobs=1): err= 0: pid=1249288: Sat Nov 16 16:58:45 2024 00:23:02.098 read: IOPS=673, BW=168MiB/s (177MB/s)(1686MiB/10014msec) 00:23:02.098 slat (usec): min=13, max=161962, avg=1244.42, stdev=5734.70 00:23:02.098 clat (usec): min=1485, max=274993, avg=93710.53, stdev=60912.40 00:23:02.098 lat (usec): min=1543, max=345579, avg=94954.95, stdev=61776.56 00:23:02.098 clat percentiles (msec): 00:23:02.098 | 1.00th=[ 6], 5.00th=[ 16], 10.00th=[ 24], 20.00th=[ 34], 00:23:02.098 | 30.00th=[ 45], 40.00th=[ 62], 50.00th=[ 83], 60.00th=[ 102], 00:23:02.098 | 70.00th=[ 138], 80.00th=[ 161], 90.00th=[ 182], 95.00th=[ 194], 00:23:02.098 | 99.00th=[ 215], 99.50th=[ 257], 99.90th=[ 264], 99.95th=[ 264], 00:23:02.098 | 99.99th=[ 275] 00:23:02.098 bw ( KiB/s): min=93696, max=409088, per=8.94%, avg=171002.75, stdev=92412.83, samples=20 00:23:02.098 iops : min= 366, max= 1598, avg=667.90, stdev=360.96, samples=20 00:23:02.098 lat (msec) : 2=0.04%, 4=0.55%, 10=1.68%, 20=5.74%, 50=23.71% 00:23:02.098 lat (msec) : 100=27.69%, 250=39.96%, 500=0.64% 00:23:02.098 cpu : usr=0.47%, sys=2.43%, ctx=1250, majf=0, minf=4097 00:23:02.098 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:02.098 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.098 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.098 issued rwts: total=6745,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.098 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.098 job2: (groupid=0, jobs=1): err= 0: pid=1249310: Sat Nov 16 16:58:45 2024 00:23:02.098 read: IOPS=850, BW=213MiB/s (223MB/s)(2143MiB/10079msec) 00:23:02.098 slat (usec): min=9, max=135270, avg=830.75, stdev=4400.07 00:23:02.098 clat (usec): min=860, max=261920, avg=74371.03, stdev=57838.67 00:23:02.098 lat (usec): min=880, max=278293, avg=75201.78, stdev=58524.43 00:23:02.098 clat percentiles (usec): 00:23:02.098 | 1.00th=[ 1860], 5.00th=[ 7635], 10.00th=[ 15795], 20.00th=[ 27395], 00:23:02.098 | 30.00th=[ 30540], 40.00th=[ 34866], 50.00th=[ 40109], 60.00th=[ 90702], 00:23:02.098 | 70.00th=[110625], 80.00th=[139461], 90.00th=[164627], 95.00th=[175113], 00:23:02.098 | 99.00th=[196084], 99.50th=[204473], 99.90th=[219153], 99.95th=[227541], 00:23:02.098 | 99.99th=[261096] 00:23:02.098 bw ( KiB/s): min=91136, max=537600, per=11.38%, avg=217796.10, stdev=150227.80, samples=20 00:23:02.098 iops : min= 356, max= 2100, avg=850.70, stdev=586.87, samples=20 00:23:02.098 lat (usec) : 1000=0.05% 00:23:02.098 lat (msec) : 2=1.21%, 4=2.25%, 10=2.69%, 20=6.42%, 50=41.93% 00:23:02.098 lat (msec) : 100=9.24%, 250=36.20%, 500=0.01% 00:23:02.098 cpu : usr=0.43%, sys=2.13%, ctx=1530, majf=0, minf=4098 00:23:02.098 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:23:02.098 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.098 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.098 issued rwts: total=8572,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.098 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.098 job3: (groupid=0, jobs=1): err= 0: pid=1249332: Sat Nov 16 16:58:45 2024 00:23:02.098 read: IOPS=590, BW=148MiB/s (155MB/s)(1491MiB/10102msec) 00:23:02.098 slat (usec): min=9, max=152261, avg=1428.17, stdev=6691.10 00:23:02.099 clat (usec): min=1037, max=328205, avg=106882.39, stdev=64996.95 00:23:02.099 lat (usec): min=1056, max=328239, avg=108310.56, stdev=66050.81 00:23:02.099 clat percentiles (msec): 00:23:02.099 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 21], 20.00th=[ 32], 00:23:02.099 | 30.00th=[ 41], 40.00th=[ 90], 50.00th=[ 132], 60.00th=[ 148], 00:23:02.099 | 70.00th=[ 159], 80.00th=[ 169], 90.00th=[ 178], 95.00th=[ 188], 00:23:02.099 | 99.00th=[ 213], 99.50th=[ 224], 99.90th=[ 279], 99.95th=[ 292], 00:23:02.099 | 99.99th=[ 330] 00:23:02.099 bw ( KiB/s): min=94208, max=456814, per=7.89%, avg=150987.20, stdev=98326.96, samples=20 00:23:02.099 iops : min= 368, max= 1784, avg=589.70, stdev=384.01, samples=20 00:23:02.099 lat (msec) : 2=0.20%, 4=0.89%, 10=3.37%, 20=5.35%, 50=24.12% 00:23:02.099 lat (msec) : 100=7.43%, 250=58.44%, 500=0.20% 00:23:02.099 cpu : usr=0.30%, sys=1.81%, ctx=1081, majf=0, minf=4097 00:23:02.099 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:23:02.099 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.099 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.099 issued rwts: total=5965,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.099 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.099 job4: (groupid=0, jobs=1): err= 0: pid=1249344: Sat Nov 16 16:58:45 2024 00:23:02.099 read: IOPS=754, BW=189MiB/s (198MB/s)(1903MiB/10083msec) 00:23:02.099 slat (usec): min=12, max=65811, avg=1244.00, stdev=3892.60 00:23:02.099 clat (usec): min=970, max=197743, avg=83459.65, stdev=29781.77 00:23:02.099 lat (usec): min=991, max=197783, avg=84703.65, stdev=30247.39 00:23:02.099 clat percentiles (msec): 00:23:02.099 | 1.00th=[ 13], 5.00th=[ 31], 10.00th=[ 42], 20.00th=[ 58], 00:23:02.099 | 30.00th=[ 73], 40.00th=[ 81], 50.00th=[ 86], 60.00th=[ 92], 00:23:02.099 | 70.00th=[ 99], 80.00th=[ 108], 90.00th=[ 120], 95.00th=[ 127], 00:23:02.099 | 99.00th=[ 157], 99.50th=[ 176], 99.90th=[ 192], 99.95th=[ 192], 00:23:02.099 | 99.99th=[ 199] 00:23:02.099 bw ( KiB/s): min=122368, max=346624, per=10.10%, avg=193192.05, stdev=59143.37, samples=20 00:23:02.099 iops : min= 478, max= 1354, avg=754.60, stdev=231.04, samples=20 00:23:02.099 lat (usec) : 1000=0.01% 00:23:02.099 lat (msec) : 2=0.12%, 4=0.14%, 10=0.45%, 20=1.67%, 50=11.32% 00:23:02.099 lat (msec) : 100=58.41%, 250=27.88% 00:23:02.099 cpu : usr=0.41%, sys=2.55%, ctx=1294, majf=0, minf=3721 00:23:02.099 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:02.099 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.099 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.099 issued rwts: total=7612,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.099 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.099 job5: (groupid=0, jobs=1): err= 0: pid=1249388: Sat Nov 16 16:58:45 2024 00:23:02.099 read: IOPS=515, BW=129MiB/s (135MB/s)(1303MiB/10105msec) 00:23:02.099 slat (usec): min=10, max=96572, avg=1561.25, stdev=5607.63 00:23:02.099 clat (msec): min=2, max=270, avg=122.41, stdev=42.62 00:23:02.099 lat (msec): min=2, max=270, avg=123.97, stdev=43.30 00:23:02.099 clat percentiles (msec): 00:23:02.099 | 1.00th=[ 24], 5.00th=[ 56], 10.00th=[ 77], 20.00th=[ 87], 00:23:02.099 | 30.00th=[ 93], 40.00th=[ 104], 50.00th=[ 118], 60.00th=[ 140], 00:23:02.099 | 70.00th=[ 153], 80.00th=[ 163], 90.00th=[ 176], 95.00th=[ 186], 00:23:02.099 | 99.00th=[ 226], 99.50th=[ 230], 99.90th=[ 253], 99.95th=[ 268], 00:23:02.099 | 99.99th=[ 271] 00:23:02.099 bw ( KiB/s): min=89088, max=208384, per=6.89%, avg=131770.80, stdev=33584.51, samples=20 00:23:02.099 iops : min= 348, max= 814, avg=514.65, stdev=131.13, samples=20 00:23:02.099 lat (msec) : 4=0.31%, 10=0.17%, 20=0.33%, 50=3.61%, 100=32.34% 00:23:02.099 lat (msec) : 250=63.13%, 500=0.12% 00:23:02.099 cpu : usr=0.29%, sys=1.81%, ctx=1064, majf=0, minf=4097 00:23:02.099 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:02.099 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.099 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.099 issued rwts: total=5213,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.099 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.099 job6: (groupid=0, jobs=1): err= 0: pid=1249407: Sat Nov 16 16:58:45 2024 00:23:02.099 read: IOPS=840, BW=210MiB/s (220MB/s)(2118MiB/10083msec) 00:23:02.099 slat (usec): min=13, max=41639, avg=1158.13, stdev=3540.50 00:23:02.099 clat (msec): min=18, max=200, avg=74.96, stdev=30.59 00:23:02.099 lat (msec): min=18, max=200, avg=76.12, stdev=31.08 00:23:02.099 clat percentiles (msec): 00:23:02.099 | 1.00th=[ 27], 5.00th=[ 31], 10.00th=[ 34], 20.00th=[ 46], 00:23:02.099 | 30.00th=[ 56], 40.00th=[ 65], 50.00th=[ 75], 60.00th=[ 84], 00:23:02.099 | 70.00th=[ 91], 80.00th=[ 102], 90.00th=[ 115], 95.00th=[ 127], 00:23:02.099 | 99.00th=[ 153], 99.50th=[ 174], 99.90th=[ 182], 99.95th=[ 184], 00:23:02.099 | 99.99th=[ 201] 00:23:02.099 bw ( KiB/s): min=116736, max=396288, per=11.25%, avg=215179.40, stdev=83706.08, samples=20 00:23:02.099 iops : min= 456, max= 1548, avg=840.45, stdev=326.97, samples=20 00:23:02.099 lat (msec) : 20=0.05%, 50=23.91%, 100=54.73%, 250=21.32% 00:23:02.099 cpu : usr=0.47%, sys=2.69%, ctx=1345, majf=0, minf=4097 00:23:02.099 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:23:02.099 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.099 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.099 issued rwts: total=8471,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.099 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.099 job7: (groupid=0, jobs=1): err= 0: pid=1249408: Sat Nov 16 16:58:45 2024 00:23:02.099 read: IOPS=1009, BW=252MiB/s (265MB/s)(2550MiB/10104msec) 00:23:02.099 slat (usec): min=10, max=155219, avg=797.62, stdev=3510.27 00:23:02.099 clat (usec): min=1551, max=297757, avg=62554.32, stdev=50312.94 00:23:02.099 lat (usec): min=1575, max=307187, avg=63351.94, stdev=50890.15 00:23:02.099 clat percentiles (msec): 00:23:02.099 | 1.00th=[ 7], 5.00th=[ 20], 10.00th=[ 27], 20.00th=[ 29], 00:23:02.099 | 30.00th=[ 30], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 52], 00:23:02.099 | 70.00th=[ 67], 80.00th=[ 100], 90.00th=[ 155], 95.00th=[ 171], 00:23:02.099 | 99.00th=[ 201], 99.50th=[ 213], 99.90th=[ 243], 99.95th=[ 249], 00:23:02.099 | 99.99th=[ 264] 00:23:02.099 bw ( KiB/s): min=86016, max=547257, per=13.56%, avg=259402.05, stdev=155140.46, samples=20 00:23:02.099 iops : min= 336, max= 2137, avg=1013.15, stdev=605.87, samples=20 00:23:02.099 lat (msec) : 2=0.03%, 4=0.10%, 10=3.52%, 20=1.43%, 50=53.56% 00:23:02.099 lat (msec) : 100=21.44%, 250=19.89%, 500=0.03% 00:23:02.099 cpu : usr=0.56%, sys=2.86%, ctx=1847, majf=0, minf=4097 00:23:02.099 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:23:02.099 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.099 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.099 issued rwts: total=10200,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.099 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.099 job8: (groupid=0, jobs=1): err= 0: pid=1249418: Sat Nov 16 16:58:45 2024 00:23:02.099 read: IOPS=593, BW=148MiB/s (156MB/s)(1501MiB/10108msec) 00:23:02.099 slat (usec): min=12, max=147482, avg=1481.13, stdev=5944.72 00:23:02.099 clat (usec): min=1117, max=307450, avg=106197.44, stdev=66451.74 00:23:02.099 lat (usec): min=1150, max=307492, avg=107678.57, stdev=67504.61 00:23:02.099 clat percentiles (msec): 00:23:02.099 | 1.00th=[ 5], 5.00th=[ 13], 10.00th=[ 21], 20.00th=[ 30], 00:23:02.099 | 30.00th=[ 44], 40.00th=[ 79], 50.00th=[ 117], 60.00th=[ 142], 00:23:02.099 | 70.00th=[ 159], 80.00th=[ 169], 90.00th=[ 188], 95.00th=[ 199], 00:23:02.099 | 99.00th=[ 234], 99.50th=[ 251], 99.90th=[ 271], 99.95th=[ 275], 00:23:02.099 | 99.99th=[ 309] 00:23:02.099 bw ( KiB/s): min=79201, max=366080, per=7.95%, avg=152035.80, stdev=81814.68, samples=20 00:23:02.099 iops : min= 309, max= 1430, avg=593.85, stdev=319.61, samples=20 00:23:02.099 lat (msec) : 2=0.05%, 4=0.93%, 10=2.20%, 20=6.83%, 50=21.36% 00:23:02.099 lat (msec) : 100=13.84%, 250=54.19%, 500=0.60% 00:23:02.099 cpu : usr=0.30%, sys=1.95%, ctx=1169, majf=0, minf=4097 00:23:02.099 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:02.099 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.099 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.099 issued rwts: total=6003,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.099 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.099 job9: (groupid=0, jobs=1): err= 0: pid=1249422: Sat Nov 16 16:58:45 2024 00:23:02.099 read: IOPS=576, BW=144MiB/s (151MB/s)(1456MiB/10106msec) 00:23:02.099 slat (usec): min=8, max=142389, avg=1502.64, stdev=6092.00 00:23:02.099 clat (msec): min=2, max=311, avg=109.47, stdev=66.46 00:23:02.099 lat (msec): min=2, max=311, avg=110.97, stdev=67.56 00:23:02.099 clat percentiles (msec): 00:23:02.099 | 1.00th=[ 6], 5.00th=[ 16], 10.00th=[ 24], 20.00th=[ 29], 00:23:02.099 | 30.00th=[ 55], 40.00th=[ 83], 50.00th=[ 113], 60.00th=[ 148], 00:23:02.099 | 70.00th=[ 165], 80.00th=[ 178], 90.00th=[ 188], 95.00th=[ 201], 00:23:02.099 | 99.00th=[ 226], 99.50th=[ 239], 99.90th=[ 259], 99.95th=[ 288], 00:23:02.099 | 99.99th=[ 313] 00:23:02.099 bw ( KiB/s): min=79360, max=594944, per=7.71%, avg=147456.10, stdev=113923.94, samples=20 00:23:02.099 iops : min= 310, max= 2324, avg=575.95, stdev=445.04, samples=20 00:23:02.099 lat (msec) : 4=0.31%, 10=1.72%, 20=4.77%, 50=21.57%, 100=18.49% 00:23:02.099 lat (msec) : 250=52.97%, 500=0.17% 00:23:02.099 cpu : usr=0.27%, sys=1.72%, ctx=1072, majf=0, minf=4098 00:23:02.099 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:23:02.099 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.099 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.099 issued rwts: total=5824,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.099 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.099 job10: (groupid=0, jobs=1): err= 0: pid=1249427: Sat Nov 16 16:58:45 2024 00:23:02.099 read: IOPS=685, BW=171MiB/s (180MB/s)(1729MiB/10084msec) 00:23:02.099 slat (usec): min=9, max=134477, avg=1071.74, stdev=5580.59 00:23:02.099 clat (usec): min=643, max=333863, avg=92167.34, stdev=60426.06 00:23:02.099 lat (usec): min=698, max=333877, avg=93239.08, stdev=61266.48 00:23:02.099 clat percentiles (msec): 00:23:02.099 | 1.00th=[ 5], 5.00th=[ 14], 10.00th=[ 22], 20.00th=[ 33], 00:23:02.099 | 30.00th=[ 45], 40.00th=[ 61], 50.00th=[ 84], 60.00th=[ 101], 00:23:02.100 | 70.00th=[ 126], 80.00th=[ 163], 90.00th=[ 182], 95.00th=[ 192], 00:23:02.100 | 99.00th=[ 213], 99.50th=[ 222], 99.90th=[ 259], 99.95th=[ 279], 00:23:02.100 | 99.99th=[ 334] 00:23:02.100 bw ( KiB/s): min=86528, max=410624, per=9.17%, avg=175426.75, stdev=91754.52, samples=20 00:23:02.100 iops : min= 338, max= 1604, avg=685.20, stdev=358.44, samples=20 00:23:02.100 lat (usec) : 750=0.01%, 1000=0.04% 00:23:02.100 lat (msec) : 2=0.07%, 4=0.56%, 10=2.37%, 20=5.87%, 50=24.26% 00:23:02.100 lat (msec) : 100=26.62%, 250=40.09%, 500=0.10% 00:23:02.100 cpu : usr=0.47%, sys=1.98%, ctx=1389, majf=0, minf=4097 00:23:02.100 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:02.100 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.100 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.100 issued rwts: total=6917,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.100 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.100 00:23:02.100 Run status group 0 (all jobs): 00:23:02.100 READ: bw=1868MiB/s (1959MB/s), 99.4MiB/s-252MiB/s (104MB/s-265MB/s), io=18.4GiB (19.8GB), run=10014-10108msec 00:23:02.100 00:23:02.100 Disk stats (read/write): 00:23:02.100 nvme0n1: ios=7866/0, merge=0/0, ticks=1229507/0, in_queue=1229507, util=97.12% 00:23:02.100 nvme10n1: ios=13116/0, merge=0/0, ticks=1238127/0, in_queue=1238127, util=97.35% 00:23:02.100 nvme1n1: ios=16945/0, merge=0/0, ticks=1240153/0, in_queue=1240153, util=97.65% 00:23:02.100 nvme2n1: ios=11748/0, merge=0/0, ticks=1230912/0, in_queue=1230912, util=97.79% 00:23:02.100 nvme3n1: ios=15022/0, merge=0/0, ticks=1234571/0, in_queue=1234571, util=97.88% 00:23:02.100 nvme4n1: ios=10234/0, merge=0/0, ticks=1229925/0, in_queue=1229925, util=98.25% 00:23:02.100 nvme5n1: ios=16738/0, merge=0/0, ticks=1234379/0, in_queue=1234379, util=98.41% 00:23:02.100 nvme6n1: ios=20232/0, merge=0/0, ticks=1234834/0, in_queue=1234834, util=98.51% 00:23:02.100 nvme7n1: ios=11845/0, merge=0/0, ticks=1227421/0, in_queue=1227421, util=98.88% 00:23:02.100 nvme8n1: ios=11472/0, merge=0/0, ticks=1227777/0, in_queue=1227777, util=99.07% 00:23:02.100 nvme9n1: ios=13402/0, merge=0/0, ticks=1238111/0, in_queue=1238111, util=99.20% 00:23:02.100 16:58:45 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:23:02.100 [global] 00:23:02.100 thread=1 00:23:02.100 invalidate=1 00:23:02.100 rw=randwrite 00:23:02.100 time_based=1 00:23:02.100 runtime=10 00:23:02.100 ioengine=libaio 00:23:02.100 direct=1 00:23:02.100 bs=262144 00:23:02.100 iodepth=64 00:23:02.100 norandommap=1 00:23:02.100 numjobs=1 00:23:02.100 00:23:02.100 [job0] 00:23:02.100 filename=/dev/nvme0n1 00:23:02.100 [job1] 00:23:02.100 filename=/dev/nvme10n1 00:23:02.100 [job2] 00:23:02.100 filename=/dev/nvme1n1 00:23:02.100 [job3] 00:23:02.100 filename=/dev/nvme2n1 00:23:02.100 [job4] 00:23:02.100 filename=/dev/nvme3n1 00:23:02.100 [job5] 00:23:02.100 filename=/dev/nvme4n1 00:23:02.100 [job6] 00:23:02.100 filename=/dev/nvme5n1 00:23:02.100 [job7] 00:23:02.100 filename=/dev/nvme6n1 00:23:02.100 [job8] 00:23:02.100 filename=/dev/nvme7n1 00:23:02.100 [job9] 00:23:02.100 filename=/dev/nvme8n1 00:23:02.100 [job10] 00:23:02.100 filename=/dev/nvme9n1 00:23:02.100 Could not set queue depth (nvme0n1) 00:23:02.100 Could not set queue depth (nvme10n1) 00:23:02.100 Could not set queue depth (nvme1n1) 00:23:02.100 Could not set queue depth (nvme2n1) 00:23:02.100 Could not set queue depth (nvme3n1) 00:23:02.100 Could not set queue depth (nvme4n1) 00:23:02.100 Could not set queue depth (nvme5n1) 00:23:02.100 Could not set queue depth (nvme6n1) 00:23:02.100 Could not set queue depth (nvme7n1) 00:23:02.100 Could not set queue depth (nvme8n1) 00:23:02.100 Could not set queue depth (nvme9n1) 00:23:02.100 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.100 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.100 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.100 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.100 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.100 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.100 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.100 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.100 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.100 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.100 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.100 fio-3.35 00:23:02.100 Starting 11 threads 00:23:12.166 00:23:12.166 job0: (groupid=0, jobs=1): err= 0: pid=1250621: Sat Nov 16 16:58:56 2024 00:23:12.166 write: IOPS=481, BW=120MiB/s (126MB/s)(1216MiB/10091msec); 0 zone resets 00:23:12.166 slat (usec): min=14, max=63754, avg=1233.62, stdev=3729.52 00:23:12.166 clat (usec): min=1087, max=280389, avg=131486.03, stdev=71461.53 00:23:12.166 lat (usec): min=1131, max=283788, avg=132719.65, stdev=72312.29 00:23:12.166 clat percentiles (msec): 00:23:12.166 | 1.00th=[ 4], 5.00th=[ 13], 10.00th=[ 28], 20.00th=[ 53], 00:23:12.166 | 30.00th=[ 90], 40.00th=[ 116], 50.00th=[ 136], 60.00th=[ 155], 00:23:12.166 | 70.00th=[ 182], 80.00th=[ 205], 90.00th=[ 228], 95.00th=[ 241], 00:23:12.166 | 99.00th=[ 251], 99.50th=[ 262], 99.90th=[ 275], 99.95th=[ 279], 00:23:12.166 | 99.99th=[ 279] 00:23:12.166 bw ( KiB/s): min=75776, max=346624, per=8.84%, avg=122855.95, stdev=60193.31, samples=20 00:23:12.166 iops : min= 296, max= 1354, avg=479.85, stdev=235.14, samples=20 00:23:12.166 lat (msec) : 2=0.23%, 4=0.80%, 10=2.78%, 20=2.94%, 50=11.56% 00:23:12.166 lat (msec) : 100=16.23%, 250=64.09%, 500=1.38% 00:23:12.166 cpu : usr=1.33%, sys=1.85%, ctx=2962, majf=0, minf=1 00:23:12.166 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:12.166 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.166 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.166 issued rwts: total=0,4862,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.166 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.166 job1: (groupid=0, jobs=1): err= 0: pid=1250637: Sat Nov 16 16:58:56 2024 00:23:12.166 write: IOPS=621, BW=155MiB/s (163MB/s)(1560MiB/10037msec); 0 zone resets 00:23:12.166 slat (usec): min=16, max=107445, avg=1134.23, stdev=3454.95 00:23:12.166 clat (usec): min=1267, max=387465, avg=101764.58, stdev=72010.32 00:23:12.166 lat (usec): min=1335, max=387511, avg=102898.81, stdev=72817.12 00:23:12.166 clat percentiles (msec): 00:23:12.166 | 1.00th=[ 6], 5.00th=[ 15], 10.00th=[ 33], 20.00th=[ 42], 00:23:12.166 | 30.00th=[ 55], 40.00th=[ 73], 50.00th=[ 79], 60.00th=[ 90], 00:23:12.166 | 70.00th=[ 122], 80.00th=[ 169], 90.00th=[ 215], 95.00th=[ 259], 00:23:12.166 | 99.00th=[ 292], 99.50th=[ 300], 99.90th=[ 317], 99.95th=[ 321], 00:23:12.166 | 99.99th=[ 388] 00:23:12.166 bw ( KiB/s): min=59392, max=325632, per=11.38%, avg=158161.65, stdev=75867.00, samples=20 00:23:12.166 iops : min= 232, max= 1272, avg=617.80, stdev=296.35, samples=20 00:23:12.166 lat (msec) : 2=0.05%, 4=0.53%, 10=2.64%, 20=3.19%, 50=21.70% 00:23:12.166 lat (msec) : 100=36.00%, 250=30.14%, 500=5.75% 00:23:12.166 cpu : usr=1.93%, sys=2.37%, ctx=3027, majf=0, minf=2 00:23:12.166 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:12.166 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.166 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.166 issued rwts: total=0,6241,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.166 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.166 job2: (groupid=0, jobs=1): err= 0: pid=1250638: Sat Nov 16 16:58:56 2024 00:23:12.166 write: IOPS=431, BW=108MiB/s (113MB/s)(1091MiB/10104msec); 0 zone resets 00:23:12.166 slat (usec): min=24, max=92091, avg=1974.53, stdev=4654.74 00:23:12.166 clat (usec): min=1251, max=304175, avg=146126.98, stdev=70411.65 00:23:12.166 lat (usec): min=1502, max=305729, avg=148101.51, stdev=71413.84 00:23:12.166 clat percentiles (msec): 00:23:12.166 | 1.00th=[ 4], 5.00th=[ 26], 10.00th=[ 41], 20.00th=[ 77], 00:23:12.166 | 30.00th=[ 124], 40.00th=[ 140], 50.00th=[ 150], 60.00th=[ 169], 00:23:12.166 | 70.00th=[ 188], 80.00th=[ 207], 90.00th=[ 232], 95.00th=[ 262], 00:23:12.166 | 99.00th=[ 288], 99.50th=[ 292], 99.90th=[ 300], 99.95th=[ 300], 00:23:12.166 | 99.99th=[ 305] 00:23:12.166 bw ( KiB/s): min=55296, max=313856, per=7.92%, avg=110085.35, stdev=54048.11, samples=20 00:23:12.166 iops : min= 216, max= 1226, avg=430.00, stdev=211.13, samples=20 00:23:12.166 lat (msec) : 2=0.09%, 4=0.99%, 10=2.02%, 20=1.21%, 50=11.51% 00:23:12.166 lat (msec) : 100=9.31%, 250=68.85%, 500=6.03% 00:23:12.166 cpu : usr=1.39%, sys=1.37%, ctx=1863, majf=0, minf=1 00:23:12.166 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:23:12.166 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.166 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.166 issued rwts: total=0,4363,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.166 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.166 job3: (groupid=0, jobs=1): err= 0: pid=1250639: Sat Nov 16 16:58:56 2024 00:23:12.166 write: IOPS=347, BW=86.8MiB/s (91.0MB/s)(881MiB/10147msec); 0 zone resets 00:23:12.166 slat (usec): min=21, max=88651, avg=2371.77, stdev=6130.90 00:23:12.166 clat (usec): min=1578, max=388590, avg=181883.60, stdev=86311.91 00:23:12.166 lat (msec): min=2, max=388, avg=184.26, stdev=87.62 00:23:12.166 clat percentiles (msec): 00:23:12.166 | 1.00th=[ 10], 5.00th=[ 31], 10.00th=[ 48], 20.00th=[ 78], 00:23:12.166 | 30.00th=[ 157], 40.00th=[ 182], 50.00th=[ 199], 60.00th=[ 213], 00:23:12.166 | 70.00th=[ 234], 80.00th=[ 249], 90.00th=[ 284], 95.00th=[ 309], 00:23:12.166 | 99.00th=[ 368], 99.50th=[ 380], 99.90th=[ 384], 99.95th=[ 388], 00:23:12.166 | 99.99th=[ 388] 00:23:12.166 bw ( KiB/s): min=45056, max=303520, per=6.37%, avg=88545.60, stdev=53433.91, samples=20 00:23:12.166 iops : min= 176, max= 1185, avg=345.85, stdev=208.59, samples=20 00:23:12.166 lat (msec) : 2=0.06%, 4=0.26%, 10=0.71%, 20=1.53%, 50=8.09% 00:23:12.166 lat (msec) : 100=12.80%, 250=57.20%, 500=19.36% 00:23:12.166 cpu : usr=1.12%, sys=1.25%, ctx=1568, majf=0, minf=1 00:23:12.166 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.5%, 32=0.9%, >=64=98.2% 00:23:12.166 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.166 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.166 issued rwts: total=0,3523,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.166 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.166 job4: (groupid=0, jobs=1): err= 0: pid=1250640: Sat Nov 16 16:58:56 2024 00:23:12.166 write: IOPS=428, BW=107MiB/s (112MB/s)(1083MiB/10110msec); 0 zone resets 00:23:12.166 slat (usec): min=25, max=56903, avg=2022.69, stdev=4530.65 00:23:12.166 clat (usec): min=1676, max=294274, avg=147221.66, stdev=53479.93 00:23:12.166 lat (usec): min=1809, max=294306, avg=149244.35, stdev=54225.23 00:23:12.166 clat percentiles (msec): 00:23:12.166 | 1.00th=[ 8], 5.00th=[ 37], 10.00th=[ 86], 20.00th=[ 111], 00:23:12.167 | 30.00th=[ 130], 40.00th=[ 138], 50.00th=[ 144], 60.00th=[ 155], 00:23:12.167 | 70.00th=[ 171], 80.00th=[ 192], 90.00th=[ 213], 95.00th=[ 234], 00:23:12.167 | 99.00th=[ 275], 99.50th=[ 288], 99.90th=[ 296], 99.95th=[ 296], 00:23:12.167 | 99.99th=[ 296] 00:23:12.167 bw ( KiB/s): min=61440, max=201216, per=7.87%, avg=109325.30, stdev=30760.30, samples=20 00:23:12.167 iops : min= 240, max= 786, avg=427.05, stdev=120.16, samples=20 00:23:12.167 lat (msec) : 2=0.02%, 4=0.28%, 10=1.32%, 20=1.34%, 50=2.98% 00:23:12.167 lat (msec) : 100=7.66%, 250=83.71%, 500=2.70% 00:23:12.167 cpu : usr=1.44%, sys=1.19%, ctx=1677, majf=0, minf=1 00:23:12.167 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:23:12.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.167 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.167 issued rwts: total=0,4333,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.167 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.167 job5: (groupid=0, jobs=1): err= 0: pid=1250641: Sat Nov 16 16:58:56 2024 00:23:12.167 write: IOPS=496, BW=124MiB/s (130MB/s)(1259MiB/10147msec); 0 zone resets 00:23:12.167 slat (usec): min=24, max=80900, avg=1554.63, stdev=4177.28 00:23:12.167 clat (usec): min=805, max=338027, avg=126999.37, stdev=77086.67 00:23:12.167 lat (usec): min=851, max=338096, avg=128553.99, stdev=78066.41 00:23:12.167 clat percentiles (msec): 00:23:12.167 | 1.00th=[ 7], 5.00th=[ 42], 10.00th=[ 43], 20.00th=[ 45], 00:23:12.167 | 30.00th=[ 59], 40.00th=[ 96], 50.00th=[ 115], 60.00th=[ 146], 00:23:12.167 | 70.00th=[ 169], 80.00th=[ 205], 90.00th=[ 241], 95.00th=[ 264], 00:23:12.167 | 99.00th=[ 305], 99.50th=[ 317], 99.90th=[ 330], 99.95th=[ 330], 00:23:12.167 | 99.99th=[ 338] 00:23:12.167 bw ( KiB/s): min=55296, max=367616, per=9.16%, avg=127311.25, stdev=75392.58, samples=20 00:23:12.167 iops : min= 216, max= 1436, avg=497.25, stdev=294.52, samples=20 00:23:12.167 lat (usec) : 1000=0.04% 00:23:12.167 lat (msec) : 2=0.24%, 4=0.34%, 10=0.93%, 20=0.48%, 50=25.68% 00:23:12.167 lat (msec) : 100=13.34%, 250=51.33%, 500=7.63% 00:23:12.167 cpu : usr=1.61%, sys=1.61%, ctx=2227, majf=0, minf=1 00:23:12.167 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:23:12.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.167 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.167 issued rwts: total=0,5036,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.167 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.167 job6: (groupid=0, jobs=1): err= 0: pid=1250642: Sat Nov 16 16:58:56 2024 00:23:12.167 write: IOPS=623, BW=156MiB/s (163MB/s)(1577MiB/10120msec); 0 zone resets 00:23:12.167 slat (usec): min=21, max=54075, avg=1146.75, stdev=3020.52 00:23:12.167 clat (usec): min=915, max=306544, avg=101462.40, stdev=57349.68 00:23:12.167 lat (usec): min=968, max=306633, avg=102609.15, stdev=58022.10 00:23:12.167 clat percentiles (msec): 00:23:12.167 | 1.00th=[ 3], 5.00th=[ 11], 10.00th=[ 31], 20.00th=[ 64], 00:23:12.167 | 30.00th=[ 77], 40.00th=[ 80], 50.00th=[ 90], 60.00th=[ 107], 00:23:12.167 | 70.00th=[ 123], 80.00th=[ 142], 90.00th=[ 182], 95.00th=[ 220], 00:23:12.167 | 99.00th=[ 271], 99.50th=[ 288], 99.90th=[ 292], 99.95th=[ 292], 00:23:12.167 | 99.99th=[ 309] 00:23:12.167 bw ( KiB/s): min=65536, max=212992, per=11.50%, avg=159843.70, stdev=34842.68, samples=20 00:23:12.167 iops : min= 256, max= 832, avg=624.35, stdev=136.10, samples=20 00:23:12.167 lat (usec) : 1000=0.03% 00:23:12.167 lat (msec) : 2=0.55%, 4=2.35%, 10=1.98%, 20=1.68%, 50=9.99% 00:23:12.167 lat (msec) : 100=38.56%, 250=43.06%, 500=1.79% 00:23:12.167 cpu : usr=1.99%, sys=1.93%, ctx=3337, majf=0, minf=1 00:23:12.167 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:12.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.167 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.167 issued rwts: total=0,6307,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.167 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.167 job7: (groupid=0, jobs=1): err= 0: pid=1250643: Sat Nov 16 16:58:56 2024 00:23:12.167 write: IOPS=455, BW=114MiB/s (119MB/s)(1156MiB/10147msec); 0 zone resets 00:23:12.167 slat (usec): min=16, max=77742, avg=1590.39, stdev=4386.33 00:23:12.167 clat (usec): min=1674, max=305863, avg=138856.29, stdev=81307.53 00:23:12.167 lat (usec): min=1722, max=309643, avg=140446.68, stdev=82345.37 00:23:12.167 clat percentiles (msec): 00:23:12.167 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 43], 20.00th=[ 52], 00:23:12.167 | 30.00th=[ 69], 40.00th=[ 109], 50.00th=[ 146], 60.00th=[ 176], 00:23:12.167 | 70.00th=[ 194], 80.00th=[ 220], 90.00th=[ 249], 95.00th=[ 264], 00:23:12.167 | 99.00th=[ 292], 99.50th=[ 296], 99.90th=[ 300], 99.95th=[ 305], 00:23:12.167 | 99.99th=[ 305] 00:23:12.167 bw ( KiB/s): min=59392, max=318976, per=8.40%, avg=116696.00, stdev=60827.50, samples=20 00:23:12.167 iops : min= 232, max= 1246, avg=455.80, stdev=237.57, samples=20 00:23:12.167 lat (msec) : 2=0.11%, 4=1.56%, 10=2.66%, 20=2.64%, 50=12.48% 00:23:12.167 lat (msec) : 100=18.13%, 250=53.44%, 500=8.98% 00:23:12.167 cpu : usr=1.42%, sys=1.50%, ctx=2335, majf=0, minf=1 00:23:12.167 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:23:12.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.167 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.167 issued rwts: total=0,4622,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.167 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.167 job8: (groupid=0, jobs=1): err= 0: pid=1250646: Sat Nov 16 16:58:56 2024 00:23:12.167 write: IOPS=679, BW=170MiB/s (178MB/s)(1715MiB/10104msec); 0 zone resets 00:23:12.167 slat (usec): min=13, max=87694, avg=1012.16, stdev=3540.94 00:23:12.167 clat (usec): min=850, max=325092, avg=93164.56, stdev=76202.82 00:23:12.167 lat (usec): min=873, max=336392, avg=94176.71, stdev=77099.11 00:23:12.167 clat percentiles (msec): 00:23:12.167 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 21], 20.00th=[ 36], 00:23:12.167 | 30.00th=[ 44], 40.00th=[ 47], 50.00th=[ 71], 60.00th=[ 81], 00:23:12.167 | 70.00th=[ 112], 80.00th=[ 148], 90.00th=[ 218], 95.00th=[ 268], 00:23:12.167 | 99.00th=[ 300], 99.50th=[ 309], 99.90th=[ 317], 99.95th=[ 326], 00:23:12.167 | 99.99th=[ 326] 00:23:12.167 bw ( KiB/s): min=53248, max=373760, per=12.52%, avg=174021.60, stdev=97361.44, samples=20 00:23:12.167 iops : min= 208, max= 1460, avg=679.70, stdev=380.35, samples=20 00:23:12.167 lat (usec) : 1000=0.07% 00:23:12.167 lat (msec) : 2=0.38%, 4=0.76%, 10=3.18%, 20=5.55%, 50=32.44% 00:23:12.167 lat (msec) : 100=23.80%, 250=27.14%, 500=6.68% 00:23:12.167 cpu : usr=2.03%, sys=2.23%, ctx=3777, majf=0, minf=1 00:23:12.167 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:12.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.167 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.167 issued rwts: total=0,6861,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.167 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.167 job9: (groupid=0, jobs=1): err= 0: pid=1250647: Sat Nov 16 16:58:56 2024 00:23:12.167 write: IOPS=424, BW=106MiB/s (111MB/s)(1076MiB/10145msec); 0 zone resets 00:23:12.167 slat (usec): min=16, max=133950, avg=1509.51, stdev=4985.75 00:23:12.167 clat (msec): min=2, max=408, avg=149.34, stdev=91.37 00:23:12.167 lat (msec): min=2, max=408, avg=150.85, stdev=92.52 00:23:12.167 clat percentiles (msec): 00:23:12.167 | 1.00th=[ 5], 5.00th=[ 11], 10.00th=[ 25], 20.00th=[ 56], 00:23:12.167 | 30.00th=[ 95], 40.00th=[ 125], 50.00th=[ 146], 60.00th=[ 169], 00:23:12.167 | 70.00th=[ 207], 80.00th=[ 232], 90.00th=[ 264], 95.00th=[ 305], 00:23:12.167 | 99.00th=[ 393], 99.50th=[ 397], 99.90th=[ 405], 99.95th=[ 409], 00:23:12.167 | 99.99th=[ 409] 00:23:12.167 bw ( KiB/s): min=45056, max=207872, per=7.81%, avg=108509.35, stdev=49050.92, samples=20 00:23:12.167 iops : min= 176, max= 812, avg=423.80, stdev=191.56, samples=20 00:23:12.167 lat (msec) : 4=0.74%, 10=3.81%, 20=4.00%, 50=10.13%, 100=12.90% 00:23:12.167 lat (msec) : 250=54.95%, 500=13.46% 00:23:12.167 cpu : usr=1.30%, sys=1.61%, ctx=2606, majf=0, minf=1 00:23:12.167 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:23:12.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.167 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.167 issued rwts: total=0,4302,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.167 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.167 job10: (groupid=0, jobs=1): err= 0: pid=1250648: Sat Nov 16 16:58:56 2024 00:23:12.167 write: IOPS=456, BW=114MiB/s (120MB/s)(1157MiB/10143msec); 0 zone resets 00:23:12.167 slat (usec): min=16, max=82713, avg=1562.72, stdev=4613.70 00:23:12.167 clat (usec): min=1415, max=341308, avg=138696.68, stdev=79881.20 00:23:12.167 lat (usec): min=1519, max=341346, avg=140259.40, stdev=81013.58 00:23:12.167 clat percentiles (msec): 00:23:12.167 | 1.00th=[ 5], 5.00th=[ 14], 10.00th=[ 26], 20.00th=[ 58], 00:23:12.167 | 30.00th=[ 100], 40.00th=[ 124], 50.00th=[ 140], 60.00th=[ 153], 00:23:12.167 | 70.00th=[ 174], 80.00th=[ 211], 90.00th=[ 251], 95.00th=[ 275], 00:23:12.167 | 99.00th=[ 326], 99.50th=[ 334], 99.90th=[ 338], 99.95th=[ 342], 00:23:12.167 | 99.99th=[ 342] 00:23:12.167 bw ( KiB/s): min=56320, max=179712, per=8.41%, avg=116812.80, stdev=36450.46, samples=20 00:23:12.167 iops : min= 220, max= 702, avg=456.30, stdev=142.38, samples=20 00:23:12.167 lat (msec) : 2=0.09%, 4=0.82%, 10=2.36%, 20=5.02%, 50=10.05% 00:23:12.167 lat (msec) : 100=11.93%, 250=59.49%, 500=10.25% 00:23:12.167 cpu : usr=1.51%, sys=1.68%, ctx=2680, majf=0, minf=1 00:23:12.167 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:23:12.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.167 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.167 issued rwts: total=0,4626,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.167 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.167 00:23:12.167 Run status group 0 (all jobs): 00:23:12.167 WRITE: bw=1357MiB/s (1423MB/s), 86.8MiB/s-170MiB/s (91.0MB/s-178MB/s), io=13.4GiB (14.4GB), run=10037-10147msec 00:23:12.167 00:23:12.167 Disk stats (read/write): 00:23:12.167 nvme0n1: ios=45/9525, merge=0/0, ticks=1410/1222919, in_queue=1224329, util=99.95% 00:23:12.168 nvme10n1: ios=39/12157, merge=0/0, ticks=29/1224967, in_queue=1224996, util=97.53% 00:23:12.168 nvme1n1: ios=44/8555, merge=0/0, ticks=1760/1207696, in_queue=1209456, util=100.00% 00:23:12.168 nvme2n1: ios=47/6851, merge=0/0, ticks=1407/1212498, in_queue=1213905, util=100.00% 00:23:12.168 nvme3n1: ios=52/8456, merge=0/0, ticks=934/1202974, in_queue=1203908, util=100.00% 00:23:12.168 nvme4n1: ios=46/9914, merge=0/0, ticks=979/1211221, in_queue=1212200, util=100.00% 00:23:12.168 nvme5n1: ios=40/12428, merge=0/0, ticks=1560/1216383, in_queue=1217943, util=100.00% 00:23:12.168 nvme6n1: ios=46/9074, merge=0/0, ticks=154/1219258, in_queue=1219412, util=99.50% 00:23:12.168 nvme7n1: ios=42/13562, merge=0/0, ticks=2251/1219450, in_queue=1221701, util=100.00% 00:23:12.168 nvme8n1: ios=37/8395, merge=0/0, ticks=39/1220622, in_queue=1220661, util=99.13% 00:23:12.168 nvme9n1: ios=0/9082, merge=0/0, ticks=0/1219484, in_queue=1219484, util=99.07% 00:23:12.168 16:58:56 -- target/multiconnection.sh@36 -- # sync 00:23:12.168 16:58:56 -- target/multiconnection.sh@37 -- # seq 1 11 00:23:12.168 16:58:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.168 16:58:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:12.168 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:12.168 16:58:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:23:12.168 16:58:57 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.168 16:58:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.168 16:58:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:23:12.168 16:58:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.168 16:58:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:23:12.168 16:58:57 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.168 16:58:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:12.168 16:58:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.168 16:58:57 -- common/autotest_common.sh@10 -- # set +x 00:23:12.168 16:58:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.168 16:58:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.168 16:58:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:23:12.168 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:23:12.168 16:58:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:23:12.168 16:58:57 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.168 16:58:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.168 16:58:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:23:12.168 16:58:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.168 16:58:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:23:12.168 16:58:57 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.168 16:58:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:12.168 16:58:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.168 16:58:57 -- common/autotest_common.sh@10 -- # set +x 00:23:12.168 16:58:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.168 16:58:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.168 16:58:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:23:12.168 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:23:12.168 16:58:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:23:12.168 16:58:57 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.168 16:58:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.168 16:58:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:23:12.168 16:58:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.168 16:58:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:23:12.168 16:58:57 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.168 16:58:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:23:12.168 16:58:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.168 16:58:57 -- common/autotest_common.sh@10 -- # set +x 00:23:12.168 16:58:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.168 16:58:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.168 16:58:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:23:12.168 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:23:12.168 16:58:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:23:12.168 16:58:57 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.168 16:58:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.168 16:58:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:23:12.168 16:58:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.168 16:58:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:23:12.168 16:58:57 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.168 16:58:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:23:12.168 16:58:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.168 16:58:57 -- common/autotest_common.sh@10 -- # set +x 00:23:12.168 16:58:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.168 16:58:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.168 16:58:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:23:12.426 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:23:12.426 16:58:58 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:23:12.426 16:58:58 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.426 16:58:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.426 16:58:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:23:12.426 16:58:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.426 16:58:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:23:12.426 16:58:58 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.426 16:58:58 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:23:12.426 16:58:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.426 16:58:58 -- common/autotest_common.sh@10 -- # set +x 00:23:12.426 16:58:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.426 16:58:58 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.427 16:58:58 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:23:12.685 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:23:12.685 16:58:58 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:23:12.685 16:58:58 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.685 16:58:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.685 16:58:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:23:12.685 16:58:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.685 16:58:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:23:12.685 16:58:58 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.685 16:58:58 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:23:12.685 16:58:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.685 16:58:58 -- common/autotest_common.sh@10 -- # set +x 00:23:12.685 16:58:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.685 16:58:58 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.685 16:58:58 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:23:12.943 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:23:12.943 16:58:58 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:23:12.943 16:58:58 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.943 16:58:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.943 16:58:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:23:12.943 16:58:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.943 16:58:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:23:12.943 16:58:58 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.943 16:58:58 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:23:12.943 16:58:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.943 16:58:58 -- common/autotest_common.sh@10 -- # set +x 00:23:12.943 16:58:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.943 16:58:58 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.943 16:58:58 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:23:12.943 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:23:12.943 16:58:58 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:23:12.943 16:58:58 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.943 16:58:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.943 16:58:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:23:12.943 16:58:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.943 16:58:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:23:12.943 16:58:58 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.943 16:58:58 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:23:12.943 16:58:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.943 16:58:58 -- common/autotest_common.sh@10 -- # set +x 00:23:12.943 16:58:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.943 16:58:58 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.943 16:58:58 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:23:13.201 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:23:13.201 16:58:58 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:23:13.201 16:58:58 -- common/autotest_common.sh@1208 -- # local i=0 00:23:13.201 16:58:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:13.201 16:58:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:23:13.201 16:58:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:13.201 16:58:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:23:13.201 16:58:58 -- common/autotest_common.sh@1220 -- # return 0 00:23:13.201 16:58:58 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:23:13.201 16:58:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.201 16:58:58 -- common/autotest_common.sh@10 -- # set +x 00:23:13.201 16:58:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.201 16:58:58 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:13.201 16:58:58 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:23:13.201 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:23:13.201 16:58:58 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:23:13.201 16:58:58 -- common/autotest_common.sh@1208 -- # local i=0 00:23:13.201 16:58:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:13.201 16:58:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:23:13.201 16:58:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:13.201 16:58:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:23:13.201 16:58:58 -- common/autotest_common.sh@1220 -- # return 0 00:23:13.201 16:58:58 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:23:13.201 16:58:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.201 16:58:58 -- common/autotest_common.sh@10 -- # set +x 00:23:13.201 16:58:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.201 16:58:58 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:13.201 16:58:58 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:23:13.459 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:23:13.459 16:58:58 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:23:13.459 16:58:58 -- common/autotest_common.sh@1208 -- # local i=0 00:23:13.459 16:58:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:13.459 16:58:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:23:13.459 16:58:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:13.459 16:58:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:23:13.459 16:58:58 -- common/autotest_common.sh@1220 -- # return 0 00:23:13.459 16:58:58 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:23:13.459 16:58:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.459 16:58:58 -- common/autotest_common.sh@10 -- # set +x 00:23:13.459 16:58:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.459 16:58:58 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:23:13.459 16:58:58 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:23:13.459 16:58:58 -- target/multiconnection.sh@47 -- # nvmftestfini 00:23:13.459 16:58:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:13.459 16:58:58 -- nvmf/common.sh@116 -- # sync 00:23:13.459 16:58:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:13.459 16:58:59 -- nvmf/common.sh@119 -- # set +e 00:23:13.459 16:58:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:13.459 16:58:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:13.459 rmmod nvme_tcp 00:23:13.459 rmmod nvme_fabrics 00:23:13.459 rmmod nvme_keyring 00:23:13.459 16:58:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:13.459 16:58:59 -- nvmf/common.sh@123 -- # set -e 00:23:13.459 16:58:59 -- nvmf/common.sh@124 -- # return 0 00:23:13.459 16:58:59 -- nvmf/common.sh@477 -- # '[' -n 1244900 ']' 00:23:13.459 16:58:59 -- nvmf/common.sh@478 -- # killprocess 1244900 00:23:13.459 16:58:59 -- common/autotest_common.sh@936 -- # '[' -z 1244900 ']' 00:23:13.459 16:58:59 -- common/autotest_common.sh@940 -- # kill -0 1244900 00:23:13.459 16:58:59 -- common/autotest_common.sh@941 -- # uname 00:23:13.459 16:58:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:13.459 16:58:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1244900 00:23:13.459 16:58:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:13.459 16:58:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:13.459 16:58:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1244900' 00:23:13.459 killing process with pid 1244900 00:23:13.459 16:58:59 -- common/autotest_common.sh@955 -- # kill 1244900 00:23:13.459 16:58:59 -- common/autotest_common.sh@960 -- # wait 1244900 00:23:14.026 16:58:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:14.026 16:58:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:14.026 16:58:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:14.026 16:58:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:14.026 16:58:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:14.026 16:58:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:14.027 16:58:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:14.027 16:58:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:16.562 16:59:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:16.562 00:23:16.562 real 1m0.879s 00:23:16.562 user 3m25.592s 00:23:16.562 sys 0m24.961s 00:23:16.562 16:59:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:16.562 16:59:01 -- common/autotest_common.sh@10 -- # set +x 00:23:16.562 ************************************ 00:23:16.562 END TEST nvmf_multiconnection 00:23:16.562 ************************************ 00:23:16.562 16:59:01 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:16.562 16:59:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:16.562 16:59:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:16.562 16:59:01 -- common/autotest_common.sh@10 -- # set +x 00:23:16.562 ************************************ 00:23:16.562 START TEST nvmf_initiator_timeout 00:23:16.562 ************************************ 00:23:16.562 16:59:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:16.562 * Looking for test storage... 00:23:16.562 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:16.562 16:59:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:16.562 16:59:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:16.562 16:59:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:16.562 16:59:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:16.562 16:59:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:16.562 16:59:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:16.562 16:59:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:16.562 16:59:01 -- scripts/common.sh@335 -- # IFS=.-: 00:23:16.562 16:59:01 -- scripts/common.sh@335 -- # read -ra ver1 00:23:16.562 16:59:01 -- scripts/common.sh@336 -- # IFS=.-: 00:23:16.562 16:59:01 -- scripts/common.sh@336 -- # read -ra ver2 00:23:16.562 16:59:01 -- scripts/common.sh@337 -- # local 'op=<' 00:23:16.562 16:59:01 -- scripts/common.sh@339 -- # ver1_l=2 00:23:16.562 16:59:01 -- scripts/common.sh@340 -- # ver2_l=1 00:23:16.562 16:59:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:16.562 16:59:01 -- scripts/common.sh@343 -- # case "$op" in 00:23:16.562 16:59:01 -- scripts/common.sh@344 -- # : 1 00:23:16.562 16:59:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:16.562 16:59:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:16.562 16:59:01 -- scripts/common.sh@364 -- # decimal 1 00:23:16.562 16:59:01 -- scripts/common.sh@352 -- # local d=1 00:23:16.562 16:59:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:16.562 16:59:01 -- scripts/common.sh@354 -- # echo 1 00:23:16.562 16:59:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:16.562 16:59:01 -- scripts/common.sh@365 -- # decimal 2 00:23:16.562 16:59:01 -- scripts/common.sh@352 -- # local d=2 00:23:16.562 16:59:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:16.562 16:59:01 -- scripts/common.sh@354 -- # echo 2 00:23:16.562 16:59:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:16.562 16:59:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:16.562 16:59:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:16.562 16:59:01 -- scripts/common.sh@367 -- # return 0 00:23:16.562 16:59:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:16.562 16:59:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:16.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:16.562 --rc genhtml_branch_coverage=1 00:23:16.562 --rc genhtml_function_coverage=1 00:23:16.562 --rc genhtml_legend=1 00:23:16.562 --rc geninfo_all_blocks=1 00:23:16.562 --rc geninfo_unexecuted_blocks=1 00:23:16.562 00:23:16.562 ' 00:23:16.562 16:59:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:16.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:16.562 --rc genhtml_branch_coverage=1 00:23:16.562 --rc genhtml_function_coverage=1 00:23:16.562 --rc genhtml_legend=1 00:23:16.562 --rc geninfo_all_blocks=1 00:23:16.562 --rc geninfo_unexecuted_blocks=1 00:23:16.562 00:23:16.562 ' 00:23:16.562 16:59:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:16.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:16.562 --rc genhtml_branch_coverage=1 00:23:16.562 --rc genhtml_function_coverage=1 00:23:16.562 --rc genhtml_legend=1 00:23:16.562 --rc geninfo_all_blocks=1 00:23:16.562 --rc geninfo_unexecuted_blocks=1 00:23:16.562 00:23:16.562 ' 00:23:16.562 16:59:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:16.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:16.562 --rc genhtml_branch_coverage=1 00:23:16.562 --rc genhtml_function_coverage=1 00:23:16.562 --rc genhtml_legend=1 00:23:16.562 --rc geninfo_all_blocks=1 00:23:16.562 --rc geninfo_unexecuted_blocks=1 00:23:16.562 00:23:16.562 ' 00:23:16.562 16:59:01 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:16.562 16:59:01 -- nvmf/common.sh@7 -- # uname -s 00:23:16.562 16:59:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:16.562 16:59:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:16.562 16:59:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:16.562 16:59:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:16.562 16:59:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:16.562 16:59:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:16.562 16:59:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:16.562 16:59:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:16.562 16:59:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:16.562 16:59:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:16.562 16:59:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:16.562 16:59:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:16.562 16:59:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:16.562 16:59:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:16.562 16:59:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:16.562 16:59:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:16.562 16:59:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:16.562 16:59:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:16.562 16:59:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:16.562 16:59:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:16.562 16:59:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:16.562 16:59:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:16.562 16:59:01 -- paths/export.sh@5 -- # export PATH 00:23:16.562 16:59:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:16.562 16:59:01 -- nvmf/common.sh@46 -- # : 0 00:23:16.562 16:59:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:16.562 16:59:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:16.562 16:59:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:16.562 16:59:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:16.562 16:59:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:16.562 16:59:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:16.562 16:59:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:16.562 16:59:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:16.562 16:59:01 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:16.562 16:59:01 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:16.562 16:59:01 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:23:16.562 16:59:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:16.562 16:59:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:16.562 16:59:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:16.562 16:59:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:16.562 16:59:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:16.562 16:59:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:16.562 16:59:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:16.562 16:59:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:16.562 16:59:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:16.562 16:59:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:16.562 16:59:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:16.562 16:59:01 -- common/autotest_common.sh@10 -- # set +x 00:23:18.470 16:59:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:18.470 16:59:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:18.470 16:59:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:18.470 16:59:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:18.470 16:59:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:18.470 16:59:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:18.470 16:59:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:18.470 16:59:03 -- nvmf/common.sh@294 -- # net_devs=() 00:23:18.470 16:59:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:18.470 16:59:03 -- nvmf/common.sh@295 -- # e810=() 00:23:18.470 16:59:03 -- nvmf/common.sh@295 -- # local -ga e810 00:23:18.470 16:59:03 -- nvmf/common.sh@296 -- # x722=() 00:23:18.470 16:59:03 -- nvmf/common.sh@296 -- # local -ga x722 00:23:18.470 16:59:03 -- nvmf/common.sh@297 -- # mlx=() 00:23:18.470 16:59:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:18.470 16:59:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:18.470 16:59:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:18.470 16:59:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:18.470 16:59:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:18.470 16:59:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:18.470 16:59:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:18.470 16:59:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:18.470 16:59:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:18.470 16:59:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:18.470 16:59:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:18.470 16:59:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:18.470 16:59:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:18.470 16:59:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:18.470 16:59:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:18.470 16:59:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:18.470 16:59:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:18.470 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:18.470 16:59:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:18.470 16:59:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:18.470 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:18.470 16:59:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:18.470 16:59:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:18.470 16:59:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:18.470 16:59:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:18.470 16:59:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:18.470 16:59:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:18.470 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:18.470 16:59:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:18.470 16:59:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:18.470 16:59:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:18.470 16:59:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:18.470 16:59:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:18.470 16:59:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:18.470 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:18.470 16:59:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:18.470 16:59:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:18.470 16:59:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:18.470 16:59:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:18.470 16:59:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:18.470 16:59:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:18.470 16:59:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:18.470 16:59:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:18.470 16:59:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:18.470 16:59:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:18.470 16:59:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:18.470 16:59:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:18.470 16:59:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:18.470 16:59:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:18.470 16:59:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:18.470 16:59:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:18.470 16:59:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:18.470 16:59:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:18.470 16:59:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:18.470 16:59:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:18.470 16:59:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:18.470 16:59:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:18.470 16:59:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:18.470 16:59:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:18.470 16:59:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:18.470 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:18.470 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.211 ms 00:23:18.470 00:23:18.470 --- 10.0.0.2 ping statistics --- 00:23:18.470 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:18.470 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:23:18.470 16:59:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:18.470 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:18.470 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:23:18.470 00:23:18.470 --- 10.0.0.1 ping statistics --- 00:23:18.470 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:18.470 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:23:18.470 16:59:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:18.470 16:59:04 -- nvmf/common.sh@410 -- # return 0 00:23:18.471 16:59:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:18.471 16:59:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:18.471 16:59:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:18.471 16:59:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:18.471 16:59:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:18.471 16:59:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:18.471 16:59:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:18.471 16:59:04 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:23:18.471 16:59:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:18.471 16:59:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:18.471 16:59:04 -- common/autotest_common.sh@10 -- # set +x 00:23:18.471 16:59:04 -- nvmf/common.sh@469 -- # nvmfpid=1254018 00:23:18.471 16:59:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:18.471 16:59:04 -- nvmf/common.sh@470 -- # waitforlisten 1254018 00:23:18.471 16:59:04 -- common/autotest_common.sh@829 -- # '[' -z 1254018 ']' 00:23:18.471 16:59:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:18.471 16:59:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:18.471 16:59:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:18.471 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:18.471 16:59:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:18.471 16:59:04 -- common/autotest_common.sh@10 -- # set +x 00:23:18.471 [2024-11-16 16:59:04.121480] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:23:18.471 [2024-11-16 16:59:04.121547] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:18.471 EAL: No free 2048 kB hugepages reported on node 1 00:23:18.471 [2024-11-16 16:59:04.190089] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:18.731 [2024-11-16 16:59:04.289154] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:18.731 [2024-11-16 16:59:04.289327] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:18.731 [2024-11-16 16:59:04.289348] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:18.731 [2024-11-16 16:59:04.289362] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:18.731 [2024-11-16 16:59:04.289426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:18.731 [2024-11-16 16:59:04.289461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:18.731 [2024-11-16 16:59:04.289514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:18.731 [2024-11-16 16:59:04.289517] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:19.670 16:59:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:19.670 16:59:05 -- common/autotest_common.sh@862 -- # return 0 00:23:19.670 16:59:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:19.670 16:59:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:19.670 16:59:05 -- common/autotest_common.sh@10 -- # set +x 00:23:19.670 16:59:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:19.670 16:59:05 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:23:19.670 16:59:05 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:19.670 16:59:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.670 16:59:05 -- common/autotest_common.sh@10 -- # set +x 00:23:19.670 Malloc0 00:23:19.670 16:59:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.670 16:59:05 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:23:19.670 16:59:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.670 16:59:05 -- common/autotest_common.sh@10 -- # set +x 00:23:19.670 Delay0 00:23:19.670 16:59:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.670 16:59:05 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:19.670 16:59:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.670 16:59:05 -- common/autotest_common.sh@10 -- # set +x 00:23:19.670 [2024-11-16 16:59:05.175032] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:19.670 16:59:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.670 16:59:05 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:23:19.670 16:59:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.670 16:59:05 -- common/autotest_common.sh@10 -- # set +x 00:23:19.670 16:59:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.670 16:59:05 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:23:19.670 16:59:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.670 16:59:05 -- common/autotest_common.sh@10 -- # set +x 00:23:19.670 16:59:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.670 16:59:05 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:19.670 16:59:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.670 16:59:05 -- common/autotest_common.sh@10 -- # set +x 00:23:19.670 [2024-11-16 16:59:05.203268] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:19.670 16:59:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.670 16:59:05 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:20.237 16:59:05 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:23:20.237 16:59:05 -- common/autotest_common.sh@1187 -- # local i=0 00:23:20.237 16:59:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:20.237 16:59:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:20.237 16:59:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:22.144 16:59:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:22.403 16:59:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:22.403 16:59:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:23:22.403 16:59:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:22.403 16:59:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:22.403 16:59:07 -- common/autotest_common.sh@1197 -- # return 0 00:23:22.403 16:59:07 -- target/initiator_timeout.sh@35 -- # fio_pid=1254466 00:23:22.403 16:59:07 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:22.403 16:59:07 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:22.403 [global] 00:23:22.403 thread=1 00:23:22.403 invalidate=1 00:23:22.403 rw=write 00:23:22.403 time_based=1 00:23:22.404 runtime=60 00:23:22.404 ioengine=libaio 00:23:22.404 direct=1 00:23:22.404 bs=4096 00:23:22.404 iodepth=1 00:23:22.404 norandommap=0 00:23:22.404 numjobs=1 00:23:22.404 00:23:22.404 verify_dump=1 00:23:22.404 verify_backlog=512 00:23:22.404 verify_state_save=0 00:23:22.404 do_verify=1 00:23:22.404 verify=crc32c-intel 00:23:22.404 [job0] 00:23:22.404 filename=/dev/nvme0n1 00:23:22.404 Could not set queue depth (nvme0n1) 00:23:22.404 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:22.404 fio-3.35 00:23:22.404 Starting 1 thread 00:23:25.694 16:59:10 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:25.694 16:59:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.694 16:59:10 -- common/autotest_common.sh@10 -- # set +x 00:23:25.694 true 00:23:25.694 16:59:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.694 16:59:10 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:25.694 16:59:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.694 16:59:10 -- common/autotest_common.sh@10 -- # set +x 00:23:25.694 true 00:23:25.694 16:59:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.694 16:59:10 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:25.694 16:59:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.694 16:59:10 -- common/autotest_common.sh@10 -- # set +x 00:23:25.694 true 00:23:25.694 16:59:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.694 16:59:10 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:25.694 16:59:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.694 16:59:10 -- common/autotest_common.sh@10 -- # set +x 00:23:25.694 true 00:23:25.694 16:59:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.694 16:59:10 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:28.228 16:59:13 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:28.228 16:59:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.228 16:59:13 -- common/autotest_common.sh@10 -- # set +x 00:23:28.228 true 00:23:28.228 16:59:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.228 16:59:13 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:28.228 16:59:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.228 16:59:13 -- common/autotest_common.sh@10 -- # set +x 00:23:28.228 true 00:23:28.228 16:59:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.228 16:59:13 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:28.228 16:59:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.228 16:59:13 -- common/autotest_common.sh@10 -- # set +x 00:23:28.228 true 00:23:28.228 16:59:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.228 16:59:13 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:28.228 16:59:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.228 16:59:13 -- common/autotest_common.sh@10 -- # set +x 00:23:28.486 true 00:23:28.486 16:59:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.486 16:59:13 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:28.486 16:59:13 -- target/initiator_timeout.sh@54 -- # wait 1254466 00:24:24.730 00:24:24.730 job0: (groupid=0, jobs=1): err= 0: pid=1254535: Sat Nov 16 17:00:08 2024 00:24:24.730 read: IOPS=37, BW=148KiB/s (152kB/s)(8892KiB/60028msec) 00:24:24.730 slat (nsec): min=3845, max=49337, avg=9816.07, stdev=8108.69 00:24:24.730 clat (usec): min=196, max=41167k, avg=26775.53, stdev=873099.94 00:24:24.730 lat (usec): min=201, max=41167k, avg=26785.35, stdev=873100.23 00:24:24.730 clat percentiles (usec): 00:24:24.730 | 1.00th=[ 204], 5.00th=[ 210], 10.00th=[ 215], 00:24:24.730 | 20.00th=[ 219], 30.00th=[ 223], 40.00th=[ 227], 00:24:24.730 | 50.00th=[ 231], 60.00th=[ 237], 70.00th=[ 247], 00:24:24.730 | 80.00th=[ 375], 90.00th=[ 41157], 95.00th=[ 41157], 00:24:24.730 | 99.00th=[ 41157], 99.50th=[ 41157], 99.90th=[ 41157], 00:24:24.730 | 99.95th=[ 42206], 99.99th=[17112761] 00:24:24.730 write: IOPS=42, BW=171KiB/s (175kB/s)(10.0MiB/60028msec); 0 zone resets 00:24:24.730 slat (nsec): min=5115, max=33462, avg=7957.07, stdev=3369.45 00:24:24.730 clat (usec): min=154, max=323, avg=176.27, stdev=11.47 00:24:24.730 lat (usec): min=159, max=353, avg=184.22, stdev=12.82 00:24:24.730 clat percentiles (usec): 00:24:24.730 | 1.00th=[ 159], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 167], 00:24:24.730 | 30.00th=[ 169], 40.00th=[ 172], 50.00th=[ 176], 60.00th=[ 178], 00:24:24.730 | 70.00th=[ 182], 80.00th=[ 186], 90.00th=[ 192], 95.00th=[ 196], 00:24:24.730 | 99.00th=[ 206], 99.50th=[ 212], 99.90th=[ 249], 99.95th=[ 318], 00:24:24.730 | 99.99th=[ 322] 00:24:24.730 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=5120.00, stdev=2048.00, samples=4 00:24:24.730 iops : min= 1024, max= 2048, avg=1280.00, stdev=512.00, samples=4 00:24:24.730 lat (usec) : 250=86.56%, 500=4.27% 00:24:24.730 lat (msec) : 50=9.16%, >=2000=0.02% 00:24:24.730 cpu : usr=0.05%, sys=0.06%, ctx=4783, majf=0, minf=1 00:24:24.730 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:24.730 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:24.730 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:24.730 issued rwts: total=2223,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:24.730 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:24.730 00:24:24.730 Run status group 0 (all jobs): 00:24:24.730 READ: bw=148KiB/s (152kB/s), 148KiB/s-148KiB/s (152kB/s-152kB/s), io=8892KiB (9105kB), run=60028-60028msec 00:24:24.730 WRITE: bw=171KiB/s (175kB/s), 171KiB/s-171KiB/s (175kB/s-175kB/s), io=10.0MiB (10.5MB), run=60028-60028msec 00:24:24.730 00:24:24.730 Disk stats (read/write): 00:24:24.730 nvme0n1: ios=2318/2560, merge=0/0, ticks=18257/445, in_queue=18702, util=99.53% 00:24:24.730 17:00:08 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:24.730 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:24.730 17:00:08 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:24.730 17:00:08 -- common/autotest_common.sh@1208 -- # local i=0 00:24:24.730 17:00:08 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:24.730 17:00:08 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:24.730 17:00:08 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:24.730 17:00:08 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:24.730 17:00:08 -- common/autotest_common.sh@1220 -- # return 0 00:24:24.730 17:00:08 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:24.730 17:00:08 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:24.730 nvmf hotplug test: fio successful as expected 00:24:24.730 17:00:08 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:24.730 17:00:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:24.730 17:00:08 -- common/autotest_common.sh@10 -- # set +x 00:24:24.730 17:00:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:24.730 17:00:08 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:24.730 17:00:08 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:24.730 17:00:08 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:24.730 17:00:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:24.730 17:00:08 -- nvmf/common.sh@116 -- # sync 00:24:24.730 17:00:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:24.730 17:00:08 -- nvmf/common.sh@119 -- # set +e 00:24:24.730 17:00:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:24.731 17:00:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:24.731 rmmod nvme_tcp 00:24:24.731 rmmod nvme_fabrics 00:24:24.731 rmmod nvme_keyring 00:24:24.731 17:00:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:24.731 17:00:08 -- nvmf/common.sh@123 -- # set -e 00:24:24.731 17:00:08 -- nvmf/common.sh@124 -- # return 0 00:24:24.731 17:00:08 -- nvmf/common.sh@477 -- # '[' -n 1254018 ']' 00:24:24.731 17:00:08 -- nvmf/common.sh@478 -- # killprocess 1254018 00:24:24.731 17:00:08 -- common/autotest_common.sh@936 -- # '[' -z 1254018 ']' 00:24:24.731 17:00:08 -- common/autotest_common.sh@940 -- # kill -0 1254018 00:24:24.731 17:00:08 -- common/autotest_common.sh@941 -- # uname 00:24:24.731 17:00:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:24.731 17:00:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1254018 00:24:24.731 17:00:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:24.731 17:00:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:24.731 17:00:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1254018' 00:24:24.731 killing process with pid 1254018 00:24:24.731 17:00:08 -- common/autotest_common.sh@955 -- # kill 1254018 00:24:24.731 17:00:08 -- common/autotest_common.sh@960 -- # wait 1254018 00:24:24.731 17:00:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:24.731 17:00:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:24.731 17:00:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:24.731 17:00:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:24.731 17:00:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:24.731 17:00:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:24.731 17:00:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:24.731 17:00:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:25.301 17:00:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:25.301 00:24:25.301 real 1m9.128s 00:24:25.301 user 4m14.230s 00:24:25.301 sys 0m6.761s 00:24:25.301 17:00:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:25.301 17:00:10 -- common/autotest_common.sh@10 -- # set +x 00:24:25.301 ************************************ 00:24:25.301 END TEST nvmf_initiator_timeout 00:24:25.301 ************************************ 00:24:25.301 17:00:10 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:25.301 17:00:10 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:25.301 17:00:10 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:25.301 17:00:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:25.301 17:00:10 -- common/autotest_common.sh@10 -- # set +x 00:24:27.210 17:00:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:27.210 17:00:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:27.210 17:00:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:27.210 17:00:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:27.210 17:00:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:27.210 17:00:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:27.210 17:00:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:27.210 17:00:12 -- nvmf/common.sh@294 -- # net_devs=() 00:24:27.210 17:00:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:27.210 17:00:12 -- nvmf/common.sh@295 -- # e810=() 00:24:27.210 17:00:12 -- nvmf/common.sh@295 -- # local -ga e810 00:24:27.210 17:00:12 -- nvmf/common.sh@296 -- # x722=() 00:24:27.210 17:00:12 -- nvmf/common.sh@296 -- # local -ga x722 00:24:27.210 17:00:12 -- nvmf/common.sh@297 -- # mlx=() 00:24:27.210 17:00:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:27.210 17:00:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:27.210 17:00:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:27.210 17:00:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:27.210 17:00:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:27.210 17:00:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:27.210 17:00:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:27.210 17:00:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:27.210 17:00:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:27.210 17:00:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:27.210 17:00:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:27.210 17:00:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:27.210 17:00:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:27.210 17:00:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:27.210 17:00:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:27.210 17:00:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:27.210 17:00:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:27.210 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:27.210 17:00:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:27.210 17:00:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:27.210 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:27.210 17:00:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:27.210 17:00:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:27.210 17:00:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:27.210 17:00:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:27.210 17:00:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:27.210 17:00:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:27.210 17:00:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:27.210 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:27.210 17:00:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:27.210 17:00:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:27.210 17:00:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:27.210 17:00:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:27.210 17:00:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:27.210 17:00:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:27.210 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:27.211 17:00:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:27.211 17:00:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:27.211 17:00:12 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:27.211 17:00:12 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:27.211 17:00:12 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:27.211 17:00:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:27.211 17:00:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:27.211 17:00:12 -- common/autotest_common.sh@10 -- # set +x 00:24:27.211 ************************************ 00:24:27.211 START TEST nvmf_perf_adq 00:24:27.211 ************************************ 00:24:27.211 17:00:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:27.211 * Looking for test storage... 00:24:27.211 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:27.211 17:00:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:27.211 17:00:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:27.211 17:00:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:27.211 17:00:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:27.211 17:00:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:27.211 17:00:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:27.211 17:00:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:27.211 17:00:12 -- scripts/common.sh@335 -- # IFS=.-: 00:24:27.211 17:00:12 -- scripts/common.sh@335 -- # read -ra ver1 00:24:27.211 17:00:12 -- scripts/common.sh@336 -- # IFS=.-: 00:24:27.211 17:00:12 -- scripts/common.sh@336 -- # read -ra ver2 00:24:27.211 17:00:12 -- scripts/common.sh@337 -- # local 'op=<' 00:24:27.211 17:00:12 -- scripts/common.sh@339 -- # ver1_l=2 00:24:27.211 17:00:12 -- scripts/common.sh@340 -- # ver2_l=1 00:24:27.211 17:00:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:27.211 17:00:12 -- scripts/common.sh@343 -- # case "$op" in 00:24:27.211 17:00:12 -- scripts/common.sh@344 -- # : 1 00:24:27.211 17:00:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:27.211 17:00:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:27.211 17:00:12 -- scripts/common.sh@364 -- # decimal 1 00:24:27.211 17:00:12 -- scripts/common.sh@352 -- # local d=1 00:24:27.211 17:00:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:27.211 17:00:12 -- scripts/common.sh@354 -- # echo 1 00:24:27.472 17:00:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:27.472 17:00:12 -- scripts/common.sh@365 -- # decimal 2 00:24:27.472 17:00:12 -- scripts/common.sh@352 -- # local d=2 00:24:27.472 17:00:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:27.472 17:00:12 -- scripts/common.sh@354 -- # echo 2 00:24:27.472 17:00:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:27.472 17:00:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:27.472 17:00:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:27.472 17:00:12 -- scripts/common.sh@367 -- # return 0 00:24:27.472 17:00:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:27.472 17:00:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:27.472 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:27.472 --rc genhtml_branch_coverage=1 00:24:27.472 --rc genhtml_function_coverage=1 00:24:27.472 --rc genhtml_legend=1 00:24:27.472 --rc geninfo_all_blocks=1 00:24:27.472 --rc geninfo_unexecuted_blocks=1 00:24:27.472 00:24:27.472 ' 00:24:27.472 17:00:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:27.472 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:27.472 --rc genhtml_branch_coverage=1 00:24:27.472 --rc genhtml_function_coverage=1 00:24:27.472 --rc genhtml_legend=1 00:24:27.472 --rc geninfo_all_blocks=1 00:24:27.472 --rc geninfo_unexecuted_blocks=1 00:24:27.472 00:24:27.472 ' 00:24:27.472 17:00:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:27.472 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:27.472 --rc genhtml_branch_coverage=1 00:24:27.472 --rc genhtml_function_coverage=1 00:24:27.472 --rc genhtml_legend=1 00:24:27.472 --rc geninfo_all_blocks=1 00:24:27.472 --rc geninfo_unexecuted_blocks=1 00:24:27.472 00:24:27.472 ' 00:24:27.472 17:00:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:27.472 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:27.472 --rc genhtml_branch_coverage=1 00:24:27.472 --rc genhtml_function_coverage=1 00:24:27.472 --rc genhtml_legend=1 00:24:27.472 --rc geninfo_all_blocks=1 00:24:27.472 --rc geninfo_unexecuted_blocks=1 00:24:27.472 00:24:27.472 ' 00:24:27.472 17:00:12 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:27.472 17:00:12 -- nvmf/common.sh@7 -- # uname -s 00:24:27.472 17:00:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:27.472 17:00:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:27.472 17:00:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:27.472 17:00:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:27.472 17:00:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:27.472 17:00:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:27.472 17:00:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:27.472 17:00:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:27.472 17:00:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:27.472 17:00:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:27.472 17:00:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:27.472 17:00:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:27.472 17:00:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:27.472 17:00:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:27.472 17:00:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:27.472 17:00:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:27.472 17:00:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:27.472 17:00:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:27.472 17:00:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:27.472 17:00:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.472 17:00:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.472 17:00:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.472 17:00:12 -- paths/export.sh@5 -- # export PATH 00:24:27.472 17:00:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.472 17:00:12 -- nvmf/common.sh@46 -- # : 0 00:24:27.472 17:00:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:27.472 17:00:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:27.472 17:00:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:27.472 17:00:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:27.472 17:00:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:27.472 17:00:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:27.472 17:00:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:27.472 17:00:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:27.472 17:00:12 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:27.472 17:00:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:27.472 17:00:12 -- common/autotest_common.sh@10 -- # set +x 00:24:29.381 17:00:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:29.381 17:00:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:29.381 17:00:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:29.381 17:00:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:29.381 17:00:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:29.381 17:00:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:29.381 17:00:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:29.381 17:00:14 -- nvmf/common.sh@294 -- # net_devs=() 00:24:29.381 17:00:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:29.381 17:00:14 -- nvmf/common.sh@295 -- # e810=() 00:24:29.381 17:00:14 -- nvmf/common.sh@295 -- # local -ga e810 00:24:29.381 17:00:14 -- nvmf/common.sh@296 -- # x722=() 00:24:29.381 17:00:14 -- nvmf/common.sh@296 -- # local -ga x722 00:24:29.381 17:00:14 -- nvmf/common.sh@297 -- # mlx=() 00:24:29.381 17:00:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:29.381 17:00:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:29.381 17:00:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:29.381 17:00:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:29.381 17:00:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:29.381 17:00:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:29.381 17:00:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:29.381 17:00:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:29.381 17:00:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:29.381 17:00:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:29.381 17:00:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:29.381 17:00:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:29.381 17:00:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:29.381 17:00:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:29.381 17:00:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:29.381 17:00:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:29.381 17:00:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:29.381 17:00:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:29.381 17:00:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:29.381 17:00:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:29.381 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:29.381 17:00:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:29.381 17:00:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:29.381 17:00:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:29.381 17:00:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:29.381 17:00:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:29.381 17:00:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:29.381 17:00:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:29.381 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:29.381 17:00:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:29.381 17:00:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:29.382 17:00:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:29.382 17:00:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:29.382 17:00:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:29.382 17:00:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:29.382 17:00:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:29.382 17:00:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:29.382 17:00:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:29.382 17:00:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:29.382 17:00:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:29.382 17:00:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:29.382 17:00:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:29.382 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:29.382 17:00:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:29.382 17:00:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:29.382 17:00:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:29.382 17:00:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:29.382 17:00:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:29.382 17:00:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:29.382 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:29.382 17:00:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:29.382 17:00:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:29.382 17:00:14 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:29.382 17:00:14 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:29.382 17:00:14 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:29.382 17:00:14 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:29.382 17:00:14 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:29.951 17:00:15 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:32.488 17:00:17 -- target/perf_adq.sh@54 -- # sleep 5 00:24:37.786 17:00:22 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:37.786 17:00:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:37.786 17:00:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:37.786 17:00:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:37.786 17:00:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:37.786 17:00:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:37.786 17:00:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:37.786 17:00:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:37.786 17:00:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:37.786 17:00:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:37.786 17:00:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:37.786 17:00:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:37.786 17:00:22 -- common/autotest_common.sh@10 -- # set +x 00:24:37.786 17:00:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:37.786 17:00:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:37.786 17:00:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:37.786 17:00:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:37.786 17:00:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:37.786 17:00:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:37.786 17:00:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:37.786 17:00:22 -- nvmf/common.sh@294 -- # net_devs=() 00:24:37.786 17:00:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:37.786 17:00:22 -- nvmf/common.sh@295 -- # e810=() 00:24:37.786 17:00:22 -- nvmf/common.sh@295 -- # local -ga e810 00:24:37.786 17:00:22 -- nvmf/common.sh@296 -- # x722=() 00:24:37.786 17:00:22 -- nvmf/common.sh@296 -- # local -ga x722 00:24:37.786 17:00:22 -- nvmf/common.sh@297 -- # mlx=() 00:24:37.786 17:00:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:37.786 17:00:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:37.786 17:00:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:37.786 17:00:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:37.786 17:00:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:37.786 17:00:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:37.786 17:00:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:37.786 17:00:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:37.786 17:00:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:37.786 17:00:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:37.786 17:00:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:37.786 17:00:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:37.786 17:00:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:37.786 17:00:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:37.786 17:00:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:37.786 17:00:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:37.787 17:00:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:37.787 17:00:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:37.787 17:00:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:37.787 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:37.787 17:00:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:37.787 17:00:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:37.787 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:37.787 17:00:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:37.787 17:00:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:37.787 17:00:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:37.787 17:00:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:37.787 17:00:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:37.787 17:00:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:37.787 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:37.787 17:00:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:37.787 17:00:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:37.787 17:00:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:37.787 17:00:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:37.787 17:00:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:37.787 17:00:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:37.787 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:37.787 17:00:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:37.787 17:00:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:37.787 17:00:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:37.787 17:00:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:37.787 17:00:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:37.787 17:00:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:37.787 17:00:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:37.787 17:00:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:37.787 17:00:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:37.787 17:00:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:37.787 17:00:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:37.787 17:00:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:37.787 17:00:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:37.787 17:00:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:37.787 17:00:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:37.787 17:00:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:37.787 17:00:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:37.787 17:00:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:37.787 17:00:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:37.787 17:00:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:37.787 17:00:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:37.787 17:00:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:37.787 17:00:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:37.787 17:00:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:37.787 17:00:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:37.787 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:37.787 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.278 ms 00:24:37.787 00:24:37.787 --- 10.0.0.2 ping statistics --- 00:24:37.787 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:37.787 rtt min/avg/max/mdev = 0.278/0.278/0.278/0.000 ms 00:24:37.787 17:00:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:37.787 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:37.787 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:24:37.787 00:24:37.787 --- 10.0.0.1 ping statistics --- 00:24:37.787 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:37.787 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:24:37.787 17:00:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:37.787 17:00:23 -- nvmf/common.sh@410 -- # return 0 00:24:37.787 17:00:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:37.787 17:00:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:37.787 17:00:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:37.787 17:00:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:37.787 17:00:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:37.787 17:00:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:37.787 17:00:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:37.787 17:00:23 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:37.787 17:00:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:37.787 17:00:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:37.787 17:00:23 -- common/autotest_common.sh@10 -- # set +x 00:24:37.787 17:00:23 -- nvmf/common.sh@469 -- # nvmfpid=1267077 00:24:37.787 17:00:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:37.787 17:00:23 -- nvmf/common.sh@470 -- # waitforlisten 1267077 00:24:37.787 17:00:23 -- common/autotest_common.sh@829 -- # '[' -z 1267077 ']' 00:24:37.787 17:00:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:37.787 17:00:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:37.787 17:00:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:37.787 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:37.787 17:00:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:37.787 17:00:23 -- common/autotest_common.sh@10 -- # set +x 00:24:37.787 [2024-11-16 17:00:23.131495] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:37.787 [2024-11-16 17:00:23.131567] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:37.787 EAL: No free 2048 kB hugepages reported on node 1 00:24:37.787 [2024-11-16 17:00:23.215077] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:37.787 [2024-11-16 17:00:23.324082] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:37.787 [2024-11-16 17:00:23.324294] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:37.787 [2024-11-16 17:00:23.324325] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:37.787 [2024-11-16 17:00:23.324359] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:37.787 [2024-11-16 17:00:23.324440] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:37.787 [2024-11-16 17:00:23.324563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:37.787 [2024-11-16 17:00:23.324642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:37.787 [2024-11-16 17:00:23.324667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:37.787 17:00:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:37.787 17:00:23 -- common/autotest_common.sh@862 -- # return 0 00:24:37.787 17:00:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:37.787 17:00:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:37.787 17:00:23 -- common/autotest_common.sh@10 -- # set +x 00:24:37.787 17:00:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:37.787 17:00:23 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:37.787 17:00:23 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:37.787 17:00:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.787 17:00:23 -- common/autotest_common.sh@10 -- # set +x 00:24:37.787 17:00:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.787 17:00:23 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:37.787 17:00:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.787 17:00:23 -- common/autotest_common.sh@10 -- # set +x 00:24:38.072 17:00:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.072 17:00:23 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:38.072 17:00:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.072 17:00:23 -- common/autotest_common.sh@10 -- # set +x 00:24:38.072 [2024-11-16 17:00:23.607327] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:38.072 17:00:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.072 17:00:23 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:38.072 17:00:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.072 17:00:23 -- common/autotest_common.sh@10 -- # set +x 00:24:38.072 Malloc1 00:24:38.072 17:00:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.072 17:00:23 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:38.072 17:00:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.072 17:00:23 -- common/autotest_common.sh@10 -- # set +x 00:24:38.072 17:00:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.072 17:00:23 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:38.072 17:00:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.072 17:00:23 -- common/autotest_common.sh@10 -- # set +x 00:24:38.073 17:00:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.073 17:00:23 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:38.073 17:00:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.073 17:00:23 -- common/autotest_common.sh@10 -- # set +x 00:24:38.073 [2024-11-16 17:00:23.659703] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:38.073 17:00:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.073 17:00:23 -- target/perf_adq.sh@73 -- # perfpid=1267173 00:24:38.073 17:00:23 -- target/perf_adq.sh@74 -- # sleep 2 00:24:38.073 17:00:23 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:38.073 EAL: No free 2048 kB hugepages reported on node 1 00:24:39.980 17:00:25 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:39.980 17:00:25 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:39.980 17:00:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.980 17:00:25 -- common/autotest_common.sh@10 -- # set +x 00:24:39.980 17:00:25 -- target/perf_adq.sh@76 -- # wc -l 00:24:39.980 17:00:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.980 17:00:25 -- target/perf_adq.sh@76 -- # count=4 00:24:39.980 17:00:25 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:39.980 17:00:25 -- target/perf_adq.sh@81 -- # wait 1267173 00:24:49.960 Initializing NVMe Controllers 00:24:49.960 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:49.960 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:49.960 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:49.960 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:49.960 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:49.960 Initialization complete. Launching workers. 00:24:49.960 ======================================================== 00:24:49.960 Latency(us) 00:24:49.960 Device Information : IOPS MiB/s Average min max 00:24:49.960 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11165.40 43.61 5731.87 1796.51 9907.29 00:24:49.960 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11055.90 43.19 5788.37 2039.84 8921.01 00:24:49.960 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11487.80 44.87 5571.80 1765.32 9013.63 00:24:49.960 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11047.30 43.15 5794.09 1895.56 9764.39 00:24:49.960 ======================================================== 00:24:49.960 Total : 44756.39 174.83 5720.10 1765.32 9907.29 00:24:49.960 00:24:49.960 17:00:33 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:49.960 17:00:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:49.960 17:00:33 -- nvmf/common.sh@116 -- # sync 00:24:49.960 17:00:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:49.960 17:00:33 -- nvmf/common.sh@119 -- # set +e 00:24:49.960 17:00:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:49.960 17:00:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:49.960 rmmod nvme_tcp 00:24:49.960 rmmod nvme_fabrics 00:24:49.960 rmmod nvme_keyring 00:24:49.960 17:00:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:49.960 17:00:33 -- nvmf/common.sh@123 -- # set -e 00:24:49.960 17:00:33 -- nvmf/common.sh@124 -- # return 0 00:24:49.960 17:00:33 -- nvmf/common.sh@477 -- # '[' -n 1267077 ']' 00:24:49.960 17:00:33 -- nvmf/common.sh@478 -- # killprocess 1267077 00:24:49.960 17:00:33 -- common/autotest_common.sh@936 -- # '[' -z 1267077 ']' 00:24:49.960 17:00:33 -- common/autotest_common.sh@940 -- # kill -0 1267077 00:24:49.960 17:00:33 -- common/autotest_common.sh@941 -- # uname 00:24:49.960 17:00:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:49.960 17:00:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1267077 00:24:49.960 17:00:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:49.960 17:00:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:49.960 17:00:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1267077' 00:24:49.960 killing process with pid 1267077 00:24:49.960 17:00:33 -- common/autotest_common.sh@955 -- # kill 1267077 00:24:49.960 17:00:33 -- common/autotest_common.sh@960 -- # wait 1267077 00:24:49.960 17:00:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:49.960 17:00:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:49.960 17:00:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:49.960 17:00:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:49.960 17:00:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:49.960 17:00:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:49.960 17:00:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:49.960 17:00:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:50.530 17:00:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:50.530 17:00:36 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:50.530 17:00:36 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:51.469 17:00:36 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:54.009 17:00:39 -- target/perf_adq.sh@54 -- # sleep 5 00:24:59.287 17:00:44 -- target/perf_adq.sh@87 -- # nvmftestinit 00:24:59.287 17:00:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:59.287 17:00:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:59.287 17:00:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:59.287 17:00:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:59.287 17:00:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:59.287 17:00:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:59.287 17:00:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:59.287 17:00:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:59.287 17:00:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:59.287 17:00:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:59.287 17:00:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:59.287 17:00:44 -- common/autotest_common.sh@10 -- # set +x 00:24:59.287 17:00:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:59.287 17:00:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:59.287 17:00:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:59.287 17:00:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:59.287 17:00:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:59.287 17:00:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:59.287 17:00:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:59.287 17:00:44 -- nvmf/common.sh@294 -- # net_devs=() 00:24:59.287 17:00:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:59.287 17:00:44 -- nvmf/common.sh@295 -- # e810=() 00:24:59.287 17:00:44 -- nvmf/common.sh@295 -- # local -ga e810 00:24:59.287 17:00:44 -- nvmf/common.sh@296 -- # x722=() 00:24:59.287 17:00:44 -- nvmf/common.sh@296 -- # local -ga x722 00:24:59.287 17:00:44 -- nvmf/common.sh@297 -- # mlx=() 00:24:59.287 17:00:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:59.287 17:00:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:59.287 17:00:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:59.287 17:00:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:59.287 17:00:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:59.287 17:00:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:59.287 17:00:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:59.287 17:00:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:59.287 17:00:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:59.287 17:00:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:59.287 17:00:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:59.287 17:00:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:59.287 17:00:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:59.287 17:00:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:59.287 17:00:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:59.287 17:00:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:59.287 17:00:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:59.287 17:00:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:59.287 17:00:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:59.287 17:00:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:59.287 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:59.287 17:00:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:59.287 17:00:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:59.287 17:00:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:59.287 17:00:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:59.287 17:00:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:59.287 17:00:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:59.287 17:00:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:59.287 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:59.287 17:00:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:59.287 17:00:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:59.287 17:00:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:59.287 17:00:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:59.287 17:00:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:59.288 17:00:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:59.288 17:00:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:59.288 17:00:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:59.288 17:00:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:59.288 17:00:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:59.288 17:00:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:59.288 17:00:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:59.288 17:00:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:59.288 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:59.288 17:00:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:59.288 17:00:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:59.288 17:00:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:59.288 17:00:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:59.288 17:00:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:59.288 17:00:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:59.288 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:59.288 17:00:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:59.288 17:00:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:59.288 17:00:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:59.288 17:00:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:59.288 17:00:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:59.288 17:00:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:59.288 17:00:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:59.288 17:00:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:59.288 17:00:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:59.288 17:00:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:59.288 17:00:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:59.288 17:00:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:59.288 17:00:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:59.288 17:00:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:59.288 17:00:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:59.288 17:00:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:59.288 17:00:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:59.288 17:00:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:59.288 17:00:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:59.288 17:00:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:59.288 17:00:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:59.288 17:00:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:59.288 17:00:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:59.288 17:00:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:59.288 17:00:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:59.288 17:00:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:59.288 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:59.288 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.147 ms 00:24:59.288 00:24:59.288 --- 10.0.0.2 ping statistics --- 00:24:59.288 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:59.288 rtt min/avg/max/mdev = 0.147/0.147/0.147/0.000 ms 00:24:59.288 17:00:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:59.288 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:59.288 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.060 ms 00:24:59.288 00:24:59.288 --- 10.0.0.1 ping statistics --- 00:24:59.288 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:59.288 rtt min/avg/max/mdev = 0.060/0.060/0.060/0.000 ms 00:24:59.288 17:00:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:59.288 17:00:44 -- nvmf/common.sh@410 -- # return 0 00:24:59.288 17:00:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:59.288 17:00:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:59.288 17:00:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:59.288 17:00:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:59.288 17:00:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:59.288 17:00:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:59.288 17:00:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:59.288 17:00:44 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:24:59.288 17:00:44 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:24:59.288 17:00:44 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:24:59.288 17:00:44 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:24:59.288 net.core.busy_poll = 1 00:24:59.288 17:00:44 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:24:59.288 net.core.busy_read = 1 00:24:59.288 17:00:44 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:24:59.288 17:00:44 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:24:59.288 17:00:44 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:24:59.288 17:00:44 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:24:59.288 17:00:44 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:24:59.288 17:00:44 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:59.288 17:00:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:59.288 17:00:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:59.288 17:00:44 -- common/autotest_common.sh@10 -- # set +x 00:24:59.288 17:00:44 -- nvmf/common.sh@469 -- # nvmfpid=1269918 00:24:59.288 17:00:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:59.288 17:00:44 -- nvmf/common.sh@470 -- # waitforlisten 1269918 00:24:59.288 17:00:44 -- common/autotest_common.sh@829 -- # '[' -z 1269918 ']' 00:24:59.288 17:00:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:59.288 17:00:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:59.288 17:00:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:59.288 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:59.288 17:00:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:59.288 17:00:44 -- common/autotest_common.sh@10 -- # set +x 00:24:59.288 [2024-11-16 17:00:44.505024] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:59.288 [2024-11-16 17:00:44.505115] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:59.288 EAL: No free 2048 kB hugepages reported on node 1 00:24:59.289 [2024-11-16 17:00:44.570804] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:59.289 [2024-11-16 17:00:44.659936] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:59.289 [2024-11-16 17:00:44.660096] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:59.289 [2024-11-16 17:00:44.660114] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:59.289 [2024-11-16 17:00:44.660127] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:59.289 [2024-11-16 17:00:44.660275] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:59.289 [2024-11-16 17:00:44.660340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:59.289 [2024-11-16 17:00:44.660407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:59.289 [2024-11-16 17:00:44.660409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:59.289 17:00:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:59.289 17:00:44 -- common/autotest_common.sh@862 -- # return 0 00:24:59.289 17:00:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:59.289 17:00:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:59.289 17:00:44 -- common/autotest_common.sh@10 -- # set +x 00:24:59.289 17:00:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:59.289 17:00:44 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:24:59.289 17:00:44 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:24:59.289 17:00:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.289 17:00:44 -- common/autotest_common.sh@10 -- # set +x 00:24:59.289 17:00:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.289 17:00:44 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:59.289 17:00:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.289 17:00:44 -- common/autotest_common.sh@10 -- # set +x 00:24:59.289 17:00:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.289 17:00:44 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:24:59.289 17:00:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.289 17:00:44 -- common/autotest_common.sh@10 -- # set +x 00:24:59.289 [2024-11-16 17:00:44.867218] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:59.289 17:00:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.289 17:00:44 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:59.289 17:00:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.289 17:00:44 -- common/autotest_common.sh@10 -- # set +x 00:24:59.289 Malloc1 00:24:59.289 17:00:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.289 17:00:44 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:59.289 17:00:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.289 17:00:44 -- common/autotest_common.sh@10 -- # set +x 00:24:59.289 17:00:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.289 17:00:44 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:59.289 17:00:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.289 17:00:44 -- common/autotest_common.sh@10 -- # set +x 00:24:59.289 17:00:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.289 17:00:44 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:59.289 17:00:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.289 17:00:44 -- common/autotest_common.sh@10 -- # set +x 00:24:59.289 [2024-11-16 17:00:44.919869] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:59.289 17:00:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.289 17:00:44 -- target/perf_adq.sh@94 -- # perfpid=1269951 00:24:59.289 17:00:44 -- target/perf_adq.sh@95 -- # sleep 2 00:24:59.289 17:00:44 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:59.289 EAL: No free 2048 kB hugepages reported on node 1 00:25:01.191 17:00:46 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:25:01.191 17:00:46 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:25:01.191 17:00:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:01.191 17:00:46 -- target/perf_adq.sh@97 -- # wc -l 00:25:01.191 17:00:46 -- common/autotest_common.sh@10 -- # set +x 00:25:01.449 17:00:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:01.449 17:00:46 -- target/perf_adq.sh@97 -- # count=3 00:25:01.449 17:00:46 -- target/perf_adq.sh@98 -- # [[ 3 -lt 2 ]] 00:25:01.449 17:00:46 -- target/perf_adq.sh@103 -- # wait 1269951 00:25:09.576 Initializing NVMe Controllers 00:25:09.576 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:09.576 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:09.576 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:09.576 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:09.576 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:09.576 Initialization complete. Launching workers. 00:25:09.576 ======================================================== 00:25:09.576 Latency(us) 00:25:09.576 Device Information : IOPS MiB/s Average min max 00:25:09.576 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 4543.90 17.75 14130.53 1845.76 59782.53 00:25:09.576 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4369.20 17.07 14710.21 1747.36 60320.01 00:25:09.576 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 5501.10 21.49 11635.11 1408.84 61719.67 00:25:09.576 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 5168.40 20.19 12384.05 1254.37 58635.46 00:25:09.576 ======================================================== 00:25:09.576 Total : 19582.60 76.49 13097.91 1254.37 61719.67 00:25:09.576 00:25:09.576 17:00:55 -- target/perf_adq.sh@104 -- # nvmftestfini 00:25:09.576 17:00:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:09.576 17:00:55 -- nvmf/common.sh@116 -- # sync 00:25:09.576 17:00:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:09.576 17:00:55 -- nvmf/common.sh@119 -- # set +e 00:25:09.576 17:00:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:09.576 17:00:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:09.576 rmmod nvme_tcp 00:25:09.576 rmmod nvme_fabrics 00:25:09.576 rmmod nvme_keyring 00:25:09.576 17:00:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:09.576 17:00:55 -- nvmf/common.sh@123 -- # set -e 00:25:09.576 17:00:55 -- nvmf/common.sh@124 -- # return 0 00:25:09.576 17:00:55 -- nvmf/common.sh@477 -- # '[' -n 1269918 ']' 00:25:09.576 17:00:55 -- nvmf/common.sh@478 -- # killprocess 1269918 00:25:09.576 17:00:55 -- common/autotest_common.sh@936 -- # '[' -z 1269918 ']' 00:25:09.576 17:00:55 -- common/autotest_common.sh@940 -- # kill -0 1269918 00:25:09.576 17:00:55 -- common/autotest_common.sh@941 -- # uname 00:25:09.576 17:00:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:09.576 17:00:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1269918 00:25:09.576 17:00:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:09.576 17:00:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:09.576 17:00:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1269918' 00:25:09.576 killing process with pid 1269918 00:25:09.576 17:00:55 -- common/autotest_common.sh@955 -- # kill 1269918 00:25:09.576 17:00:55 -- common/autotest_common.sh@960 -- # wait 1269918 00:25:09.836 17:00:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:09.836 17:00:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:09.836 17:00:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:09.836 17:00:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:09.836 17:00:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:09.836 17:00:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:09.836 17:00:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:09.836 17:00:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:11.748 17:00:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:11.748 17:00:57 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:25:11.748 00:25:11.748 real 0m44.626s 00:25:11.748 user 2m39.257s 00:25:11.748 sys 0m9.580s 00:25:11.748 17:00:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:11.748 17:00:57 -- common/autotest_common.sh@10 -- # set +x 00:25:11.748 ************************************ 00:25:11.748 END TEST nvmf_perf_adq 00:25:11.748 ************************************ 00:25:11.748 17:00:57 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:11.748 17:00:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:11.748 17:00:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:11.748 17:00:57 -- common/autotest_common.sh@10 -- # set +x 00:25:11.748 ************************************ 00:25:11.748 START TEST nvmf_shutdown 00:25:11.748 ************************************ 00:25:11.748 17:00:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:12.007 * Looking for test storage... 00:25:12.007 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:12.007 17:00:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:12.007 17:00:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:12.007 17:00:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:12.007 17:00:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:12.007 17:00:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:12.007 17:00:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:12.007 17:00:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:12.007 17:00:57 -- scripts/common.sh@335 -- # IFS=.-: 00:25:12.007 17:00:57 -- scripts/common.sh@335 -- # read -ra ver1 00:25:12.008 17:00:57 -- scripts/common.sh@336 -- # IFS=.-: 00:25:12.008 17:00:57 -- scripts/common.sh@336 -- # read -ra ver2 00:25:12.008 17:00:57 -- scripts/common.sh@337 -- # local 'op=<' 00:25:12.008 17:00:57 -- scripts/common.sh@339 -- # ver1_l=2 00:25:12.008 17:00:57 -- scripts/common.sh@340 -- # ver2_l=1 00:25:12.008 17:00:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:12.008 17:00:57 -- scripts/common.sh@343 -- # case "$op" in 00:25:12.008 17:00:57 -- scripts/common.sh@344 -- # : 1 00:25:12.008 17:00:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:12.008 17:00:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:12.008 17:00:57 -- scripts/common.sh@364 -- # decimal 1 00:25:12.008 17:00:57 -- scripts/common.sh@352 -- # local d=1 00:25:12.008 17:00:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:12.008 17:00:57 -- scripts/common.sh@354 -- # echo 1 00:25:12.008 17:00:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:12.008 17:00:57 -- scripts/common.sh@365 -- # decimal 2 00:25:12.008 17:00:57 -- scripts/common.sh@352 -- # local d=2 00:25:12.008 17:00:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:12.008 17:00:57 -- scripts/common.sh@354 -- # echo 2 00:25:12.008 17:00:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:12.008 17:00:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:12.008 17:00:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:12.008 17:00:57 -- scripts/common.sh@367 -- # return 0 00:25:12.008 17:00:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:12.008 17:00:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:12.008 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:12.008 --rc genhtml_branch_coverage=1 00:25:12.008 --rc genhtml_function_coverage=1 00:25:12.008 --rc genhtml_legend=1 00:25:12.008 --rc geninfo_all_blocks=1 00:25:12.008 --rc geninfo_unexecuted_blocks=1 00:25:12.008 00:25:12.008 ' 00:25:12.008 17:00:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:12.008 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:12.008 --rc genhtml_branch_coverage=1 00:25:12.008 --rc genhtml_function_coverage=1 00:25:12.008 --rc genhtml_legend=1 00:25:12.008 --rc geninfo_all_blocks=1 00:25:12.008 --rc geninfo_unexecuted_blocks=1 00:25:12.008 00:25:12.008 ' 00:25:12.008 17:00:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:12.008 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:12.008 --rc genhtml_branch_coverage=1 00:25:12.008 --rc genhtml_function_coverage=1 00:25:12.008 --rc genhtml_legend=1 00:25:12.008 --rc geninfo_all_blocks=1 00:25:12.008 --rc geninfo_unexecuted_blocks=1 00:25:12.008 00:25:12.008 ' 00:25:12.008 17:00:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:12.008 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:12.008 --rc genhtml_branch_coverage=1 00:25:12.008 --rc genhtml_function_coverage=1 00:25:12.008 --rc genhtml_legend=1 00:25:12.008 --rc geninfo_all_blocks=1 00:25:12.008 --rc geninfo_unexecuted_blocks=1 00:25:12.008 00:25:12.008 ' 00:25:12.008 17:00:57 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:12.008 17:00:57 -- nvmf/common.sh@7 -- # uname -s 00:25:12.008 17:00:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:12.008 17:00:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:12.008 17:00:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:12.008 17:00:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:12.008 17:00:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:12.008 17:00:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:12.008 17:00:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:12.008 17:00:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:12.008 17:00:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:12.008 17:00:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:12.008 17:00:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:12.008 17:00:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:12.008 17:00:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:12.008 17:00:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:12.008 17:00:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:12.008 17:00:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:12.008 17:00:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:12.008 17:00:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:12.008 17:00:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:12.008 17:00:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:12.008 17:00:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:12.008 17:00:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:12.008 17:00:57 -- paths/export.sh@5 -- # export PATH 00:25:12.008 17:00:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:12.008 17:00:57 -- nvmf/common.sh@46 -- # : 0 00:25:12.008 17:00:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:12.008 17:00:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:12.008 17:00:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:12.008 17:00:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:12.008 17:00:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:12.008 17:00:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:12.008 17:00:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:12.008 17:00:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:12.008 17:00:57 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:12.008 17:00:57 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:12.008 17:00:57 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:25:12.008 17:00:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:12.008 17:00:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:12.008 17:00:57 -- common/autotest_common.sh@10 -- # set +x 00:25:12.008 ************************************ 00:25:12.008 START TEST nvmf_shutdown_tc1 00:25:12.008 ************************************ 00:25:12.008 17:00:57 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:25:12.008 17:00:57 -- target/shutdown.sh@74 -- # starttarget 00:25:12.008 17:00:57 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:12.008 17:00:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:12.008 17:00:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:12.008 17:00:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:12.008 17:00:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:12.008 17:00:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:12.008 17:00:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:12.008 17:00:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:12.008 17:00:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:12.008 17:00:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:12.008 17:00:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:12.008 17:00:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:12.008 17:00:57 -- common/autotest_common.sh@10 -- # set +x 00:25:13.916 17:00:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:13.916 17:00:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:13.916 17:00:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:13.916 17:00:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:13.916 17:00:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:13.916 17:00:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:13.916 17:00:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:13.916 17:00:59 -- nvmf/common.sh@294 -- # net_devs=() 00:25:13.916 17:00:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:13.916 17:00:59 -- nvmf/common.sh@295 -- # e810=() 00:25:13.916 17:00:59 -- nvmf/common.sh@295 -- # local -ga e810 00:25:13.916 17:00:59 -- nvmf/common.sh@296 -- # x722=() 00:25:13.916 17:00:59 -- nvmf/common.sh@296 -- # local -ga x722 00:25:13.916 17:00:59 -- nvmf/common.sh@297 -- # mlx=() 00:25:13.916 17:00:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:13.916 17:00:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:13.916 17:00:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:13.916 17:00:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:13.916 17:00:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:13.916 17:00:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:13.916 17:00:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:13.916 17:00:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:13.916 17:00:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:13.916 17:00:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:13.916 17:00:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:13.916 17:00:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:13.916 17:00:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:13.916 17:00:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:13.916 17:00:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:13.916 17:00:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:13.916 17:00:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:13.916 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:13.916 17:00:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:13.916 17:00:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:13.916 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:13.916 17:00:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:13.916 17:00:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:13.916 17:00:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:13.916 17:00:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:13.916 17:00:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:13.916 17:00:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:13.916 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:13.916 17:00:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:13.916 17:00:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:13.916 17:00:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:13.916 17:00:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:13.916 17:00:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:13.916 17:00:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:13.916 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:13.916 17:00:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:13.916 17:00:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:13.916 17:00:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:13.916 17:00:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:13.916 17:00:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:13.916 17:00:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:13.916 17:00:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:13.916 17:00:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:13.916 17:00:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:13.916 17:00:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:13.917 17:00:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:13.917 17:00:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:13.917 17:00:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:13.917 17:00:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:13.917 17:00:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:13.917 17:00:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:13.917 17:00:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:13.917 17:00:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:14.175 17:00:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:14.175 17:00:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:14.175 17:00:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:14.175 17:00:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:14.175 17:00:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:14.175 17:00:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:14.175 17:00:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:14.175 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:14.175 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.172 ms 00:25:14.175 00:25:14.175 --- 10.0.0.2 ping statistics --- 00:25:14.175 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:14.175 rtt min/avg/max/mdev = 0.172/0.172/0.172/0.000 ms 00:25:14.175 17:00:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:14.175 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:14.175 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:25:14.175 00:25:14.175 --- 10.0.0.1 ping statistics --- 00:25:14.175 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:14.175 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:25:14.175 17:00:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:14.175 17:00:59 -- nvmf/common.sh@410 -- # return 0 00:25:14.175 17:00:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:14.175 17:00:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:14.175 17:00:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:14.175 17:00:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:14.175 17:00:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:14.175 17:00:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:14.175 17:00:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:14.175 17:00:59 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:14.175 17:00:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:14.175 17:00:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:14.175 17:00:59 -- common/autotest_common.sh@10 -- # set +x 00:25:14.434 17:00:59 -- nvmf/common.sh@469 -- # nvmfpid=1273166 00:25:14.434 17:00:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:14.434 17:00:59 -- nvmf/common.sh@470 -- # waitforlisten 1273166 00:25:14.434 17:00:59 -- common/autotest_common.sh@829 -- # '[' -z 1273166 ']' 00:25:14.434 17:00:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:14.434 17:00:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:14.434 17:00:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:14.434 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:14.434 17:00:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:14.434 17:00:59 -- common/autotest_common.sh@10 -- # set +x 00:25:14.434 [2024-11-16 17:00:59.967941] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:14.434 [2024-11-16 17:00:59.968029] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:14.434 EAL: No free 2048 kB hugepages reported on node 1 00:25:14.434 [2024-11-16 17:01:00.050579] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:14.434 [2024-11-16 17:01:00.141673] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:14.434 [2024-11-16 17:01:00.141859] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:14.434 [2024-11-16 17:01:00.141879] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:14.434 [2024-11-16 17:01:00.141894] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:14.434 [2024-11-16 17:01:00.142008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:14.434 [2024-11-16 17:01:00.142087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:14.434 [2024-11-16 17:01:00.142107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:14.434 [2024-11-16 17:01:00.142110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:15.372 17:01:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:15.372 17:01:00 -- common/autotest_common.sh@862 -- # return 0 00:25:15.372 17:01:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:15.372 17:01:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:15.372 17:01:00 -- common/autotest_common.sh@10 -- # set +x 00:25:15.372 17:01:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:15.372 17:01:00 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:15.372 17:01:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.372 17:01:00 -- common/autotest_common.sh@10 -- # set +x 00:25:15.372 [2024-11-16 17:01:00.995380] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:15.372 17:01:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.372 17:01:01 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:15.372 17:01:01 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:15.372 17:01:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:15.372 17:01:01 -- common/autotest_common.sh@10 -- # set +x 00:25:15.372 17:01:01 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:15.372 17:01:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.372 17:01:01 -- target/shutdown.sh@28 -- # cat 00:25:15.372 17:01:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.372 17:01:01 -- target/shutdown.sh@28 -- # cat 00:25:15.372 17:01:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.372 17:01:01 -- target/shutdown.sh@28 -- # cat 00:25:15.372 17:01:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.372 17:01:01 -- target/shutdown.sh@28 -- # cat 00:25:15.372 17:01:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.372 17:01:01 -- target/shutdown.sh@28 -- # cat 00:25:15.372 17:01:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.372 17:01:01 -- target/shutdown.sh@28 -- # cat 00:25:15.372 17:01:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.372 17:01:01 -- target/shutdown.sh@28 -- # cat 00:25:15.372 17:01:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.372 17:01:01 -- target/shutdown.sh@28 -- # cat 00:25:15.372 17:01:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.372 17:01:01 -- target/shutdown.sh@28 -- # cat 00:25:15.372 17:01:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.372 17:01:01 -- target/shutdown.sh@28 -- # cat 00:25:15.372 17:01:01 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:15.372 17:01:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.372 17:01:01 -- common/autotest_common.sh@10 -- # set +x 00:25:15.372 Malloc1 00:25:15.372 [2024-11-16 17:01:01.083804] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:15.372 Malloc2 00:25:15.631 Malloc3 00:25:15.631 Malloc4 00:25:15.631 Malloc5 00:25:15.631 Malloc6 00:25:15.631 Malloc7 00:25:15.890 Malloc8 00:25:15.890 Malloc9 00:25:15.890 Malloc10 00:25:15.890 17:01:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.890 17:01:01 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:15.890 17:01:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:15.890 17:01:01 -- common/autotest_common.sh@10 -- # set +x 00:25:15.890 17:01:01 -- target/shutdown.sh@78 -- # perfpid=1273477 00:25:15.890 17:01:01 -- target/shutdown.sh@79 -- # waitforlisten 1273477 /var/tmp/bdevperf.sock 00:25:15.890 17:01:01 -- common/autotest_common.sh@829 -- # '[' -z 1273477 ']' 00:25:15.890 17:01:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:15.890 17:01:01 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:15.890 17:01:01 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:25:15.890 17:01:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:15.890 17:01:01 -- nvmf/common.sh@520 -- # config=() 00:25:15.890 17:01:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:15.890 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:15.890 17:01:01 -- nvmf/common.sh@520 -- # local subsystem config 00:25:15.890 17:01:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:15.890 17:01:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.890 17:01:01 -- common/autotest_common.sh@10 -- # set +x 00:25:15.890 17:01:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.890 { 00:25:15.890 "params": { 00:25:15.890 "name": "Nvme$subsystem", 00:25:15.890 "trtype": "$TEST_TRANSPORT", 00:25:15.890 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.890 "adrfam": "ipv4", 00:25:15.890 "trsvcid": "$NVMF_PORT", 00:25:15.890 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.890 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.890 "hdgst": ${hdgst:-false}, 00:25:15.890 "ddgst": ${ddgst:-false} 00:25:15.890 }, 00:25:15.890 "method": "bdev_nvme_attach_controller" 00:25:15.890 } 00:25:15.890 EOF 00:25:15.890 )") 00:25:15.890 17:01:01 -- nvmf/common.sh@542 -- # cat 00:25:15.890 17:01:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.890 17:01:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.890 { 00:25:15.890 "params": { 00:25:15.890 "name": "Nvme$subsystem", 00:25:15.890 "trtype": "$TEST_TRANSPORT", 00:25:15.890 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.890 "adrfam": "ipv4", 00:25:15.890 "trsvcid": "$NVMF_PORT", 00:25:15.890 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.890 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.890 "hdgst": ${hdgst:-false}, 00:25:15.890 "ddgst": ${ddgst:-false} 00:25:15.890 }, 00:25:15.890 "method": "bdev_nvme_attach_controller" 00:25:15.890 } 00:25:15.890 EOF 00:25:15.890 )") 00:25:15.890 17:01:01 -- nvmf/common.sh@542 -- # cat 00:25:15.890 17:01:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.890 17:01:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.890 { 00:25:15.890 "params": { 00:25:15.890 "name": "Nvme$subsystem", 00:25:15.890 "trtype": "$TEST_TRANSPORT", 00:25:15.890 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.890 "adrfam": "ipv4", 00:25:15.890 "trsvcid": "$NVMF_PORT", 00:25:15.890 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.890 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.890 "hdgst": ${hdgst:-false}, 00:25:15.890 "ddgst": ${ddgst:-false} 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 } 00:25:15.891 EOF 00:25:15.891 )") 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # cat 00:25:15.891 17:01:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.891 { 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme$subsystem", 00:25:15.891 "trtype": "$TEST_TRANSPORT", 00:25:15.891 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.891 "adrfam": "ipv4", 00:25:15.891 "trsvcid": "$NVMF_PORT", 00:25:15.891 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.891 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.891 "hdgst": ${hdgst:-false}, 00:25:15.891 "ddgst": ${ddgst:-false} 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 } 00:25:15.891 EOF 00:25:15.891 )") 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # cat 00:25:15.891 17:01:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.891 { 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme$subsystem", 00:25:15.891 "trtype": "$TEST_TRANSPORT", 00:25:15.891 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.891 "adrfam": "ipv4", 00:25:15.891 "trsvcid": "$NVMF_PORT", 00:25:15.891 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.891 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.891 "hdgst": ${hdgst:-false}, 00:25:15.891 "ddgst": ${ddgst:-false} 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 } 00:25:15.891 EOF 00:25:15.891 )") 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # cat 00:25:15.891 17:01:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.891 { 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme$subsystem", 00:25:15.891 "trtype": "$TEST_TRANSPORT", 00:25:15.891 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.891 "adrfam": "ipv4", 00:25:15.891 "trsvcid": "$NVMF_PORT", 00:25:15.891 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.891 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.891 "hdgst": ${hdgst:-false}, 00:25:15.891 "ddgst": ${ddgst:-false} 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 } 00:25:15.891 EOF 00:25:15.891 )") 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # cat 00:25:15.891 17:01:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.891 { 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme$subsystem", 00:25:15.891 "trtype": "$TEST_TRANSPORT", 00:25:15.891 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.891 "adrfam": "ipv4", 00:25:15.891 "trsvcid": "$NVMF_PORT", 00:25:15.891 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.891 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.891 "hdgst": ${hdgst:-false}, 00:25:15.891 "ddgst": ${ddgst:-false} 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 } 00:25:15.891 EOF 00:25:15.891 )") 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # cat 00:25:15.891 17:01:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.891 { 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme$subsystem", 00:25:15.891 "trtype": "$TEST_TRANSPORT", 00:25:15.891 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.891 "adrfam": "ipv4", 00:25:15.891 "trsvcid": "$NVMF_PORT", 00:25:15.891 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.891 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.891 "hdgst": ${hdgst:-false}, 00:25:15.891 "ddgst": ${ddgst:-false} 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 } 00:25:15.891 EOF 00:25:15.891 )") 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # cat 00:25:15.891 17:01:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.891 { 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme$subsystem", 00:25:15.891 "trtype": "$TEST_TRANSPORT", 00:25:15.891 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.891 "adrfam": "ipv4", 00:25:15.891 "trsvcid": "$NVMF_PORT", 00:25:15.891 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.891 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.891 "hdgst": ${hdgst:-false}, 00:25:15.891 "ddgst": ${ddgst:-false} 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 } 00:25:15.891 EOF 00:25:15.891 )") 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # cat 00:25:15.891 17:01:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.891 { 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme$subsystem", 00:25:15.891 "trtype": "$TEST_TRANSPORT", 00:25:15.891 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.891 "adrfam": "ipv4", 00:25:15.891 "trsvcid": "$NVMF_PORT", 00:25:15.891 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.891 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.891 "hdgst": ${hdgst:-false}, 00:25:15.891 "ddgst": ${ddgst:-false} 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 } 00:25:15.891 EOF 00:25:15.891 )") 00:25:15.891 17:01:01 -- nvmf/common.sh@542 -- # cat 00:25:15.891 17:01:01 -- nvmf/common.sh@544 -- # jq . 00:25:15.891 17:01:01 -- nvmf/common.sh@545 -- # IFS=, 00:25:15.891 17:01:01 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme1", 00:25:15.891 "trtype": "tcp", 00:25:15.891 "traddr": "10.0.0.2", 00:25:15.891 "adrfam": "ipv4", 00:25:15.891 "trsvcid": "4420", 00:25:15.891 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:15.891 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:15.891 "hdgst": false, 00:25:15.891 "ddgst": false 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 },{ 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme2", 00:25:15.891 "trtype": "tcp", 00:25:15.891 "traddr": "10.0.0.2", 00:25:15.891 "adrfam": "ipv4", 00:25:15.891 "trsvcid": "4420", 00:25:15.891 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:15.891 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:15.891 "hdgst": false, 00:25:15.891 "ddgst": false 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 },{ 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme3", 00:25:15.891 "trtype": "tcp", 00:25:15.891 "traddr": "10.0.0.2", 00:25:15.891 "adrfam": "ipv4", 00:25:15.891 "trsvcid": "4420", 00:25:15.891 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:15.891 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:15.891 "hdgst": false, 00:25:15.891 "ddgst": false 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 },{ 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme4", 00:25:15.891 "trtype": "tcp", 00:25:15.891 "traddr": "10.0.0.2", 00:25:15.891 "adrfam": "ipv4", 00:25:15.891 "trsvcid": "4420", 00:25:15.891 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:15.891 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:15.891 "hdgst": false, 00:25:15.891 "ddgst": false 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 },{ 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme5", 00:25:15.891 "trtype": "tcp", 00:25:15.891 "traddr": "10.0.0.2", 00:25:15.891 "adrfam": "ipv4", 00:25:15.891 "trsvcid": "4420", 00:25:15.891 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:15.891 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:15.891 "hdgst": false, 00:25:15.891 "ddgst": false 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 },{ 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme6", 00:25:15.891 "trtype": "tcp", 00:25:15.891 "traddr": "10.0.0.2", 00:25:15.891 "adrfam": "ipv4", 00:25:15.891 "trsvcid": "4420", 00:25:15.891 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:15.891 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:15.891 "hdgst": false, 00:25:15.891 "ddgst": false 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 },{ 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme7", 00:25:15.891 "trtype": "tcp", 00:25:15.891 "traddr": "10.0.0.2", 00:25:15.891 "adrfam": "ipv4", 00:25:15.891 "trsvcid": "4420", 00:25:15.891 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:15.891 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:15.891 "hdgst": false, 00:25:15.891 "ddgst": false 00:25:15.891 }, 00:25:15.891 "method": "bdev_nvme_attach_controller" 00:25:15.891 },{ 00:25:15.891 "params": { 00:25:15.891 "name": "Nvme8", 00:25:15.892 "trtype": "tcp", 00:25:15.892 "traddr": "10.0.0.2", 00:25:15.892 "adrfam": "ipv4", 00:25:15.892 "trsvcid": "4420", 00:25:15.892 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:15.892 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:15.892 "hdgst": false, 00:25:15.892 "ddgst": false 00:25:15.892 }, 00:25:15.892 "method": "bdev_nvme_attach_controller" 00:25:15.892 },{ 00:25:15.892 "params": { 00:25:15.892 "name": "Nvme9", 00:25:15.892 "trtype": "tcp", 00:25:15.892 "traddr": "10.0.0.2", 00:25:15.892 "adrfam": "ipv4", 00:25:15.892 "trsvcid": "4420", 00:25:15.892 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:15.892 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:15.892 "hdgst": false, 00:25:15.892 "ddgst": false 00:25:15.892 }, 00:25:15.892 "method": "bdev_nvme_attach_controller" 00:25:15.892 },{ 00:25:15.892 "params": { 00:25:15.892 "name": "Nvme10", 00:25:15.892 "trtype": "tcp", 00:25:15.892 "traddr": "10.0.0.2", 00:25:15.892 "adrfam": "ipv4", 00:25:15.892 "trsvcid": "4420", 00:25:15.892 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:15.892 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:15.892 "hdgst": false, 00:25:15.892 "ddgst": false 00:25:15.892 }, 00:25:15.892 "method": "bdev_nvme_attach_controller" 00:25:15.892 }' 00:25:15.892 [2024-11-16 17:01:01.574417] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:15.892 [2024-11-16 17:01:01.574504] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:25:15.892 EAL: No free 2048 kB hugepages reported on node 1 00:25:15.892 [2024-11-16 17:01:01.637551] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:16.150 [2024-11-16 17:01:01.722756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:18.056 17:01:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:18.056 17:01:03 -- common/autotest_common.sh@862 -- # return 0 00:25:18.056 17:01:03 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:18.056 17:01:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:18.056 17:01:03 -- common/autotest_common.sh@10 -- # set +x 00:25:18.056 17:01:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:18.056 17:01:03 -- target/shutdown.sh@83 -- # kill -9 1273477 00:25:18.056 17:01:03 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:25:18.056 17:01:03 -- target/shutdown.sh@87 -- # sleep 1 00:25:18.626 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1273477 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:25:18.626 17:01:04 -- target/shutdown.sh@88 -- # kill -0 1273166 00:25:18.626 17:01:04 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:25:18.626 17:01:04 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:18.626 17:01:04 -- nvmf/common.sh@520 -- # config=() 00:25:18.626 17:01:04 -- nvmf/common.sh@520 -- # local subsystem config 00:25:18.626 17:01:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.626 { 00:25:18.626 "params": { 00:25:18.626 "name": "Nvme$subsystem", 00:25:18.626 "trtype": "$TEST_TRANSPORT", 00:25:18.626 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.626 "adrfam": "ipv4", 00:25:18.626 "trsvcid": "$NVMF_PORT", 00:25:18.626 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.626 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.626 "hdgst": ${hdgst:-false}, 00:25:18.626 "ddgst": ${ddgst:-false} 00:25:18.626 }, 00:25:18.626 "method": "bdev_nvme_attach_controller" 00:25:18.626 } 00:25:18.626 EOF 00:25:18.626 )") 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # cat 00:25:18.626 17:01:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.626 { 00:25:18.626 "params": { 00:25:18.626 "name": "Nvme$subsystem", 00:25:18.626 "trtype": "$TEST_TRANSPORT", 00:25:18.626 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.626 "adrfam": "ipv4", 00:25:18.626 "trsvcid": "$NVMF_PORT", 00:25:18.626 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.626 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.626 "hdgst": ${hdgst:-false}, 00:25:18.626 "ddgst": ${ddgst:-false} 00:25:18.626 }, 00:25:18.626 "method": "bdev_nvme_attach_controller" 00:25:18.626 } 00:25:18.626 EOF 00:25:18.626 )") 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # cat 00:25:18.626 17:01:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.626 { 00:25:18.626 "params": { 00:25:18.626 "name": "Nvme$subsystem", 00:25:18.626 "trtype": "$TEST_TRANSPORT", 00:25:18.626 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.626 "adrfam": "ipv4", 00:25:18.626 "trsvcid": "$NVMF_PORT", 00:25:18.626 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.626 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.626 "hdgst": ${hdgst:-false}, 00:25:18.626 "ddgst": ${ddgst:-false} 00:25:18.626 }, 00:25:18.626 "method": "bdev_nvme_attach_controller" 00:25:18.626 } 00:25:18.626 EOF 00:25:18.626 )") 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # cat 00:25:18.626 17:01:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.626 { 00:25:18.626 "params": { 00:25:18.626 "name": "Nvme$subsystem", 00:25:18.626 "trtype": "$TEST_TRANSPORT", 00:25:18.626 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.626 "adrfam": "ipv4", 00:25:18.626 "trsvcid": "$NVMF_PORT", 00:25:18.626 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.626 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.626 "hdgst": ${hdgst:-false}, 00:25:18.626 "ddgst": ${ddgst:-false} 00:25:18.626 }, 00:25:18.626 "method": "bdev_nvme_attach_controller" 00:25:18.626 } 00:25:18.626 EOF 00:25:18.626 )") 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # cat 00:25:18.626 17:01:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.626 { 00:25:18.626 "params": { 00:25:18.626 "name": "Nvme$subsystem", 00:25:18.626 "trtype": "$TEST_TRANSPORT", 00:25:18.626 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.626 "adrfam": "ipv4", 00:25:18.626 "trsvcid": "$NVMF_PORT", 00:25:18.626 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.626 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.626 "hdgst": ${hdgst:-false}, 00:25:18.626 "ddgst": ${ddgst:-false} 00:25:18.626 }, 00:25:18.626 "method": "bdev_nvme_attach_controller" 00:25:18.626 } 00:25:18.626 EOF 00:25:18.626 )") 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # cat 00:25:18.626 17:01:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.626 { 00:25:18.626 "params": { 00:25:18.626 "name": "Nvme$subsystem", 00:25:18.626 "trtype": "$TEST_TRANSPORT", 00:25:18.626 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.626 "adrfam": "ipv4", 00:25:18.626 "trsvcid": "$NVMF_PORT", 00:25:18.626 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.626 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.626 "hdgst": ${hdgst:-false}, 00:25:18.626 "ddgst": ${ddgst:-false} 00:25:18.626 }, 00:25:18.626 "method": "bdev_nvme_attach_controller" 00:25:18.626 } 00:25:18.626 EOF 00:25:18.626 )") 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # cat 00:25:18.626 17:01:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.626 { 00:25:18.626 "params": { 00:25:18.626 "name": "Nvme$subsystem", 00:25:18.626 "trtype": "$TEST_TRANSPORT", 00:25:18.626 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.626 "adrfam": "ipv4", 00:25:18.626 "trsvcid": "$NVMF_PORT", 00:25:18.626 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.626 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.626 "hdgst": ${hdgst:-false}, 00:25:18.626 "ddgst": ${ddgst:-false} 00:25:18.626 }, 00:25:18.626 "method": "bdev_nvme_attach_controller" 00:25:18.626 } 00:25:18.626 EOF 00:25:18.626 )") 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # cat 00:25:18.626 17:01:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.626 { 00:25:18.626 "params": { 00:25:18.626 "name": "Nvme$subsystem", 00:25:18.626 "trtype": "$TEST_TRANSPORT", 00:25:18.626 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.626 "adrfam": "ipv4", 00:25:18.626 "trsvcid": "$NVMF_PORT", 00:25:18.626 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.626 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.626 "hdgst": ${hdgst:-false}, 00:25:18.626 "ddgst": ${ddgst:-false} 00:25:18.626 }, 00:25:18.626 "method": "bdev_nvme_attach_controller" 00:25:18.626 } 00:25:18.626 EOF 00:25:18.626 )") 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # cat 00:25:18.626 17:01:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.626 { 00:25:18.626 "params": { 00:25:18.626 "name": "Nvme$subsystem", 00:25:18.626 "trtype": "$TEST_TRANSPORT", 00:25:18.626 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.626 "adrfam": "ipv4", 00:25:18.626 "trsvcid": "$NVMF_PORT", 00:25:18.626 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.626 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.626 "hdgst": ${hdgst:-false}, 00:25:18.626 "ddgst": ${ddgst:-false} 00:25:18.626 }, 00:25:18.626 "method": "bdev_nvme_attach_controller" 00:25:18.626 } 00:25:18.626 EOF 00:25:18.626 )") 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # cat 00:25:18.626 17:01:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.626 { 00:25:18.626 "params": { 00:25:18.626 "name": "Nvme$subsystem", 00:25:18.626 "trtype": "$TEST_TRANSPORT", 00:25:18.626 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.626 "adrfam": "ipv4", 00:25:18.626 "trsvcid": "$NVMF_PORT", 00:25:18.626 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.626 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.626 "hdgst": ${hdgst:-false}, 00:25:18.626 "ddgst": ${ddgst:-false} 00:25:18.626 }, 00:25:18.626 "method": "bdev_nvme_attach_controller" 00:25:18.626 } 00:25:18.626 EOF 00:25:18.626 )") 00:25:18.626 17:01:04 -- nvmf/common.sh@542 -- # cat 00:25:18.626 17:01:04 -- nvmf/common.sh@544 -- # jq . 00:25:18.626 17:01:04 -- nvmf/common.sh@545 -- # IFS=, 00:25:18.626 17:01:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:18.626 "params": { 00:25:18.626 "name": "Nvme1", 00:25:18.626 "trtype": "tcp", 00:25:18.626 "traddr": "10.0.0.2", 00:25:18.626 "adrfam": "ipv4", 00:25:18.626 "trsvcid": "4420", 00:25:18.626 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:18.626 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:18.626 "hdgst": false, 00:25:18.626 "ddgst": false 00:25:18.626 }, 00:25:18.626 "method": "bdev_nvme_attach_controller" 00:25:18.626 },{ 00:25:18.627 "params": { 00:25:18.627 "name": "Nvme2", 00:25:18.627 "trtype": "tcp", 00:25:18.627 "traddr": "10.0.0.2", 00:25:18.627 "adrfam": "ipv4", 00:25:18.627 "trsvcid": "4420", 00:25:18.627 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:18.627 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:18.627 "hdgst": false, 00:25:18.627 "ddgst": false 00:25:18.627 }, 00:25:18.627 "method": "bdev_nvme_attach_controller" 00:25:18.627 },{ 00:25:18.627 "params": { 00:25:18.627 "name": "Nvme3", 00:25:18.627 "trtype": "tcp", 00:25:18.627 "traddr": "10.0.0.2", 00:25:18.627 "adrfam": "ipv4", 00:25:18.627 "trsvcid": "4420", 00:25:18.627 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:18.627 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:18.627 "hdgst": false, 00:25:18.627 "ddgst": false 00:25:18.627 }, 00:25:18.627 "method": "bdev_nvme_attach_controller" 00:25:18.627 },{ 00:25:18.627 "params": { 00:25:18.627 "name": "Nvme4", 00:25:18.627 "trtype": "tcp", 00:25:18.627 "traddr": "10.0.0.2", 00:25:18.627 "adrfam": "ipv4", 00:25:18.627 "trsvcid": "4420", 00:25:18.627 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:18.627 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:18.627 "hdgst": false, 00:25:18.627 "ddgst": false 00:25:18.627 }, 00:25:18.627 "method": "bdev_nvme_attach_controller" 00:25:18.627 },{ 00:25:18.627 "params": { 00:25:18.627 "name": "Nvme5", 00:25:18.627 "trtype": "tcp", 00:25:18.627 "traddr": "10.0.0.2", 00:25:18.627 "adrfam": "ipv4", 00:25:18.627 "trsvcid": "4420", 00:25:18.627 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:18.627 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:18.627 "hdgst": false, 00:25:18.627 "ddgst": false 00:25:18.627 }, 00:25:18.627 "method": "bdev_nvme_attach_controller" 00:25:18.627 },{ 00:25:18.627 "params": { 00:25:18.627 "name": "Nvme6", 00:25:18.627 "trtype": "tcp", 00:25:18.627 "traddr": "10.0.0.2", 00:25:18.627 "adrfam": "ipv4", 00:25:18.627 "trsvcid": "4420", 00:25:18.627 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:18.627 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:18.627 "hdgst": false, 00:25:18.627 "ddgst": false 00:25:18.627 }, 00:25:18.627 "method": "bdev_nvme_attach_controller" 00:25:18.627 },{ 00:25:18.627 "params": { 00:25:18.627 "name": "Nvme7", 00:25:18.627 "trtype": "tcp", 00:25:18.627 "traddr": "10.0.0.2", 00:25:18.627 "adrfam": "ipv4", 00:25:18.627 "trsvcid": "4420", 00:25:18.627 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:18.627 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:18.627 "hdgst": false, 00:25:18.627 "ddgst": false 00:25:18.627 }, 00:25:18.627 "method": "bdev_nvme_attach_controller" 00:25:18.627 },{ 00:25:18.627 "params": { 00:25:18.627 "name": "Nvme8", 00:25:18.627 "trtype": "tcp", 00:25:18.627 "traddr": "10.0.0.2", 00:25:18.627 "adrfam": "ipv4", 00:25:18.627 "trsvcid": "4420", 00:25:18.627 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:18.627 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:18.627 "hdgst": false, 00:25:18.627 "ddgst": false 00:25:18.627 }, 00:25:18.627 "method": "bdev_nvme_attach_controller" 00:25:18.627 },{ 00:25:18.627 "params": { 00:25:18.627 "name": "Nvme9", 00:25:18.627 "trtype": "tcp", 00:25:18.627 "traddr": "10.0.0.2", 00:25:18.627 "adrfam": "ipv4", 00:25:18.627 "trsvcid": "4420", 00:25:18.627 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:18.627 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:18.627 "hdgst": false, 00:25:18.627 "ddgst": false 00:25:18.627 }, 00:25:18.627 "method": "bdev_nvme_attach_controller" 00:25:18.627 },{ 00:25:18.627 "params": { 00:25:18.627 "name": "Nvme10", 00:25:18.627 "trtype": "tcp", 00:25:18.627 "traddr": "10.0.0.2", 00:25:18.627 "adrfam": "ipv4", 00:25:18.627 "trsvcid": "4420", 00:25:18.627 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:18.627 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:18.627 "hdgst": false, 00:25:18.627 "ddgst": false 00:25:18.627 }, 00:25:18.627 "method": "bdev_nvme_attach_controller" 00:25:18.627 }' 00:25:18.627 [2024-11-16 17:01:04.339351] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:18.627 [2024-11-16 17:01:04.339436] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1273789 ] 00:25:18.627 EAL: No free 2048 kB hugepages reported on node 1 00:25:18.887 [2024-11-16 17:01:04.404420] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:18.887 [2024-11-16 17:01:04.491857] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:20.793 Running I/O for 1 seconds... 00:25:21.728 00:25:21.728 Latency(us) 00:25:21.728 [2024-11-16T16:01:07.478Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:21.728 [2024-11-16T16:01:07.478Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.728 Verification LBA range: start 0x0 length 0x400 00:25:21.728 Nvme1n1 : 1.07 404.14 25.26 0.00 0.00 155866.17 16796.63 126605.84 00:25:21.728 [2024-11-16T16:01:07.478Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.728 Verification LBA range: start 0x0 length 0x400 00:25:21.728 Nvme2n1 : 1.08 401.26 25.08 0.00 0.00 155606.22 18641.35 115731.72 00:25:21.728 [2024-11-16T16:01:07.478Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.728 Verification LBA range: start 0x0 length 0x400 00:25:21.728 Nvme3n1 : 1.08 403.00 25.19 0.00 0.00 154074.03 16990.81 121168.78 00:25:21.728 [2024-11-16T16:01:07.478Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.728 Verification LBA range: start 0x0 length 0x400 00:25:21.728 Nvme4n1 : 1.09 399.61 24.98 0.00 0.00 154016.09 19709.35 116508.44 00:25:21.728 [2024-11-16T16:01:07.478Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.728 Verification LBA range: start 0x0 length 0x400 00:25:21.728 Nvme5n1 : 1.09 398.00 24.87 0.00 0.00 153446.07 20777.34 118061.89 00:25:21.728 [2024-11-16T16:01:07.478Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.728 Verification LBA range: start 0x0 length 0x400 00:25:21.728 Nvme6n1 : 1.09 397.27 24.83 0.00 0.00 152604.92 19320.98 119615.34 00:25:21.728 [2024-11-16T16:01:07.478Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.728 Verification LBA range: start 0x0 length 0x400 00:25:21.728 Nvme7n1 : 1.10 395.64 24.73 0.00 0.00 152724.38 16796.63 124275.67 00:25:21.728 [2024-11-16T16:01:07.478Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.728 Verification LBA range: start 0x0 length 0x400 00:25:21.728 Nvme8n1 : 1.10 395.02 24.69 0.00 0.00 152090.39 15049.01 125829.12 00:25:21.728 [2024-11-16T16:01:07.478Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.728 Verification LBA range: start 0x0 length 0x400 00:25:21.728 Nvme9n1 : 1.10 394.29 24.64 0.00 0.00 151676.08 12524.66 126605.84 00:25:21.728 [2024-11-16T16:01:07.478Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.728 Verification LBA range: start 0x0 length 0x400 00:25:21.728 Nvme10n1 : 1.10 404.40 25.28 0.00 0.00 147201.30 7670.14 125052.40 00:25:21.728 [2024-11-16T16:01:07.478Z] =================================================================================================================== 00:25:21.728 [2024-11-16T16:01:07.478Z] Total : 3992.63 249.54 0.00 0.00 152914.77 7670.14 126605.84 00:25:21.728 17:01:07 -- target/shutdown.sh@93 -- # stoptarget 00:25:21.728 17:01:07 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:21.728 17:01:07 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:21.728 17:01:07 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:21.728 17:01:07 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:21.728 17:01:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:21.728 17:01:07 -- nvmf/common.sh@116 -- # sync 00:25:21.728 17:01:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:21.728 17:01:07 -- nvmf/common.sh@119 -- # set +e 00:25:21.728 17:01:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:21.728 17:01:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:21.728 rmmod nvme_tcp 00:25:21.728 rmmod nvme_fabrics 00:25:21.728 rmmod nvme_keyring 00:25:21.988 17:01:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:21.988 17:01:07 -- nvmf/common.sh@123 -- # set -e 00:25:21.988 17:01:07 -- nvmf/common.sh@124 -- # return 0 00:25:21.988 17:01:07 -- nvmf/common.sh@477 -- # '[' -n 1273166 ']' 00:25:21.988 17:01:07 -- nvmf/common.sh@478 -- # killprocess 1273166 00:25:21.988 17:01:07 -- common/autotest_common.sh@936 -- # '[' -z 1273166 ']' 00:25:21.988 17:01:07 -- common/autotest_common.sh@940 -- # kill -0 1273166 00:25:21.988 17:01:07 -- common/autotest_common.sh@941 -- # uname 00:25:21.988 17:01:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:21.988 17:01:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1273166 00:25:21.988 17:01:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:21.988 17:01:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:21.988 17:01:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1273166' 00:25:21.988 killing process with pid 1273166 00:25:21.988 17:01:07 -- common/autotest_common.sh@955 -- # kill 1273166 00:25:21.988 17:01:07 -- common/autotest_common.sh@960 -- # wait 1273166 00:25:22.558 17:01:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:22.558 17:01:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:22.558 17:01:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:22.558 17:01:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:22.558 17:01:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:22.558 17:01:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:22.558 17:01:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:22.558 17:01:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:24.481 17:01:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:24.481 00:25:24.481 real 0m12.434s 00:25:24.481 user 0m36.403s 00:25:24.481 sys 0m3.305s 00:25:24.481 17:01:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:24.481 17:01:10 -- common/autotest_common.sh@10 -- # set +x 00:25:24.481 ************************************ 00:25:24.481 END TEST nvmf_shutdown_tc1 00:25:24.481 ************************************ 00:25:24.481 17:01:10 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:24.481 17:01:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:24.481 17:01:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:24.481 17:01:10 -- common/autotest_common.sh@10 -- # set +x 00:25:24.482 ************************************ 00:25:24.482 START TEST nvmf_shutdown_tc2 00:25:24.482 ************************************ 00:25:24.482 17:01:10 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:25:24.482 17:01:10 -- target/shutdown.sh@98 -- # starttarget 00:25:24.482 17:01:10 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:24.482 17:01:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:24.482 17:01:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:24.482 17:01:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:24.482 17:01:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:24.482 17:01:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:24.482 17:01:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:24.482 17:01:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:24.482 17:01:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:24.482 17:01:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:24.482 17:01:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:24.482 17:01:10 -- common/autotest_common.sh@10 -- # set +x 00:25:24.482 17:01:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:24.482 17:01:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:24.482 17:01:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:24.482 17:01:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:24.482 17:01:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:24.482 17:01:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:24.482 17:01:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:24.482 17:01:10 -- nvmf/common.sh@294 -- # net_devs=() 00:25:24.482 17:01:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:24.482 17:01:10 -- nvmf/common.sh@295 -- # e810=() 00:25:24.482 17:01:10 -- nvmf/common.sh@295 -- # local -ga e810 00:25:24.482 17:01:10 -- nvmf/common.sh@296 -- # x722=() 00:25:24.482 17:01:10 -- nvmf/common.sh@296 -- # local -ga x722 00:25:24.482 17:01:10 -- nvmf/common.sh@297 -- # mlx=() 00:25:24.482 17:01:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:24.482 17:01:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:24.482 17:01:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:24.482 17:01:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:24.482 17:01:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:24.482 17:01:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:24.482 17:01:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:24.482 17:01:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:24.482 17:01:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:24.482 17:01:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:24.482 17:01:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:24.482 17:01:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:24.482 17:01:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:24.482 17:01:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:24.482 17:01:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:24.482 17:01:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:24.482 17:01:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:24.482 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:24.482 17:01:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:24.482 17:01:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:24.482 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:24.482 17:01:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:24.482 17:01:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:24.482 17:01:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:24.482 17:01:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:24.482 17:01:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:24.482 17:01:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:24.482 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:24.482 17:01:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:24.482 17:01:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:24.482 17:01:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:24.482 17:01:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:24.482 17:01:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:24.482 17:01:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:24.482 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:24.482 17:01:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:24.482 17:01:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:24.482 17:01:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:24.482 17:01:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:24.482 17:01:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:24.482 17:01:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:24.482 17:01:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:24.482 17:01:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:24.482 17:01:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:24.482 17:01:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:24.482 17:01:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:24.482 17:01:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:24.482 17:01:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:24.482 17:01:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:24.482 17:01:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:24.482 17:01:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:24.482 17:01:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:24.482 17:01:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:24.482 17:01:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:24.482 17:01:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:24.482 17:01:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:24.482 17:01:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:24.482 17:01:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:24.482 17:01:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:24.741 17:01:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:24.741 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:24.741 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.147 ms 00:25:24.741 00:25:24.741 --- 10.0.0.2 ping statistics --- 00:25:24.741 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:24.741 rtt min/avg/max/mdev = 0.147/0.147/0.147/0.000 ms 00:25:24.741 17:01:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:24.741 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:24.741 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.069 ms 00:25:24.741 00:25:24.741 --- 10.0.0.1 ping statistics --- 00:25:24.741 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:24.741 rtt min/avg/max/mdev = 0.069/0.069/0.069/0.000 ms 00:25:24.741 17:01:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:24.741 17:01:10 -- nvmf/common.sh@410 -- # return 0 00:25:24.741 17:01:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:24.741 17:01:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:24.741 17:01:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:24.741 17:01:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:24.741 17:01:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:24.741 17:01:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:24.741 17:01:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:24.741 17:01:10 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:24.741 17:01:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:24.741 17:01:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:24.741 17:01:10 -- common/autotest_common.sh@10 -- # set +x 00:25:24.741 17:01:10 -- nvmf/common.sh@469 -- # nvmfpid=1274693 00:25:24.741 17:01:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:24.741 17:01:10 -- nvmf/common.sh@470 -- # waitforlisten 1274693 00:25:24.741 17:01:10 -- common/autotest_common.sh@829 -- # '[' -z 1274693 ']' 00:25:24.741 17:01:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:24.741 17:01:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:24.741 17:01:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:24.741 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:24.741 17:01:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:24.741 17:01:10 -- common/autotest_common.sh@10 -- # set +x 00:25:24.741 [2024-11-16 17:01:10.310917] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:24.741 [2024-11-16 17:01:10.310996] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:24.741 EAL: No free 2048 kB hugepages reported on node 1 00:25:24.741 [2024-11-16 17:01:10.379109] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:24.741 [2024-11-16 17:01:10.468523] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:24.741 [2024-11-16 17:01:10.468697] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:24.741 [2024-11-16 17:01:10.468719] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:24.741 [2024-11-16 17:01:10.468733] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:24.741 [2024-11-16 17:01:10.468812] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:24.741 [2024-11-16 17:01:10.468866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:24.741 [2024-11-16 17:01:10.472635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:24.741 [2024-11-16 17:01:10.472648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:25.676 17:01:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:25.676 17:01:11 -- common/autotest_common.sh@862 -- # return 0 00:25:25.676 17:01:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:25.676 17:01:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:25.676 17:01:11 -- common/autotest_common.sh@10 -- # set +x 00:25:25.676 17:01:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:25.676 17:01:11 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:25.676 17:01:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.676 17:01:11 -- common/autotest_common.sh@10 -- # set +x 00:25:25.676 [2024-11-16 17:01:11.325330] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:25.676 17:01:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.676 17:01:11 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:25.676 17:01:11 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:25.676 17:01:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:25.676 17:01:11 -- common/autotest_common.sh@10 -- # set +x 00:25:25.676 17:01:11 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:25.676 17:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.676 17:01:11 -- target/shutdown.sh@28 -- # cat 00:25:25.676 17:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.676 17:01:11 -- target/shutdown.sh@28 -- # cat 00:25:25.676 17:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.676 17:01:11 -- target/shutdown.sh@28 -- # cat 00:25:25.676 17:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.676 17:01:11 -- target/shutdown.sh@28 -- # cat 00:25:25.676 17:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.676 17:01:11 -- target/shutdown.sh@28 -- # cat 00:25:25.676 17:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.676 17:01:11 -- target/shutdown.sh@28 -- # cat 00:25:25.676 17:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.676 17:01:11 -- target/shutdown.sh@28 -- # cat 00:25:25.676 17:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.676 17:01:11 -- target/shutdown.sh@28 -- # cat 00:25:25.676 17:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.676 17:01:11 -- target/shutdown.sh@28 -- # cat 00:25:25.676 17:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.676 17:01:11 -- target/shutdown.sh@28 -- # cat 00:25:25.676 17:01:11 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:25.676 17:01:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.676 17:01:11 -- common/autotest_common.sh@10 -- # set +x 00:25:25.676 Malloc1 00:25:25.676 [2024-11-16 17:01:11.409481] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:25.934 Malloc2 00:25:25.934 Malloc3 00:25:25.934 Malloc4 00:25:25.934 Malloc5 00:25:25.934 Malloc6 00:25:25.934 Malloc7 00:25:26.195 Malloc8 00:25:26.195 Malloc9 00:25:26.195 Malloc10 00:25:26.195 17:01:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.195 17:01:11 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:26.195 17:01:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:26.195 17:01:11 -- common/autotest_common.sh@10 -- # set +x 00:25:26.195 17:01:11 -- target/shutdown.sh@102 -- # perfpid=1274880 00:25:26.195 17:01:11 -- target/shutdown.sh@103 -- # waitforlisten 1274880 /var/tmp/bdevperf.sock 00:25:26.195 17:01:11 -- common/autotest_common.sh@829 -- # '[' -z 1274880 ']' 00:25:26.195 17:01:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:26.195 17:01:11 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:26.195 17:01:11 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:26.195 17:01:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:26.195 17:01:11 -- nvmf/common.sh@520 -- # config=() 00:25:26.195 17:01:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:26.195 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:26.195 17:01:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:26.195 17:01:11 -- nvmf/common.sh@520 -- # local subsystem config 00:25:26.195 17:01:11 -- common/autotest_common.sh@10 -- # set +x 00:25:26.195 17:01:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.195 17:01:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.195 { 00:25:26.195 "params": { 00:25:26.195 "name": "Nvme$subsystem", 00:25:26.195 "trtype": "$TEST_TRANSPORT", 00:25:26.195 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.195 "adrfam": "ipv4", 00:25:26.195 "trsvcid": "$NVMF_PORT", 00:25:26.195 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.195 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.195 "hdgst": ${hdgst:-false}, 00:25:26.195 "ddgst": ${ddgst:-false} 00:25:26.195 }, 00:25:26.195 "method": "bdev_nvme_attach_controller" 00:25:26.195 } 00:25:26.195 EOF 00:25:26.195 )") 00:25:26.195 17:01:11 -- nvmf/common.sh@542 -- # cat 00:25:26.195 17:01:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.195 17:01:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.195 { 00:25:26.195 "params": { 00:25:26.195 "name": "Nvme$subsystem", 00:25:26.195 "trtype": "$TEST_TRANSPORT", 00:25:26.195 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.195 "adrfam": "ipv4", 00:25:26.195 "trsvcid": "$NVMF_PORT", 00:25:26.195 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.195 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.195 "hdgst": ${hdgst:-false}, 00:25:26.195 "ddgst": ${ddgst:-false} 00:25:26.195 }, 00:25:26.195 "method": "bdev_nvme_attach_controller" 00:25:26.195 } 00:25:26.195 EOF 00:25:26.195 )") 00:25:26.195 17:01:11 -- nvmf/common.sh@542 -- # cat 00:25:26.195 17:01:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.195 17:01:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.195 { 00:25:26.195 "params": { 00:25:26.195 "name": "Nvme$subsystem", 00:25:26.195 "trtype": "$TEST_TRANSPORT", 00:25:26.195 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.195 "adrfam": "ipv4", 00:25:26.195 "trsvcid": "$NVMF_PORT", 00:25:26.195 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.195 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.195 "hdgst": ${hdgst:-false}, 00:25:26.195 "ddgst": ${ddgst:-false} 00:25:26.195 }, 00:25:26.195 "method": "bdev_nvme_attach_controller" 00:25:26.195 } 00:25:26.195 EOF 00:25:26.195 )") 00:25:26.195 17:01:11 -- nvmf/common.sh@542 -- # cat 00:25:26.195 17:01:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.195 17:01:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.195 { 00:25:26.195 "params": { 00:25:26.195 "name": "Nvme$subsystem", 00:25:26.195 "trtype": "$TEST_TRANSPORT", 00:25:26.195 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.195 "adrfam": "ipv4", 00:25:26.195 "trsvcid": "$NVMF_PORT", 00:25:26.195 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.195 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.195 "hdgst": ${hdgst:-false}, 00:25:26.195 "ddgst": ${ddgst:-false} 00:25:26.195 }, 00:25:26.195 "method": "bdev_nvme_attach_controller" 00:25:26.195 } 00:25:26.195 EOF 00:25:26.195 )") 00:25:26.195 17:01:11 -- nvmf/common.sh@542 -- # cat 00:25:26.195 17:01:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.195 17:01:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.195 { 00:25:26.195 "params": { 00:25:26.195 "name": "Nvme$subsystem", 00:25:26.195 "trtype": "$TEST_TRANSPORT", 00:25:26.195 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.195 "adrfam": "ipv4", 00:25:26.195 "trsvcid": "$NVMF_PORT", 00:25:26.195 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.195 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.195 "hdgst": ${hdgst:-false}, 00:25:26.195 "ddgst": ${ddgst:-false} 00:25:26.195 }, 00:25:26.195 "method": "bdev_nvme_attach_controller" 00:25:26.195 } 00:25:26.195 EOF 00:25:26.195 )") 00:25:26.195 17:01:11 -- nvmf/common.sh@542 -- # cat 00:25:26.195 17:01:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.195 17:01:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.195 { 00:25:26.195 "params": { 00:25:26.195 "name": "Nvme$subsystem", 00:25:26.195 "trtype": "$TEST_TRANSPORT", 00:25:26.195 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.195 "adrfam": "ipv4", 00:25:26.195 "trsvcid": "$NVMF_PORT", 00:25:26.195 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.195 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.195 "hdgst": ${hdgst:-false}, 00:25:26.195 "ddgst": ${ddgst:-false} 00:25:26.195 }, 00:25:26.195 "method": "bdev_nvme_attach_controller" 00:25:26.195 } 00:25:26.195 EOF 00:25:26.195 )") 00:25:26.195 17:01:11 -- nvmf/common.sh@542 -- # cat 00:25:26.195 17:01:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.195 17:01:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.195 { 00:25:26.195 "params": { 00:25:26.195 "name": "Nvme$subsystem", 00:25:26.195 "trtype": "$TEST_TRANSPORT", 00:25:26.195 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.195 "adrfam": "ipv4", 00:25:26.195 "trsvcid": "$NVMF_PORT", 00:25:26.195 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.195 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.195 "hdgst": ${hdgst:-false}, 00:25:26.195 "ddgst": ${ddgst:-false} 00:25:26.195 }, 00:25:26.195 "method": "bdev_nvme_attach_controller" 00:25:26.195 } 00:25:26.195 EOF 00:25:26.195 )") 00:25:26.195 17:01:11 -- nvmf/common.sh@542 -- # cat 00:25:26.196 17:01:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.196 17:01:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.196 { 00:25:26.196 "params": { 00:25:26.196 "name": "Nvme$subsystem", 00:25:26.196 "trtype": "$TEST_TRANSPORT", 00:25:26.196 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.196 "adrfam": "ipv4", 00:25:26.196 "trsvcid": "$NVMF_PORT", 00:25:26.196 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.196 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.196 "hdgst": ${hdgst:-false}, 00:25:26.196 "ddgst": ${ddgst:-false} 00:25:26.196 }, 00:25:26.196 "method": "bdev_nvme_attach_controller" 00:25:26.196 } 00:25:26.196 EOF 00:25:26.196 )") 00:25:26.196 17:01:11 -- nvmf/common.sh@542 -- # cat 00:25:26.196 17:01:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.196 17:01:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.196 { 00:25:26.196 "params": { 00:25:26.196 "name": "Nvme$subsystem", 00:25:26.196 "trtype": "$TEST_TRANSPORT", 00:25:26.196 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.196 "adrfam": "ipv4", 00:25:26.196 "trsvcid": "$NVMF_PORT", 00:25:26.196 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.196 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.196 "hdgst": ${hdgst:-false}, 00:25:26.196 "ddgst": ${ddgst:-false} 00:25:26.196 }, 00:25:26.196 "method": "bdev_nvme_attach_controller" 00:25:26.196 } 00:25:26.196 EOF 00:25:26.196 )") 00:25:26.196 17:01:11 -- nvmf/common.sh@542 -- # cat 00:25:26.196 17:01:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.196 17:01:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.196 { 00:25:26.196 "params": { 00:25:26.196 "name": "Nvme$subsystem", 00:25:26.196 "trtype": "$TEST_TRANSPORT", 00:25:26.196 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.196 "adrfam": "ipv4", 00:25:26.196 "trsvcid": "$NVMF_PORT", 00:25:26.196 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.196 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.196 "hdgst": ${hdgst:-false}, 00:25:26.196 "ddgst": ${ddgst:-false} 00:25:26.196 }, 00:25:26.196 "method": "bdev_nvme_attach_controller" 00:25:26.196 } 00:25:26.196 EOF 00:25:26.196 )") 00:25:26.196 17:01:11 -- nvmf/common.sh@542 -- # cat 00:25:26.196 17:01:11 -- nvmf/common.sh@544 -- # jq . 00:25:26.196 17:01:11 -- nvmf/common.sh@545 -- # IFS=, 00:25:26.196 17:01:11 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:26.196 "params": { 00:25:26.196 "name": "Nvme1", 00:25:26.196 "trtype": "tcp", 00:25:26.196 "traddr": "10.0.0.2", 00:25:26.196 "adrfam": "ipv4", 00:25:26.196 "trsvcid": "4420", 00:25:26.196 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:26.196 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:26.196 "hdgst": false, 00:25:26.196 "ddgst": false 00:25:26.196 }, 00:25:26.196 "method": "bdev_nvme_attach_controller" 00:25:26.196 },{ 00:25:26.196 "params": { 00:25:26.196 "name": "Nvme2", 00:25:26.196 "trtype": "tcp", 00:25:26.196 "traddr": "10.0.0.2", 00:25:26.196 "adrfam": "ipv4", 00:25:26.196 "trsvcid": "4420", 00:25:26.196 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:26.196 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:26.196 "hdgst": false, 00:25:26.196 "ddgst": false 00:25:26.196 }, 00:25:26.196 "method": "bdev_nvme_attach_controller" 00:25:26.196 },{ 00:25:26.196 "params": { 00:25:26.196 "name": "Nvme3", 00:25:26.196 "trtype": "tcp", 00:25:26.196 "traddr": "10.0.0.2", 00:25:26.196 "adrfam": "ipv4", 00:25:26.196 "trsvcid": "4420", 00:25:26.196 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:26.196 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:26.196 "hdgst": false, 00:25:26.196 "ddgst": false 00:25:26.196 }, 00:25:26.196 "method": "bdev_nvme_attach_controller" 00:25:26.196 },{ 00:25:26.196 "params": { 00:25:26.196 "name": "Nvme4", 00:25:26.196 "trtype": "tcp", 00:25:26.196 "traddr": "10.0.0.2", 00:25:26.196 "adrfam": "ipv4", 00:25:26.196 "trsvcid": "4420", 00:25:26.196 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:26.196 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:26.196 "hdgst": false, 00:25:26.196 "ddgst": false 00:25:26.196 }, 00:25:26.196 "method": "bdev_nvme_attach_controller" 00:25:26.196 },{ 00:25:26.196 "params": { 00:25:26.196 "name": "Nvme5", 00:25:26.196 "trtype": "tcp", 00:25:26.196 "traddr": "10.0.0.2", 00:25:26.196 "adrfam": "ipv4", 00:25:26.196 "trsvcid": "4420", 00:25:26.196 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:26.196 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:26.196 "hdgst": false, 00:25:26.196 "ddgst": false 00:25:26.196 }, 00:25:26.196 "method": "bdev_nvme_attach_controller" 00:25:26.196 },{ 00:25:26.196 "params": { 00:25:26.196 "name": "Nvme6", 00:25:26.196 "trtype": "tcp", 00:25:26.196 "traddr": "10.0.0.2", 00:25:26.196 "adrfam": "ipv4", 00:25:26.196 "trsvcid": "4420", 00:25:26.196 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:26.196 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:26.196 "hdgst": false, 00:25:26.196 "ddgst": false 00:25:26.196 }, 00:25:26.196 "method": "bdev_nvme_attach_controller" 00:25:26.196 },{ 00:25:26.196 "params": { 00:25:26.196 "name": "Nvme7", 00:25:26.196 "trtype": "tcp", 00:25:26.196 "traddr": "10.0.0.2", 00:25:26.196 "adrfam": "ipv4", 00:25:26.196 "trsvcid": "4420", 00:25:26.196 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:26.196 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:26.196 "hdgst": false, 00:25:26.196 "ddgst": false 00:25:26.196 }, 00:25:26.196 "method": "bdev_nvme_attach_controller" 00:25:26.196 },{ 00:25:26.196 "params": { 00:25:26.196 "name": "Nvme8", 00:25:26.196 "trtype": "tcp", 00:25:26.196 "traddr": "10.0.0.2", 00:25:26.196 "adrfam": "ipv4", 00:25:26.196 "trsvcid": "4420", 00:25:26.196 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:26.196 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:26.196 "hdgst": false, 00:25:26.196 "ddgst": false 00:25:26.196 }, 00:25:26.196 "method": "bdev_nvme_attach_controller" 00:25:26.196 },{ 00:25:26.196 "params": { 00:25:26.196 "name": "Nvme9", 00:25:26.196 "trtype": "tcp", 00:25:26.196 "traddr": "10.0.0.2", 00:25:26.196 "adrfam": "ipv4", 00:25:26.196 "trsvcid": "4420", 00:25:26.196 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:26.196 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:26.196 "hdgst": false, 00:25:26.196 "ddgst": false 00:25:26.196 }, 00:25:26.196 "method": "bdev_nvme_attach_controller" 00:25:26.196 },{ 00:25:26.196 "params": { 00:25:26.196 "name": "Nvme10", 00:25:26.196 "trtype": "tcp", 00:25:26.196 "traddr": "10.0.0.2", 00:25:26.196 "adrfam": "ipv4", 00:25:26.196 "trsvcid": "4420", 00:25:26.196 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:26.196 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:26.196 "hdgst": false, 00:25:26.196 "ddgst": false 00:25:26.196 }, 00:25:26.196 "method": "bdev_nvme_attach_controller" 00:25:26.196 }' 00:25:26.196 [2024-11-16 17:01:11.912766] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:26.196 [2024-11-16 17:01:11.912845] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1274880 ] 00:25:26.489 EAL: No free 2048 kB hugepages reported on node 1 00:25:26.489 [2024-11-16 17:01:11.975822] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:26.489 [2024-11-16 17:01:12.060199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:28.413 Running I/O for 10 seconds... 00:25:28.671 17:01:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:28.671 17:01:14 -- common/autotest_common.sh@862 -- # return 0 00:25:28.671 17:01:14 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:28.671 17:01:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.671 17:01:14 -- common/autotest_common.sh@10 -- # set +x 00:25:28.929 17:01:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.929 17:01:14 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:28.929 17:01:14 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:28.929 17:01:14 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:28.929 17:01:14 -- target/shutdown.sh@57 -- # local ret=1 00:25:28.929 17:01:14 -- target/shutdown.sh@58 -- # local i 00:25:28.929 17:01:14 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:28.929 17:01:14 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:28.929 17:01:14 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:28.929 17:01:14 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:28.929 17:01:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.929 17:01:14 -- common/autotest_common.sh@10 -- # set +x 00:25:28.929 17:01:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.929 17:01:14 -- target/shutdown.sh@60 -- # read_io_count=211 00:25:28.929 17:01:14 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:25:28.929 17:01:14 -- target/shutdown.sh@64 -- # ret=0 00:25:28.929 17:01:14 -- target/shutdown.sh@65 -- # break 00:25:28.929 17:01:14 -- target/shutdown.sh@69 -- # return 0 00:25:28.929 17:01:14 -- target/shutdown.sh@109 -- # killprocess 1274880 00:25:28.929 17:01:14 -- common/autotest_common.sh@936 -- # '[' -z 1274880 ']' 00:25:28.929 17:01:14 -- common/autotest_common.sh@940 -- # kill -0 1274880 00:25:28.929 17:01:14 -- common/autotest_common.sh@941 -- # uname 00:25:28.929 17:01:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:28.930 17:01:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1274880 00:25:28.930 17:01:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:28.930 17:01:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:28.930 17:01:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1274880' 00:25:28.930 killing process with pid 1274880 00:25:28.930 17:01:14 -- common/autotest_common.sh@955 -- # kill 1274880 00:25:28.930 17:01:14 -- common/autotest_common.sh@960 -- # wait 1274880 00:25:28.930 Received shutdown signal, test time was about 0.745852 seconds 00:25:28.930 00:25:28.930 Latency(us) 00:25:28.930 [2024-11-16T16:01:14.680Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:28.930 [2024-11-16T16:01:14.680Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.930 Verification LBA range: start 0x0 length 0x400 00:25:28.930 Nvme1n1 : 0.74 427.55 26.72 0.00 0.00 147490.14 9369.22 120392.06 00:25:28.930 [2024-11-16T16:01:14.680Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.930 Verification LBA range: start 0x0 length 0x400 00:25:28.930 Nvme2n1 : 0.74 425.13 26.57 0.00 0.00 146083.68 12913.02 146023.92 00:25:28.930 [2024-11-16T16:01:14.680Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.930 Verification LBA range: start 0x0 length 0x400 00:25:28.930 Nvme3n1 : 0.74 425.95 26.62 0.00 0.00 144859.45 9951.76 117285.17 00:25:28.930 [2024-11-16T16:01:14.680Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.930 Verification LBA range: start 0x0 length 0x400 00:25:28.930 Nvme4n1 : 0.75 422.79 26.42 0.00 0.00 144128.96 12524.66 118061.89 00:25:28.930 [2024-11-16T16:01:14.680Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.930 Verification LBA range: start 0x0 length 0x400 00:25:28.930 Nvme5n1 : 0.71 383.12 23.94 0.00 0.00 154966.40 24272.59 118838.61 00:25:28.930 [2024-11-16T16:01:14.680Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.930 Verification LBA range: start 0x0 length 0x400 00:25:28.930 Nvme6n1 : 0.71 382.39 23.90 0.00 0.00 153480.42 23301.69 118061.89 00:25:28.930 [2024-11-16T16:01:14.680Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.930 Verification LBA range: start 0x0 length 0x400 00:25:28.930 Nvme7n1 : 0.71 380.82 23.80 0.00 0.00 152411.71 23884.23 120392.06 00:25:28.930 [2024-11-16T16:01:14.680Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.930 Verification LBA range: start 0x0 length 0x400 00:25:28.930 Nvme8n1 : 0.72 379.02 23.69 0.00 0.00 151603.94 23884.23 123498.95 00:25:28.930 [2024-11-16T16:01:14.680Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.930 Verification LBA range: start 0x0 length 0x400 00:25:28.930 Nvme9n1 : 0.72 377.25 23.58 0.00 0.00 150724.41 23107.51 123498.95 00:25:28.930 [2024-11-16T16:01:14.680Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.930 Verification LBA range: start 0x0 length 0x400 00:25:28.930 Nvme10n1 : 0.72 375.84 23.49 0.00 0.00 149737.09 22136.60 124275.67 00:25:28.930 [2024-11-16T16:01:14.680Z] =================================================================================================================== 00:25:28.930 [2024-11-16T16:01:14.680Z] Total : 3979.84 248.74 0.00 0.00 149315.07 9369.22 146023.92 00:25:29.188 17:01:14 -- target/shutdown.sh@112 -- # sleep 1 00:25:30.122 17:01:15 -- target/shutdown.sh@113 -- # kill -0 1274693 00:25:30.122 17:01:15 -- target/shutdown.sh@115 -- # stoptarget 00:25:30.122 17:01:15 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:30.122 17:01:15 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:30.122 17:01:15 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:30.122 17:01:15 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:30.122 17:01:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:30.122 17:01:15 -- nvmf/common.sh@116 -- # sync 00:25:30.122 17:01:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:30.122 17:01:15 -- nvmf/common.sh@119 -- # set +e 00:25:30.122 17:01:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:30.122 17:01:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:30.122 rmmod nvme_tcp 00:25:30.122 rmmod nvme_fabrics 00:25:30.380 rmmod nvme_keyring 00:25:30.380 17:01:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:30.380 17:01:15 -- nvmf/common.sh@123 -- # set -e 00:25:30.380 17:01:15 -- nvmf/common.sh@124 -- # return 0 00:25:30.380 17:01:15 -- nvmf/common.sh@477 -- # '[' -n 1274693 ']' 00:25:30.380 17:01:15 -- nvmf/common.sh@478 -- # killprocess 1274693 00:25:30.380 17:01:15 -- common/autotest_common.sh@936 -- # '[' -z 1274693 ']' 00:25:30.380 17:01:15 -- common/autotest_common.sh@940 -- # kill -0 1274693 00:25:30.380 17:01:15 -- common/autotest_common.sh@941 -- # uname 00:25:30.380 17:01:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:30.380 17:01:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1274693 00:25:30.380 17:01:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:30.380 17:01:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:30.380 17:01:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1274693' 00:25:30.380 killing process with pid 1274693 00:25:30.380 17:01:15 -- common/autotest_common.sh@955 -- # kill 1274693 00:25:30.380 17:01:15 -- common/autotest_common.sh@960 -- # wait 1274693 00:25:30.946 17:01:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:30.946 17:01:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:30.946 17:01:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:30.946 17:01:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:30.946 17:01:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:30.946 17:01:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:30.946 17:01:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:30.946 17:01:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:32.847 17:01:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:32.847 00:25:32.847 real 0m8.402s 00:25:32.847 user 0m26.922s 00:25:32.847 sys 0m1.484s 00:25:32.847 17:01:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:32.847 17:01:18 -- common/autotest_common.sh@10 -- # set +x 00:25:32.847 ************************************ 00:25:32.847 END TEST nvmf_shutdown_tc2 00:25:32.847 ************************************ 00:25:32.847 17:01:18 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:32.847 17:01:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:32.847 17:01:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:32.847 17:01:18 -- common/autotest_common.sh@10 -- # set +x 00:25:32.847 ************************************ 00:25:32.847 START TEST nvmf_shutdown_tc3 00:25:32.847 ************************************ 00:25:32.847 17:01:18 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:32.847 17:01:18 -- target/shutdown.sh@120 -- # starttarget 00:25:32.847 17:01:18 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:32.847 17:01:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:32.847 17:01:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:32.847 17:01:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:32.847 17:01:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:32.847 17:01:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:32.847 17:01:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:32.847 17:01:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:32.847 17:01:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:32.847 17:01:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:32.847 17:01:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:32.847 17:01:18 -- common/autotest_common.sh@10 -- # set +x 00:25:32.847 17:01:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:32.847 17:01:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:32.847 17:01:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:32.847 17:01:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:32.847 17:01:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:32.847 17:01:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:32.847 17:01:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:32.847 17:01:18 -- nvmf/common.sh@294 -- # net_devs=() 00:25:32.847 17:01:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:32.847 17:01:18 -- nvmf/common.sh@295 -- # e810=() 00:25:32.847 17:01:18 -- nvmf/common.sh@295 -- # local -ga e810 00:25:32.847 17:01:18 -- nvmf/common.sh@296 -- # x722=() 00:25:32.847 17:01:18 -- nvmf/common.sh@296 -- # local -ga x722 00:25:32.847 17:01:18 -- nvmf/common.sh@297 -- # mlx=() 00:25:32.847 17:01:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:32.847 17:01:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:32.847 17:01:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:32.847 17:01:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:32.847 17:01:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:32.847 17:01:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:32.847 17:01:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:32.847 17:01:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:32.847 17:01:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:32.847 17:01:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:32.847 17:01:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:32.847 17:01:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:32.847 17:01:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:32.847 17:01:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:32.847 17:01:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:32.847 17:01:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:32.847 17:01:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:32.847 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:32.847 17:01:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:32.847 17:01:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:32.847 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:32.847 17:01:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:32.847 17:01:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:32.847 17:01:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:32.847 17:01:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:32.847 17:01:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:32.847 17:01:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:32.847 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:32.847 17:01:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:32.847 17:01:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:32.847 17:01:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:32.847 17:01:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:32.847 17:01:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:32.847 17:01:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:32.847 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:32.847 17:01:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:32.847 17:01:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:32.847 17:01:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:32.847 17:01:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:32.847 17:01:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:32.847 17:01:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:32.847 17:01:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:32.847 17:01:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:32.847 17:01:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:32.847 17:01:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:32.847 17:01:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:32.847 17:01:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:32.847 17:01:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:32.847 17:01:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:32.847 17:01:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:32.847 17:01:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:32.847 17:01:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:32.847 17:01:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:33.106 17:01:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:33.106 17:01:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:33.106 17:01:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:33.106 17:01:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:33.106 17:01:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:33.106 17:01:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:33.106 17:01:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:33.106 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:33.106 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:25:33.106 00:25:33.106 --- 10.0.0.2 ping statistics --- 00:25:33.106 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:33.106 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:25:33.106 17:01:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:33.106 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:33.106 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:25:33.106 00:25:33.106 --- 10.0.0.1 ping statistics --- 00:25:33.106 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:33.106 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:25:33.106 17:01:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:33.106 17:01:18 -- nvmf/common.sh@410 -- # return 0 00:25:33.106 17:01:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:33.106 17:01:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:33.107 17:01:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:33.107 17:01:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:33.107 17:01:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:33.107 17:01:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:33.107 17:01:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:33.107 17:01:18 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:33.107 17:01:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:33.107 17:01:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:33.107 17:01:18 -- common/autotest_common.sh@10 -- # set +x 00:25:33.107 17:01:18 -- nvmf/common.sh@469 -- # nvmfpid=1275813 00:25:33.107 17:01:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:33.107 17:01:18 -- nvmf/common.sh@470 -- # waitforlisten 1275813 00:25:33.107 17:01:18 -- common/autotest_common.sh@829 -- # '[' -z 1275813 ']' 00:25:33.107 17:01:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:33.107 17:01:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:33.107 17:01:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:33.107 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:33.107 17:01:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:33.107 17:01:18 -- common/autotest_common.sh@10 -- # set +x 00:25:33.107 [2024-11-16 17:01:18.745838] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:33.107 [2024-11-16 17:01:18.745906] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:33.107 EAL: No free 2048 kB hugepages reported on node 1 00:25:33.107 [2024-11-16 17:01:18.807142] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:33.365 [2024-11-16 17:01:18.893195] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:33.365 [2024-11-16 17:01:18.893347] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:33.365 [2024-11-16 17:01:18.893364] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:33.365 [2024-11-16 17:01:18.893377] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:33.365 [2024-11-16 17:01:18.893465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:33.365 [2024-11-16 17:01:18.893512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:33.365 [2024-11-16 17:01:18.893573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:33.365 [2024-11-16 17:01:18.893575] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:34.297 17:01:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:34.297 17:01:19 -- common/autotest_common.sh@862 -- # return 0 00:25:34.297 17:01:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:34.297 17:01:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:34.297 17:01:19 -- common/autotest_common.sh@10 -- # set +x 00:25:34.297 17:01:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:34.297 17:01:19 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:34.297 17:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.297 17:01:19 -- common/autotest_common.sh@10 -- # set +x 00:25:34.297 [2024-11-16 17:01:19.792507] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:34.297 17:01:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.297 17:01:19 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:34.297 17:01:19 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:34.297 17:01:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:34.297 17:01:19 -- common/autotest_common.sh@10 -- # set +x 00:25:34.297 17:01:19 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:34.297 17:01:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.297 17:01:19 -- target/shutdown.sh@28 -- # cat 00:25:34.297 17:01:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.297 17:01:19 -- target/shutdown.sh@28 -- # cat 00:25:34.297 17:01:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.297 17:01:19 -- target/shutdown.sh@28 -- # cat 00:25:34.297 17:01:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.297 17:01:19 -- target/shutdown.sh@28 -- # cat 00:25:34.297 17:01:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.297 17:01:19 -- target/shutdown.sh@28 -- # cat 00:25:34.297 17:01:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.297 17:01:19 -- target/shutdown.sh@28 -- # cat 00:25:34.297 17:01:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.297 17:01:19 -- target/shutdown.sh@28 -- # cat 00:25:34.297 17:01:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.297 17:01:19 -- target/shutdown.sh@28 -- # cat 00:25:34.297 17:01:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.297 17:01:19 -- target/shutdown.sh@28 -- # cat 00:25:34.297 17:01:19 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:34.297 17:01:19 -- target/shutdown.sh@28 -- # cat 00:25:34.297 17:01:19 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:34.297 17:01:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.297 17:01:19 -- common/autotest_common.sh@10 -- # set +x 00:25:34.298 Malloc1 00:25:34.298 [2024-11-16 17:01:19.882336] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:34.298 Malloc2 00:25:34.298 Malloc3 00:25:34.298 Malloc4 00:25:34.556 Malloc5 00:25:34.556 Malloc6 00:25:34.556 Malloc7 00:25:34.556 Malloc8 00:25:34.556 Malloc9 00:25:34.815 Malloc10 00:25:34.815 17:01:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.815 17:01:20 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:34.815 17:01:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:34.815 17:01:20 -- common/autotest_common.sh@10 -- # set +x 00:25:34.815 17:01:20 -- target/shutdown.sh@124 -- # perfpid=1276039 00:25:34.815 17:01:20 -- target/shutdown.sh@125 -- # waitforlisten 1276039 /var/tmp/bdevperf.sock 00:25:34.815 17:01:20 -- common/autotest_common.sh@829 -- # '[' -z 1276039 ']' 00:25:34.815 17:01:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:34.815 17:01:20 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:34.815 17:01:20 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:34.815 17:01:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:34.815 17:01:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:34.815 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:34.815 17:01:20 -- nvmf/common.sh@520 -- # config=() 00:25:34.815 17:01:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:34.815 17:01:20 -- nvmf/common.sh@520 -- # local subsystem config 00:25:34.815 17:01:20 -- common/autotest_common.sh@10 -- # set +x 00:25:34.815 17:01:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.815 17:01:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.815 { 00:25:34.815 "params": { 00:25:34.815 "name": "Nvme$subsystem", 00:25:34.815 "trtype": "$TEST_TRANSPORT", 00:25:34.815 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.815 "adrfam": "ipv4", 00:25:34.815 "trsvcid": "$NVMF_PORT", 00:25:34.815 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.815 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.815 "hdgst": ${hdgst:-false}, 00:25:34.815 "ddgst": ${ddgst:-false} 00:25:34.815 }, 00:25:34.815 "method": "bdev_nvme_attach_controller" 00:25:34.815 } 00:25:34.815 EOF 00:25:34.815 )") 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # cat 00:25:34.816 17:01:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.816 { 00:25:34.816 "params": { 00:25:34.816 "name": "Nvme$subsystem", 00:25:34.816 "trtype": "$TEST_TRANSPORT", 00:25:34.816 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.816 "adrfam": "ipv4", 00:25:34.816 "trsvcid": "$NVMF_PORT", 00:25:34.816 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.816 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.816 "hdgst": ${hdgst:-false}, 00:25:34.816 "ddgst": ${ddgst:-false} 00:25:34.816 }, 00:25:34.816 "method": "bdev_nvme_attach_controller" 00:25:34.816 } 00:25:34.816 EOF 00:25:34.816 )") 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # cat 00:25:34.816 17:01:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.816 { 00:25:34.816 "params": { 00:25:34.816 "name": "Nvme$subsystem", 00:25:34.816 "trtype": "$TEST_TRANSPORT", 00:25:34.816 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.816 "adrfam": "ipv4", 00:25:34.816 "trsvcid": "$NVMF_PORT", 00:25:34.816 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.816 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.816 "hdgst": ${hdgst:-false}, 00:25:34.816 "ddgst": ${ddgst:-false} 00:25:34.816 }, 00:25:34.816 "method": "bdev_nvme_attach_controller" 00:25:34.816 } 00:25:34.816 EOF 00:25:34.816 )") 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # cat 00:25:34.816 17:01:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.816 { 00:25:34.816 "params": { 00:25:34.816 "name": "Nvme$subsystem", 00:25:34.816 "trtype": "$TEST_TRANSPORT", 00:25:34.816 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.816 "adrfam": "ipv4", 00:25:34.816 "trsvcid": "$NVMF_PORT", 00:25:34.816 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.816 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.816 "hdgst": ${hdgst:-false}, 00:25:34.816 "ddgst": ${ddgst:-false} 00:25:34.816 }, 00:25:34.816 "method": "bdev_nvme_attach_controller" 00:25:34.816 } 00:25:34.816 EOF 00:25:34.816 )") 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # cat 00:25:34.816 17:01:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.816 { 00:25:34.816 "params": { 00:25:34.816 "name": "Nvme$subsystem", 00:25:34.816 "trtype": "$TEST_TRANSPORT", 00:25:34.816 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.816 "adrfam": "ipv4", 00:25:34.816 "trsvcid": "$NVMF_PORT", 00:25:34.816 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.816 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.816 "hdgst": ${hdgst:-false}, 00:25:34.816 "ddgst": ${ddgst:-false} 00:25:34.816 }, 00:25:34.816 "method": "bdev_nvme_attach_controller" 00:25:34.816 } 00:25:34.816 EOF 00:25:34.816 )") 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # cat 00:25:34.816 17:01:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.816 { 00:25:34.816 "params": { 00:25:34.816 "name": "Nvme$subsystem", 00:25:34.816 "trtype": "$TEST_TRANSPORT", 00:25:34.816 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.816 "adrfam": "ipv4", 00:25:34.816 "trsvcid": "$NVMF_PORT", 00:25:34.816 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.816 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.816 "hdgst": ${hdgst:-false}, 00:25:34.816 "ddgst": ${ddgst:-false} 00:25:34.816 }, 00:25:34.816 "method": "bdev_nvme_attach_controller" 00:25:34.816 } 00:25:34.816 EOF 00:25:34.816 )") 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # cat 00:25:34.816 17:01:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.816 { 00:25:34.816 "params": { 00:25:34.816 "name": "Nvme$subsystem", 00:25:34.816 "trtype": "$TEST_TRANSPORT", 00:25:34.816 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.816 "adrfam": "ipv4", 00:25:34.816 "trsvcid": "$NVMF_PORT", 00:25:34.816 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.816 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.816 "hdgst": ${hdgst:-false}, 00:25:34.816 "ddgst": ${ddgst:-false} 00:25:34.816 }, 00:25:34.816 "method": "bdev_nvme_attach_controller" 00:25:34.816 } 00:25:34.816 EOF 00:25:34.816 )") 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # cat 00:25:34.816 17:01:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.816 { 00:25:34.816 "params": { 00:25:34.816 "name": "Nvme$subsystem", 00:25:34.816 "trtype": "$TEST_TRANSPORT", 00:25:34.816 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.816 "adrfam": "ipv4", 00:25:34.816 "trsvcid": "$NVMF_PORT", 00:25:34.816 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.816 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.816 "hdgst": ${hdgst:-false}, 00:25:34.816 "ddgst": ${ddgst:-false} 00:25:34.816 }, 00:25:34.816 "method": "bdev_nvme_attach_controller" 00:25:34.816 } 00:25:34.816 EOF 00:25:34.816 )") 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # cat 00:25:34.816 17:01:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.816 { 00:25:34.816 "params": { 00:25:34.816 "name": "Nvme$subsystem", 00:25:34.816 "trtype": "$TEST_TRANSPORT", 00:25:34.816 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.816 "adrfam": "ipv4", 00:25:34.816 "trsvcid": "$NVMF_PORT", 00:25:34.816 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.816 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.816 "hdgst": ${hdgst:-false}, 00:25:34.816 "ddgst": ${ddgst:-false} 00:25:34.816 }, 00:25:34.816 "method": "bdev_nvme_attach_controller" 00:25:34.816 } 00:25:34.816 EOF 00:25:34.816 )") 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # cat 00:25:34.816 17:01:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.816 { 00:25:34.816 "params": { 00:25:34.816 "name": "Nvme$subsystem", 00:25:34.816 "trtype": "$TEST_TRANSPORT", 00:25:34.816 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.816 "adrfam": "ipv4", 00:25:34.816 "trsvcid": "$NVMF_PORT", 00:25:34.816 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.816 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.816 "hdgst": ${hdgst:-false}, 00:25:34.816 "ddgst": ${ddgst:-false} 00:25:34.816 }, 00:25:34.816 "method": "bdev_nvme_attach_controller" 00:25:34.816 } 00:25:34.816 EOF 00:25:34.816 )") 00:25:34.816 17:01:20 -- nvmf/common.sh@542 -- # cat 00:25:34.816 17:01:20 -- nvmf/common.sh@544 -- # jq . 00:25:34.816 17:01:20 -- nvmf/common.sh@545 -- # IFS=, 00:25:34.816 17:01:20 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:34.816 "params": { 00:25:34.816 "name": "Nvme1", 00:25:34.816 "trtype": "tcp", 00:25:34.816 "traddr": "10.0.0.2", 00:25:34.816 "adrfam": "ipv4", 00:25:34.816 "trsvcid": "4420", 00:25:34.816 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:34.816 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:34.816 "hdgst": false, 00:25:34.816 "ddgst": false 00:25:34.816 }, 00:25:34.816 "method": "bdev_nvme_attach_controller" 00:25:34.816 },{ 00:25:34.816 "params": { 00:25:34.816 "name": "Nvme2", 00:25:34.816 "trtype": "tcp", 00:25:34.816 "traddr": "10.0.0.2", 00:25:34.816 "adrfam": "ipv4", 00:25:34.816 "trsvcid": "4420", 00:25:34.816 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:34.816 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:34.817 "hdgst": false, 00:25:34.817 "ddgst": false 00:25:34.817 }, 00:25:34.817 "method": "bdev_nvme_attach_controller" 00:25:34.817 },{ 00:25:34.817 "params": { 00:25:34.817 "name": "Nvme3", 00:25:34.817 "trtype": "tcp", 00:25:34.817 "traddr": "10.0.0.2", 00:25:34.817 "adrfam": "ipv4", 00:25:34.817 "trsvcid": "4420", 00:25:34.817 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:34.817 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:34.817 "hdgst": false, 00:25:34.817 "ddgst": false 00:25:34.817 }, 00:25:34.817 "method": "bdev_nvme_attach_controller" 00:25:34.817 },{ 00:25:34.817 "params": { 00:25:34.817 "name": "Nvme4", 00:25:34.817 "trtype": "tcp", 00:25:34.817 "traddr": "10.0.0.2", 00:25:34.817 "adrfam": "ipv4", 00:25:34.817 "trsvcid": "4420", 00:25:34.817 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:34.817 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:34.817 "hdgst": false, 00:25:34.817 "ddgst": false 00:25:34.817 }, 00:25:34.817 "method": "bdev_nvme_attach_controller" 00:25:34.817 },{ 00:25:34.817 "params": { 00:25:34.817 "name": "Nvme5", 00:25:34.817 "trtype": "tcp", 00:25:34.817 "traddr": "10.0.0.2", 00:25:34.817 "adrfam": "ipv4", 00:25:34.817 "trsvcid": "4420", 00:25:34.817 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:34.817 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:34.817 "hdgst": false, 00:25:34.817 "ddgst": false 00:25:34.817 }, 00:25:34.817 "method": "bdev_nvme_attach_controller" 00:25:34.817 },{ 00:25:34.817 "params": { 00:25:34.817 "name": "Nvme6", 00:25:34.817 "trtype": "tcp", 00:25:34.817 "traddr": "10.0.0.2", 00:25:34.817 "adrfam": "ipv4", 00:25:34.817 "trsvcid": "4420", 00:25:34.817 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:34.817 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:34.817 "hdgst": false, 00:25:34.817 "ddgst": false 00:25:34.817 }, 00:25:34.817 "method": "bdev_nvme_attach_controller" 00:25:34.817 },{ 00:25:34.817 "params": { 00:25:34.817 "name": "Nvme7", 00:25:34.817 "trtype": "tcp", 00:25:34.817 "traddr": "10.0.0.2", 00:25:34.817 "adrfam": "ipv4", 00:25:34.817 "trsvcid": "4420", 00:25:34.817 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:34.817 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:34.817 "hdgst": false, 00:25:34.817 "ddgst": false 00:25:34.817 }, 00:25:34.817 "method": "bdev_nvme_attach_controller" 00:25:34.817 },{ 00:25:34.817 "params": { 00:25:34.817 "name": "Nvme8", 00:25:34.817 "trtype": "tcp", 00:25:34.817 "traddr": "10.0.0.2", 00:25:34.817 "adrfam": "ipv4", 00:25:34.817 "trsvcid": "4420", 00:25:34.817 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:34.817 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:34.817 "hdgst": false, 00:25:34.817 "ddgst": false 00:25:34.817 }, 00:25:34.817 "method": "bdev_nvme_attach_controller" 00:25:34.817 },{ 00:25:34.817 "params": { 00:25:34.817 "name": "Nvme9", 00:25:34.817 "trtype": "tcp", 00:25:34.817 "traddr": "10.0.0.2", 00:25:34.817 "adrfam": "ipv4", 00:25:34.817 "trsvcid": "4420", 00:25:34.817 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:34.817 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:34.817 "hdgst": false, 00:25:34.817 "ddgst": false 00:25:34.817 }, 00:25:34.817 "method": "bdev_nvme_attach_controller" 00:25:34.817 },{ 00:25:34.817 "params": { 00:25:34.817 "name": "Nvme10", 00:25:34.817 "trtype": "tcp", 00:25:34.817 "traddr": "10.0.0.2", 00:25:34.817 "adrfam": "ipv4", 00:25:34.817 "trsvcid": "4420", 00:25:34.817 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:34.817 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:34.817 "hdgst": false, 00:25:34.817 "ddgst": false 00:25:34.817 }, 00:25:34.817 "method": "bdev_nvme_attach_controller" 00:25:34.817 }' 00:25:34.817 [2024-11-16 17:01:20.399377] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:34.817 [2024-11-16 17:01:20.399456] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1276039 ] 00:25:34.817 EAL: No free 2048 kB hugepages reported on node 1 00:25:34.817 [2024-11-16 17:01:20.465024] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:34.817 [2024-11-16 17:01:20.551183] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:36.714 Running I/O for 10 seconds... 00:25:37.289 17:01:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:37.289 17:01:22 -- common/autotest_common.sh@862 -- # return 0 00:25:37.289 17:01:22 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:37.289 17:01:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.289 17:01:22 -- common/autotest_common.sh@10 -- # set +x 00:25:37.289 17:01:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.289 17:01:22 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:37.289 17:01:22 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:37.289 17:01:22 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:37.289 17:01:22 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:37.289 17:01:22 -- target/shutdown.sh@57 -- # local ret=1 00:25:37.289 17:01:22 -- target/shutdown.sh@58 -- # local i 00:25:37.289 17:01:22 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:37.289 17:01:22 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:37.289 17:01:22 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:37.289 17:01:22 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:37.289 17:01:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.289 17:01:22 -- common/autotest_common.sh@10 -- # set +x 00:25:37.289 17:01:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.289 17:01:22 -- target/shutdown.sh@60 -- # read_io_count=254 00:25:37.289 17:01:22 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:25:37.289 17:01:22 -- target/shutdown.sh@64 -- # ret=0 00:25:37.289 17:01:22 -- target/shutdown.sh@65 -- # break 00:25:37.289 17:01:22 -- target/shutdown.sh@69 -- # return 0 00:25:37.289 17:01:22 -- target/shutdown.sh@134 -- # killprocess 1275813 00:25:37.289 17:01:22 -- common/autotest_common.sh@936 -- # '[' -z 1275813 ']' 00:25:37.289 17:01:22 -- common/autotest_common.sh@940 -- # kill -0 1275813 00:25:37.289 17:01:22 -- common/autotest_common.sh@941 -- # uname 00:25:37.289 17:01:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:37.289 17:01:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1275813 00:25:37.289 17:01:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:37.289 17:01:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:37.289 17:01:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1275813' 00:25:37.289 killing process with pid 1275813 00:25:37.289 17:01:23 -- common/autotest_common.sh@955 -- # kill 1275813 00:25:37.289 17:01:23 -- common/autotest_common.sh@960 -- # wait 1275813 00:25:37.289 [2024-11-16 17:01:23.002905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.289 [2024-11-16 17:01:23.003071] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.003678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ecfe70 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.007990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.290 [2024-11-16 17:01:23.008208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.008220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.008232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.008244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.008256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.008268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.008284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.008296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.008308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.008321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.008333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.008345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.008357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.008370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.008382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed2820 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.010853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.010879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.010894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.010907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.010919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.010931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.010943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.010957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.010969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.010982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.010994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011324] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.011658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0300 is same with the state(5) to be set 00:25:37.291 [2024-11-16 17:01:23.012588] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.291 [2024-11-16 17:01:23.012636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.291 [2024-11-16 17:01:23.012656] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.291 [2024-11-16 17:01:23.012670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.291 [2024-11-16 17:01:23.012684] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.291 [2024-11-16 17:01:23.012698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.012713] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.292 [2024-11-16 17:01:23.012727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.012740] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe6c240 is same with the state(5) to be set 00:25:37.292 [2024-11-16 17:01:23.012829] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.292 [2024-11-16 17:01:23.012850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.012866] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.292 [2024-11-16 17:01:23.012879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.012893] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.292 [2024-11-16 17:01:23.012905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.012919] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.292 [2024-11-16 17:01:23.012933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.012946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xca4fe0 is same with the state(5) to be set 00:25:37.292 [2024-11-16 17:01:23.012990] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.292 [2024-11-16 17:01:23.013011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.013026] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.292 [2024-11-16 17:01:23.013040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.013054] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.292 [2024-11-16 17:01:23.013067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.013082] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.292 [2024-11-16 17:01:23.013096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.013109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcd1200 is same with the state(5) to be set 00:25:37.292 [2024-11-16 17:01:23.014300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.014981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.014995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.015012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.015027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.015043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.015057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.015072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.015087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.015102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.015116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.015131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.015145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.015160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.015174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.015189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.015203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.292 [2024-11-16 17:01:23.015218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.292 [2024-11-16 17:01:23.015235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.015975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.015997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.016013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.016027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.016043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.016057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.016072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.016085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.016100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.016114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.016129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.016143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.016158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.016171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.016187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.016200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.016216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.016229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.016244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.016258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.016273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.016287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.016823] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xc9c060 was disconnected and freed. reset controller. 00:25:37.293 [2024-11-16 17:01:23.016912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.016933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.016954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.016969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.016990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.017005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.293 [2024-11-16 17:01:23.017022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.293 [2024-11-16 17:01:23.017036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.017971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.017987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.018000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.018015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.294 [2024-11-16 17:01:23.018028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.294 [2024-11-16 17:01:23.018044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with [2024-11-16 17:01:23.018375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:37.295 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with [2024-11-16 17:01:23.018489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:43648 len:1the state(5) to be set 00:25:37.295 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-16 17:01:23.018511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with [2024-11-16 17:01:23.018575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:37.295 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with [2024-11-16 17:01:23.018726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:44544 len:12the state(5) to be set 00:25:37.295 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with [2024-11-16 17:01:23.018745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:37.295 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with [2024-11-16 17:01:23.018855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:45056 len:1the state(5) to be set 00:25:37.295 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.295 [2024-11-16 17:01:23.018881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.295 [2024-11-16 17:01:23.018888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.295 [2024-11-16 17:01:23.018894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.018902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.296 [2024-11-16 17:01:23.018906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.018918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.018924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.296 [2024-11-16 17:01:23.018950] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.018954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.296 [2024-11-16 17:01:23.018962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.018974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.018986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.018998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019043] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xc7cac0 was disconnected and freed. reset controller. 00:25:37.296 [2024-11-16 17:01:23.019055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.019352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed07b0 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:37.296 [2024-11-16 17:01:23.021408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe6c240 (9): Bad file descriptor 00:25:37.296 [2024-11-16 17:01:23.021535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021718] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.021992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.022004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.022016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.022028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.022039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.022051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.022063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.022075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.022087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.296 [2024-11-16 17:01:23.022098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.022114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.022126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.022137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.022149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.022160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.022187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.022199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.022210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.022221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.022233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.022243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.022255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0c40 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.022624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.022651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.022673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.022688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.022704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.022719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.022735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.022749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.022764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.022779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.022794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.022808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.022824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.022838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.022859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.022874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.022889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.022904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.022919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.022933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.022948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.022961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.022977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.022990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.023006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.023019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.023034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.023048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.023050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with [2024-11-16 17:01:23.023064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37248 len:12the state(5) to be set 00:25:37.297 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.023079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.023081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.023097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-16 17:01:23.023110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.023136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.023149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:37888 len:12[2024-11-16 17:01:23.023178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with [2024-11-16 17:01:23.023193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:37.297 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.023207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.023219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.023231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.023244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-16 17:01:23.023256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.023282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.023294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 [2024-11-16 17:01:23.023306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.023319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:41600 len:1[2024-11-16 17:01:23.023332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.297 the state(5) to be set 00:25:37.297 [2024-11-16 17:01:23.023346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with [2024-11-16 17:01:23.023346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:37.297 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.297 [2024-11-16 17:01:23.023366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with [2024-11-16 17:01:23.023428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:41984 len:1the state(5) to be set 00:25:37.298 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with [2024-11-16 17:01:23.023444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:37.298 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-16 17:01:23.023506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with [2024-11-16 17:01:23.023536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:37.298 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:42624 len:1[2024-11-16 17:01:23.023586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with [2024-11-16 17:01:23.023600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:37.298 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:42880 len:1[2024-11-16 17:01:23.023675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with [2024-11-16 17:01:23.023691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:37.298 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed10f0 is same with the state(5) to be set 00:25:37.298 [2024-11-16 17:01:23.023741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.023985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.023999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.024015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.024029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.024045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.298 [2024-11-16 17:01:23.024059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.298 [2024-11-16 17:01:23.024074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:45440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:45568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:45696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:45824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.299 [2024-11-16 17:01:23.024662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.299 [2024-11-16 17:01:23.024726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024758] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe291e0 was disconnected and freed. reset controller. 00:25:37.299 [2024-11-16 17:01:23.024769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024924] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.024988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025324] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.299 [2024-11-16 17:01:23.025360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed15a0 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.025925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:37.300 [2024-11-16 17:01:23.025971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xca4fe0 (9): Bad file descriptor 00:25:37.300 [2024-11-16 17:01:23.026070] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.300 [2024-11-16 17:01:23.026093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.300 [2024-11-16 17:01:23.026109] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.300 [2024-11-16 17:01:23.026123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.300 [2024-11-16 17:01:23.026137] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.300 [2024-11-16 17:01:23.026150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.300 [2024-11-16 17:01:23.026164] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.300 [2024-11-16 17:01:23.026185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.300 [2024-11-16 17:01:23.026199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xccf710 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.026235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcd1200 (9): Bad file descriptor 00:25:37.300 [2024-11-16 17:01:23.026286] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.300 [2024-11-16 17:01:23.026307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.300 [2024-11-16 17:01:23.026322] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.300 [2024-11-16 17:01:23.026336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.300 [2024-11-16 17:01:23.026350] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.300 [2024-11-16 17:01:23.026363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.300 [2024-11-16 17:01:23.026377] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.300 [2024-11-16 17:01:23.026390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.300 [2024-11-16 17:01:23.026403] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4e980 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.026447] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.300 [2024-11-16 17:01:23.026467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.300 [2024-11-16 17:01:23.026484] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.300 [2024-11-16 17:01:23.026498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.300 [2024-11-16 17:01:23.026512] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.300 [2024-11-16 17:01:23.026525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.300 [2024-11-16 17:01:23.026539] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.300 [2024-11-16 17:01:23.026553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.300 [2024-11-16 17:01:23.026566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcf0190 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.026998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027236] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.300 [2024-11-16 17:01:23.027438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027509] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1a50 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.027793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.027817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.027838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.027854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.027876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.027892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.027907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.027922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.027938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.027952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.027968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.027981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.027997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.028674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.301 [2024-11-16 17:01:23.028683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.301 [2024-11-16 17:01:23.028689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.301 [2024-11-16 17:01:23.028698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.028710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.028722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.028747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.028759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.028771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.028784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with [2024-11-16 17:01:23.028797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:42112 len:128the state(5) to be set 00:25:37.302 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.028811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.028823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.028836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-16 17:01:23.028848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.028874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.028887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.028899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-16 17:01:23.028912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.028937] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.028949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.028962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-16 17:01:23.028974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.028989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.028999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.029011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.029024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.029042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.029055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.029067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with [2024-11-16 17:01:23.029080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:43264 len:1the state(5) to be set 00:25:37.302 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.029094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.029107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.029119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.029131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with [2024-11-16 17:01:23.029143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:43520 len:12the state(5) to be set 00:25:37.302 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.029157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.029169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.029181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.029193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.029217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.029230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with [2024-11-16 17:01:23.029242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38912 len:12the state(5) to be set 00:25:37.302 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.302 [2024-11-16 17:01:23.029256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.302 [2024-11-16 17:01:23.029258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.302 [2024-11-16 17:01:23.029267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed1ee0 is same with the state(5) to be set 00:25:37.303 [2024-11-16 17:01:23.029274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.029839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.029933] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xc93d20 was disconnected and freed. reset controller. 00:25:37.303 [2024-11-16 17:01:23.029983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.303 [2024-11-16 17:01:23.030498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.303 [2024-11-16 17:01:23.030512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.304 [2024-11-16 17:01:23.030527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.304 [2024-11-16 17:01:23.030541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.304 [2024-11-16 17:01:23.030556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.304 [2024-11-16 17:01:23.030570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.304 [2024-11-16 17:01:23.030585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.304 [2024-11-16 17:01:23.030599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.304 [2024-11-16 17:01:23.030622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.304 [2024-11-16 17:01:23.030640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.304 [2024-11-16 17:01:23.030657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.304 [2024-11-16 17:01:23.030671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.571 [2024-11-16 17:01:23.030687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.571 [2024-11-16 17:01:23.030701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.571 [2024-11-16 17:01:23.030717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.571 [2024-11-16 17:01:23.030731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.571 [2024-11-16 17:01:23.030747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.030761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.030777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.030791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.030807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.030821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.030836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.030851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.030871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.030886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.030912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.030927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.030943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.030958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.030974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.030988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.572 [2024-11-16 17:01:23.031755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.572 [2024-11-16 17:01:23.031768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.031783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.573 [2024-11-16 17:01:23.031797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.031812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.573 [2024-11-16 17:01:23.031826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.031841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.573 [2024-11-16 17:01:23.031855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.031871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.573 [2024-11-16 17:01:23.031884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.040529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.573 [2024-11-16 17:01:23.040592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.040609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.573 [2024-11-16 17:01:23.040633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.040650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.573 [2024-11-16 17:01:23.040665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.040681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.573 [2024-11-16 17:01:23.040694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.040872] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xc95300 was disconnected and freed. reset controller. 00:25:37.573 [2024-11-16 17:01:23.042503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:37.573 [2024-11-16 17:01:23.042569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xccf710 (9): Bad file descriptor 00:25:37.573 [2024-11-16 17:01:23.042743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.573 [2024-11-16 17:01:23.042847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.573 [2024-11-16 17:01:23.042874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe6c240 with addr=10.0.0.2, port=4420 00:25:37.573 [2024-11-16 17:01:23.042893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe6c240 is same with the state(5) to be set 00:25:37.573 [2024-11-16 17:01:23.042988] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043041] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043074] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043103] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcf6c00 is same with the state(5) to be set 00:25:37.573 [2024-11-16 17:01:23.043183] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043220] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043249] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043276] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe72e80 is same with the state(5) to be set 00:25:37.573 [2024-11-16 17:01:23.043350] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043386] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043414] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043446] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe6c960 is same with the state(5) to be set 00:25:37.573 [2024-11-16 17:01:23.043521] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043559] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043588] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043625] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.573 [2024-11-16 17:01:23.043641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.043655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcfc4f0 is same with the state(5) to be set 00:25:37.573 [2024-11-16 17:01:23.043690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4e980 (9): Bad file descriptor 00:25:37.573 [2024-11-16 17:01:23.043718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcf0190 (9): Bad file descriptor 00:25:37.573 [2024-11-16 17:01:23.043742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe6c240 (9): Bad file descriptor 00:25:37.573 [2024-11-16 17:01:23.044072] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:37.573 [2024-11-16 17:01:23.046439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.573 [2024-11-16 17:01:23.046466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.046492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.573 [2024-11-16 17:01:23.046508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.046525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.573 [2024-11-16 17:01:23.046541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.046558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.573 [2024-11-16 17:01:23.046573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.046589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.573 [2024-11-16 17:01:23.046608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.573 [2024-11-16 17:01:23.046633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.046650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.046666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.046680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.046696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.046710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.046727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.046742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.046758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.046772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.046788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.046802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.046818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.046832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.046848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.046862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.046878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.046893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.046908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.046922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.046939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.046952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.046969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.046983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.574 [2024-11-16 17:01:23.047697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.574 [2024-11-16 17:01:23.047713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.047727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.047743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.047757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.047777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.047792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.047808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.047822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.047838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.047852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.047868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.047882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.047898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.047913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.047929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.047943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.047959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.047974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.047990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048564] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xc97ec0 was disconnected and freed. reset controller. 00:25:37.575 [2024-11-16 17:01:23.048628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.575 [2024-11-16 17:01:23.048960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.575 [2024-11-16 17:01:23.048976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.048990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.576 [2024-11-16 17:01:23.049936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.576 [2024-11-16 17:01:23.049951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.049965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.049981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.049996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050666] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xc994a0 was disconnected and freed. reset controller. 00:25:37.577 [2024-11-16 17:01:23.050728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.577 [2024-11-16 17:01:23.050911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.577 [2024-11-16 17:01:23.050927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.050942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.050957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.050971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.050986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.051450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.051534] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xc9aa80 was disconnected and freed. reset controller. 00:25:37.578 [2024-11-16 17:01:23.051593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:37.578 [2024-11-16 17:01:23.051628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:37.578 [2024-11-16 17:01:23.051847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.578 [2024-11-16 17:01:23.051980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.578 [2024-11-16 17:01:23.052006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xca4fe0 with addr=10.0.0.2, port=4420 00:25:37.578 [2024-11-16 17:01:23.052024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xca4fe0 is same with the state(5) to be set 00:25:37.578 [2024-11-16 17:01:23.052129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.052152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.052173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.052188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.052205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.052220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.052236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.052250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.052266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.052279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.052296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.052310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.052326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.052340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.052356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.052370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.052386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.052400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.052415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.052429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.052445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.052459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.052475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.578 [2024-11-16 17:01:23.052494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.578 [2024-11-16 17:01:23.052510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.052978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.052992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.579 [2024-11-16 17:01:23.053520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.579 [2024-11-16 17:01:23.053533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.053983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.053997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.054013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.054031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.054048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.054063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.054079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.580 [2024-11-16 17:01:23.054093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.580 [2024-11-16 17:01:23.054108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe1ce90 is same with the state(5) to be set 00:25:37.580 [2024-11-16 17:01:23.058879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:37.580 [2024-11-16 17:01:23.058936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:37.580 [2024-11-16 17:01:23.058967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe72e80 (9): Bad file descriptor 00:25:37.580 [2024-11-16 17:01:23.059136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.580 [2024-11-16 17:01:23.059237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.580 [2024-11-16 17:01:23.059263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xccf710 with addr=10.0.0.2, port=4420 00:25:37.580 [2024-11-16 17:01:23.059281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xccf710 is same with the state(5) to be set 00:25:37.580 [2024-11-16 17:01:23.059365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.580 [2024-11-16 17:01:23.059457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.580 [2024-11-16 17:01:23.059482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4e980 with addr=10.0.0.2, port=4420 00:25:37.580 [2024-11-16 17:01:23.059499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4e980 is same with the state(5) to be set 00:25:37.580 [2024-11-16 17:01:23.059598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.580 [2024-11-16 17:01:23.059688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.580 [2024-11-16 17:01:23.059713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcf0190 with addr=10.0.0.2, port=4420 00:25:37.580 [2024-11-16 17:01:23.059730] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcf0190 is same with the state(5) to be set 00:25:37.580 [2024-11-16 17:01:23.059751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xca4fe0 (9): Bad file descriptor 00:25:37.580 [2024-11-16 17:01:23.059771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:37.580 [2024-11-16 17:01:23.059787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:37.580 [2024-11-16 17:01:23.059804] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:37.580 [2024-11-16 17:01:23.059835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcf6c00 (9): Bad file descriptor 00:25:37.580 [2024-11-16 17:01:23.059864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe6c960 (9): Bad file descriptor 00:25:37.580 [2024-11-16 17:01:23.059892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcfc4f0 (9): Bad file descriptor 00:25:37.580 [2024-11-16 17:01:23.059926] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:37.580 [2024-11-16 17:01:23.059959] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:37.580 [2024-11-16 17:01:23.060677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.580 [2024-11-16 17:01:23.060706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:37.580 [2024-11-16 17:01:23.060726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:37.580 [2024-11-16 17:01:23.060826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.580 [2024-11-16 17:01:23.060916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.580 [2024-11-16 17:01:23.060941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcd1200 with addr=10.0.0.2, port=4420 00:25:37.580 [2024-11-16 17:01:23.060958] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcd1200 is same with the state(5) to be set 00:25:37.580 [2024-11-16 17:01:23.060988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xccf710 (9): Bad file descriptor 00:25:37.580 [2024-11-16 17:01:23.061011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4e980 (9): Bad file descriptor 00:25:37.580 [2024-11-16 17:01:23.061030] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcf0190 (9): Bad file descriptor 00:25:37.580 [2024-11-16 17:01:23.061046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:37.580 [2024-11-16 17:01:23.061060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:37.580 [2024-11-16 17:01:23.061075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:37.581 [2024-11-16 17:01:23.061427] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:37.581 [2024-11-16 17:01:23.062218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.581 [2024-11-16 17:01:23.062309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.581 [2024-11-16 17:01:23.062395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.581 [2024-11-16 17:01:23.062421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe72e80 with addr=10.0.0.2, port=4420 00:25:37.581 [2024-11-16 17:01:23.062438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe72e80 is same with the state(5) to be set 00:25:37.581 [2024-11-16 17:01:23.062513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.581 [2024-11-16 17:01:23.062594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.581 [2024-11-16 17:01:23.062625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe6c960 with addr=10.0.0.2, port=4420 00:25:37.581 [2024-11-16 17:01:23.062643] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe6c960 is same with the state(5) to be set 00:25:37.581 [2024-11-16 17:01:23.062719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.581 [2024-11-16 17:01:23.062811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.581 [2024-11-16 17:01:23.062835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcf6c00 with addr=10.0.0.2, port=4420 00:25:37.581 [2024-11-16 17:01:23.062852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcf6c00 is same with the state(5) to be set 00:25:37.581 [2024-11-16 17:01:23.062871] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcd1200 (9): Bad file descriptor 00:25:37.581 [2024-11-16 17:01:23.062888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:37.581 [2024-11-16 17:01:23.062901] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:37.581 [2024-11-16 17:01:23.062926] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:37.581 [2024-11-16 17:01:23.062947] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:37.581 [2024-11-16 17:01:23.062961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:37.581 [2024-11-16 17:01:23.062974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:37.581 [2024-11-16 17:01:23.062991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:37.581 [2024-11-16 17:01:23.063005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:37.581 [2024-11-16 17:01:23.063019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:37.581 [2024-11-16 17:01:23.063039] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:37.581 [2024-11-16 17:01:23.063062] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:37.581 [2024-11-16 17:01:23.063082] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:37.581 [2024-11-16 17:01:23.063185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.581 [2024-11-16 17:01:23.063207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.581 [2024-11-16 17:01:23.063220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.581 [2024-11-16 17:01:23.063236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe72e80 (9): Bad file descriptor 00:25:37.581 [2024-11-16 17:01:23.063255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe6c960 (9): Bad file descriptor 00:25:37.581 [2024-11-16 17:01:23.063274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcf6c00 (9): Bad file descriptor 00:25:37.581 [2024-11-16 17:01:23.063289] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:37.581 [2024-11-16 17:01:23.063303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:37.581 [2024-11-16 17:01:23.063317] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:37.581 [2024-11-16 17:01:23.063391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.581 [2024-11-16 17:01:23.063412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:37.581 [2024-11-16 17:01:23.063425] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:37.581 [2024-11-16 17:01:23.063440] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:37.581 [2024-11-16 17:01:23.063457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:37.581 [2024-11-16 17:01:23.063472] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:37.581 [2024-11-16 17:01:23.063485] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:37.581 [2024-11-16 17:01:23.063501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:37.581 [2024-11-16 17:01:23.063515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:37.581 [2024-11-16 17:01:23.063529] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:37.581 [2024-11-16 17:01:23.063560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.581 [2024-11-16 17:01:23.063578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.581 [2024-11-16 17:01:23.063595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.581 [2024-11-16 17:01:23.069027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.581 [2024-11-16 17:01:23.069084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.581 [2024-11-16 17:01:23.069118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.581 [2024-11-16 17:01:23.069145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.581 [2024-11-16 17:01:23.069164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.581 [2024-11-16 17:01:23.069178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.581 [2024-11-16 17:01:23.069193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.581 [2024-11-16 17:01:23.069207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.581 [2024-11-16 17:01:23.069223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.581 [2024-11-16 17:01:23.069237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.581 [2024-11-16 17:01:23.069254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.581 [2024-11-16 17:01:23.069268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.581 [2024-11-16 17:01:23.069284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.581 [2024-11-16 17:01:23.069298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.581 [2024-11-16 17:01:23.069314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.581 [2024-11-16 17:01:23.069328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.581 [2024-11-16 17:01:23.069344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.581 [2024-11-16 17:01:23.069359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.581 [2024-11-16 17:01:23.069374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.581 [2024-11-16 17:01:23.069389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.581 [2024-11-16 17:01:23.069405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.581 [2024-11-16 17:01:23.069419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.069976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.069990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.070006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.070020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.070036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.070050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.070066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.070081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.070097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.070111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.070127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.070141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.070157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.070171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.070188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.070202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.070217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.070231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.070248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.070262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.070278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.070296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.070313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.070327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.582 [2024-11-16 17:01:23.070344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.582 [2024-11-16 17:01:23.070359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.070980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.070993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.071009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.071023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.071039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.071056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.071072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.583 [2024-11-16 17:01:23.071086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.583 [2024-11-16 17:01:23.071101] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc968e0 is same with the state(5) to be set 00:25:37.583 [2024-11-16 17:01:23.073209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:37.583 [2024-11-16 17:01:23.073241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:37.583 task offset: 34816 on job bdev=Nvme10n1 fails 00:25:37.583 00:25:37.583 Latency(us) 00:25:37.583 [2024-11-16T16:01:23.333Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:37.583 [2024-11-16T16:01:23.333Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.583 [2024-11-16T16:01:23.333Z] Job: Nvme1n1 ended in about 0.81 seconds with error 00:25:37.583 Verification LBA range: start 0x0 length 0x400 00:25:37.583 Nvme1n1 : 0.81 360.61 22.54 79.31 0.00 144547.05 50486.99 118061.89 00:25:37.583 [2024-11-16T16:01:23.333Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.583 [2024-11-16T16:01:23.333Z] Job: Nvme2n1 ended in about 0.84 seconds with error 00:25:37.583 Verification LBA range: start 0x0 length 0x400 00:25:37.583 Nvme2n1 : 0.84 304.92 19.06 76.23 0.00 165389.20 54758.97 147577.36 00:25:37.583 [2024-11-16T16:01:23.333Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.583 [2024-11-16T16:01:23.333Z] Job: Nvme3n1 ended in about 0.81 seconds with error 00:25:37.583 Verification LBA range: start 0x0 length 0x400 00:25:37.583 Nvme3n1 : 0.81 363.22 22.70 78.80 0.00 141214.83 34175.81 129712.73 00:25:37.583 [2024-11-16T16:01:23.333Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.583 [2024-11-16T16:01:23.333Z] Job: Nvme4n1 ended in about 0.83 seconds with error 00:25:37.583 Verification LBA range: start 0x0 length 0x400 00:25:37.584 Nvme4n1 : 0.83 350.78 21.92 77.15 0.00 144564.55 64468.01 125052.40 00:25:37.584 [2024-11-16T16:01:23.334Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.584 [2024-11-16T16:01:23.334Z] Job: Nvme5n1 ended in about 0.83 seconds with error 00:25:37.584 Verification LBA range: start 0x0 length 0x400 00:25:37.584 Nvme5n1 : 0.83 350.31 21.89 77.05 0.00 143440.22 48545.19 115731.72 00:25:37.584 [2024-11-16T16:01:23.334Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.584 [2024-11-16T16:01:23.334Z] Job: Nvme6n1 ended in about 0.86 seconds with error 00:25:37.584 Verification LBA range: start 0x0 length 0x400 00:25:37.584 Nvme6n1 : 0.86 293.04 18.32 74.72 0.00 165445.69 98255.45 143693.75 00:25:37.584 [2024-11-16T16:01:23.334Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.584 [2024-11-16T16:01:23.334Z] Job: Nvme7n1 ended in about 0.84 seconds with error 00:25:37.584 Verification LBA range: start 0x0 length 0x400 00:25:37.584 Nvme7n1 : 0.84 345.96 21.62 76.09 0.00 142710.26 51263.72 116508.44 00:25:37.584 [2024-11-16T16:01:23.334Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.584 [2024-11-16T16:01:23.334Z] Job: Nvme8n1 ended in about 0.84 seconds with error 00:25:37.584 Verification LBA range: start 0x0 length 0x400 00:25:37.584 Nvme8n1 : 0.84 345.51 21.59 75.99 0.00 141568.43 44855.75 118838.61 00:25:37.584 [2024-11-16T16:01:23.334Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.584 [2024-11-16T16:01:23.334Z] Job: Nvme9n1 ended in about 0.84 seconds with error 00:25:37.584 Verification LBA range: start 0x0 length 0x400 00:25:37.584 Nvme9n1 : 0.84 345.13 21.57 28.46 0.00 155580.54 15922.82 123498.95 00:25:37.584 [2024-11-16T16:01:23.334Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:37.584 [2024-11-16T16:01:23.334Z] Job: Nvme10n1 ended in about 0.81 seconds with error 00:25:37.584 Verification LBA range: start 0x0 length 0x400 00:25:37.584 Nvme10n1 : 0.81 311.51 19.47 79.43 0.00 149183.21 59419.31 123498.95 00:25:37.584 [2024-11-16T16:01:23.334Z] =================================================================================================================== 00:25:37.584 [2024-11-16T16:01:23.334Z] Total : 3370.99 210.69 723.22 0.00 148929.53 15922.82 147577.36 00:25:37.584 [2024-11-16 17:01:23.101850] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:37.584 [2024-11-16 17:01:23.101944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:37.584 [2024-11-16 17:01:23.102471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.102580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.102607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe6c240 with addr=10.0.0.2, port=4420 00:25:37.584 [2024-11-16 17:01:23.102645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe6c240 is same with the state(5) to be set 00:25:37.584 [2024-11-16 17:01:23.102735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.102820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.102847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xca4fe0 with addr=10.0.0.2, port=4420 00:25:37.584 [2024-11-16 17:01:23.102864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xca4fe0 is same with the state(5) to be set 00:25:37.584 [2024-11-16 17:01:23.102929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.103014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.103040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcfc4f0 with addr=10.0.0.2, port=4420 00:25:37.584 [2024-11-16 17:01:23.103057] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcfc4f0 is same with the state(5) to be set 00:25:37.584 [2024-11-16 17:01:23.103093] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:37.584 [2024-11-16 17:01:23.103117] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:37.584 [2024-11-16 17:01:23.103137] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:37.584 [2024-11-16 17:01:23.103157] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:37.584 [2024-11-16 17:01:23.103175] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:37.584 [2024-11-16 17:01:23.103193] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:37.584 [2024-11-16 17:01:23.103211] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:37.584 [2024-11-16 17:01:23.103520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:37.584 [2024-11-16 17:01:23.103549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:37.584 [2024-11-16 17:01:23.103567] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:37.584 [2024-11-16 17:01:23.103584] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:37.584 [2024-11-16 17:01:23.103601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:37.584 [2024-11-16 17:01:23.103625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:37.584 [2024-11-16 17:01:23.103645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:37.584 [2024-11-16 17:01:23.103747] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe6c240 (9): Bad file descriptor 00:25:37.584 [2024-11-16 17:01:23.103787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xca4fe0 (9): Bad file descriptor 00:25:37.584 [2024-11-16 17:01:23.103807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcfc4f0 (9): Bad file descriptor 00:25:37.584 [2024-11-16 17:01:23.103930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.104022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.104047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcd1200 with addr=10.0.0.2, port=4420 00:25:37.584 [2024-11-16 17:01:23.104064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcd1200 is same with the state(5) to be set 00:25:37.584 [2024-11-16 17:01:23.104138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.104215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.104239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcf6c00 with addr=10.0.0.2, port=4420 00:25:37.584 [2024-11-16 17:01:23.104255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcf6c00 is same with the state(5) to be set 00:25:37.584 [2024-11-16 17:01:23.104333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.104411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.104436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe6c960 with addr=10.0.0.2, port=4420 00:25:37.584 [2024-11-16 17:01:23.104452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe6c960 is same with the state(5) to be set 00:25:37.584 [2024-11-16 17:01:23.104518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.104602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.104635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe72e80 with addr=10.0.0.2, port=4420 00:25:37.584 [2024-11-16 17:01:23.104661] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe72e80 is same with the state(5) to be set 00:25:37.584 [2024-11-16 17:01:23.104741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.104825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.104849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcf0190 with addr=10.0.0.2, port=4420 00:25:37.584 [2024-11-16 17:01:23.104865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcf0190 is same with the state(5) to be set 00:25:37.584 [2024-11-16 17:01:23.104959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.105031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.105055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe4e980 with addr=10.0.0.2, port=4420 00:25:37.584 [2024-11-16 17:01:23.105072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4e980 is same with the state(5) to be set 00:25:37.584 [2024-11-16 17:01:23.105140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.105220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:37.584 [2024-11-16 17:01:23.105245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xccf710 with addr=10.0.0.2, port=4420 00:25:37.584 [2024-11-16 17:01:23.105261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xccf710 is same with the state(5) to be set 00:25:37.584 [2024-11-16 17:01:23.105277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:37.584 [2024-11-16 17:01:23.105291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:37.584 [2024-11-16 17:01:23.105315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:37.584 [2024-11-16 17:01:23.105336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:37.585 [2024-11-16 17:01:23.105350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:37.585 [2024-11-16 17:01:23.105364] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:37.585 [2024-11-16 17:01:23.105380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:37.585 [2024-11-16 17:01:23.105393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:37.585 [2024-11-16 17:01:23.105407] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:37.585 [2024-11-16 17:01:23.105462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.585 [2024-11-16 17:01:23.105483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.585 [2024-11-16 17:01:23.105495] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.585 [2024-11-16 17:01:23.105511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcd1200 (9): Bad file descriptor 00:25:37.585 [2024-11-16 17:01:23.105530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcf6c00 (9): Bad file descriptor 00:25:37.585 [2024-11-16 17:01:23.105549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe6c960 (9): Bad file descriptor 00:25:37.585 [2024-11-16 17:01:23.105567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe72e80 (9): Bad file descriptor 00:25:37.585 [2024-11-16 17:01:23.105584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcf0190 (9): Bad file descriptor 00:25:37.585 [2024-11-16 17:01:23.105601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe4e980 (9): Bad file descriptor 00:25:37.585 [2024-11-16 17:01:23.105628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xccf710 (9): Bad file descriptor 00:25:37.585 [2024-11-16 17:01:23.105681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:37.585 [2024-11-16 17:01:23.105700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:37.585 [2024-11-16 17:01:23.105714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:37.585 [2024-11-16 17:01:23.105730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:37.585 [2024-11-16 17:01:23.105744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:37.585 [2024-11-16 17:01:23.105758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:37.585 [2024-11-16 17:01:23.105773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:37.585 [2024-11-16 17:01:23.105787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:37.585 [2024-11-16 17:01:23.105800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:37.585 [2024-11-16 17:01:23.105815] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:37.585 [2024-11-16 17:01:23.105829] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:37.585 [2024-11-16 17:01:23.105842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:37.585 [2024-11-16 17:01:23.105858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:37.585 [2024-11-16 17:01:23.105876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:37.585 [2024-11-16 17:01:23.105890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:37.585 [2024-11-16 17:01:23.105906] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:37.585 [2024-11-16 17:01:23.105922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:37.585 [2024-11-16 17:01:23.105936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:37.585 [2024-11-16 17:01:23.105951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:37.585 [2024-11-16 17:01:23.105966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:37.585 [2024-11-16 17:01:23.105980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:37.585 [2024-11-16 17:01:23.106018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.585 [2024-11-16 17:01:23.106036] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.585 [2024-11-16 17:01:23.106049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.585 [2024-11-16 17:01:23.106060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.585 [2024-11-16 17:01:23.106071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.585 [2024-11-16 17:01:23.106083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.585 [2024-11-16 17:01:23.106106] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:37.844 17:01:23 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:37.844 17:01:23 -- target/shutdown.sh@138 -- # sleep 1 00:25:39.227 17:01:24 -- target/shutdown.sh@141 -- # kill -9 1276039 00:25:39.227 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (1276039) - No such process 00:25:39.227 17:01:24 -- target/shutdown.sh@141 -- # true 00:25:39.227 17:01:24 -- target/shutdown.sh@143 -- # stoptarget 00:25:39.227 17:01:24 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:39.227 17:01:24 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:39.227 17:01:24 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:39.227 17:01:24 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:39.227 17:01:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:39.227 17:01:24 -- nvmf/common.sh@116 -- # sync 00:25:39.227 17:01:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:39.227 17:01:24 -- nvmf/common.sh@119 -- # set +e 00:25:39.227 17:01:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:39.227 17:01:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:39.227 rmmod nvme_tcp 00:25:39.227 rmmod nvme_fabrics 00:25:39.227 rmmod nvme_keyring 00:25:39.227 17:01:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:39.227 17:01:24 -- nvmf/common.sh@123 -- # set -e 00:25:39.227 17:01:24 -- nvmf/common.sh@124 -- # return 0 00:25:39.227 17:01:24 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:39.227 17:01:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:39.227 17:01:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:39.227 17:01:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:39.227 17:01:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:39.227 17:01:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:39.227 17:01:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:39.227 17:01:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:39.227 17:01:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:41.135 17:01:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:41.135 00:25:41.135 real 0m8.164s 00:25:41.135 user 0m21.663s 00:25:41.135 sys 0m1.546s 00:25:41.135 17:01:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:41.135 17:01:26 -- common/autotest_common.sh@10 -- # set +x 00:25:41.135 ************************************ 00:25:41.135 END TEST nvmf_shutdown_tc3 00:25:41.135 ************************************ 00:25:41.135 17:01:26 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:41.135 00:25:41.135 real 0m29.232s 00:25:41.135 user 1m25.119s 00:25:41.135 sys 0m6.459s 00:25:41.135 17:01:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:41.135 17:01:26 -- common/autotest_common.sh@10 -- # set +x 00:25:41.135 ************************************ 00:25:41.135 END TEST nvmf_shutdown 00:25:41.135 ************************************ 00:25:41.135 17:01:26 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:41.135 17:01:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:41.135 17:01:26 -- common/autotest_common.sh@10 -- # set +x 00:25:41.135 17:01:26 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:41.135 17:01:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:41.135 17:01:26 -- common/autotest_common.sh@10 -- # set +x 00:25:41.135 17:01:26 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:41.135 17:01:26 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:41.135 17:01:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:41.135 17:01:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:41.135 17:01:26 -- common/autotest_common.sh@10 -- # set +x 00:25:41.135 ************************************ 00:25:41.135 START TEST nvmf_multicontroller 00:25:41.135 ************************************ 00:25:41.135 17:01:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:41.135 * Looking for test storage... 00:25:41.135 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:41.135 17:01:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:41.135 17:01:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:41.135 17:01:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:41.393 17:01:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:41.393 17:01:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:41.393 17:01:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:41.393 17:01:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:41.393 17:01:26 -- scripts/common.sh@335 -- # IFS=.-: 00:25:41.393 17:01:26 -- scripts/common.sh@335 -- # read -ra ver1 00:25:41.393 17:01:26 -- scripts/common.sh@336 -- # IFS=.-: 00:25:41.393 17:01:26 -- scripts/common.sh@336 -- # read -ra ver2 00:25:41.393 17:01:26 -- scripts/common.sh@337 -- # local 'op=<' 00:25:41.393 17:01:26 -- scripts/common.sh@339 -- # ver1_l=2 00:25:41.393 17:01:26 -- scripts/common.sh@340 -- # ver2_l=1 00:25:41.393 17:01:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:41.393 17:01:26 -- scripts/common.sh@343 -- # case "$op" in 00:25:41.393 17:01:26 -- scripts/common.sh@344 -- # : 1 00:25:41.393 17:01:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:41.393 17:01:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:41.393 17:01:26 -- scripts/common.sh@364 -- # decimal 1 00:25:41.394 17:01:26 -- scripts/common.sh@352 -- # local d=1 00:25:41.394 17:01:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:41.394 17:01:26 -- scripts/common.sh@354 -- # echo 1 00:25:41.394 17:01:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:41.394 17:01:26 -- scripts/common.sh@365 -- # decimal 2 00:25:41.394 17:01:26 -- scripts/common.sh@352 -- # local d=2 00:25:41.394 17:01:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:41.394 17:01:26 -- scripts/common.sh@354 -- # echo 2 00:25:41.394 17:01:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:41.394 17:01:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:41.394 17:01:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:41.394 17:01:26 -- scripts/common.sh@367 -- # return 0 00:25:41.394 17:01:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:41.394 17:01:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:41.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:41.394 --rc genhtml_branch_coverage=1 00:25:41.394 --rc genhtml_function_coverage=1 00:25:41.394 --rc genhtml_legend=1 00:25:41.394 --rc geninfo_all_blocks=1 00:25:41.394 --rc geninfo_unexecuted_blocks=1 00:25:41.394 00:25:41.394 ' 00:25:41.394 17:01:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:41.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:41.394 --rc genhtml_branch_coverage=1 00:25:41.394 --rc genhtml_function_coverage=1 00:25:41.394 --rc genhtml_legend=1 00:25:41.394 --rc geninfo_all_blocks=1 00:25:41.394 --rc geninfo_unexecuted_blocks=1 00:25:41.394 00:25:41.394 ' 00:25:41.394 17:01:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:41.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:41.394 --rc genhtml_branch_coverage=1 00:25:41.394 --rc genhtml_function_coverage=1 00:25:41.394 --rc genhtml_legend=1 00:25:41.394 --rc geninfo_all_blocks=1 00:25:41.394 --rc geninfo_unexecuted_blocks=1 00:25:41.394 00:25:41.394 ' 00:25:41.394 17:01:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:41.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:41.394 --rc genhtml_branch_coverage=1 00:25:41.394 --rc genhtml_function_coverage=1 00:25:41.394 --rc genhtml_legend=1 00:25:41.394 --rc geninfo_all_blocks=1 00:25:41.394 --rc geninfo_unexecuted_blocks=1 00:25:41.394 00:25:41.394 ' 00:25:41.394 17:01:26 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:41.394 17:01:26 -- nvmf/common.sh@7 -- # uname -s 00:25:41.394 17:01:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:41.394 17:01:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:41.394 17:01:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:41.394 17:01:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:41.394 17:01:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:41.394 17:01:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:41.394 17:01:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:41.394 17:01:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:41.394 17:01:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:41.394 17:01:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:41.394 17:01:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:41.394 17:01:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:41.394 17:01:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:41.394 17:01:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:41.394 17:01:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:41.394 17:01:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:41.394 17:01:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:41.394 17:01:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:41.394 17:01:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:41.394 17:01:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.394 17:01:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.394 17:01:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.394 17:01:26 -- paths/export.sh@5 -- # export PATH 00:25:41.394 17:01:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.394 17:01:26 -- nvmf/common.sh@46 -- # : 0 00:25:41.394 17:01:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:41.394 17:01:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:41.394 17:01:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:41.394 17:01:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:41.394 17:01:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:41.394 17:01:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:41.394 17:01:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:41.394 17:01:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:41.394 17:01:26 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:41.394 17:01:26 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:41.394 17:01:26 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:41.394 17:01:26 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:41.394 17:01:26 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:41.394 17:01:26 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:41.394 17:01:26 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:41.394 17:01:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:41.394 17:01:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:41.394 17:01:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:41.394 17:01:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:41.394 17:01:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:41.394 17:01:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:41.394 17:01:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:41.394 17:01:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:41.394 17:01:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:41.394 17:01:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:41.394 17:01:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:41.394 17:01:26 -- common/autotest_common.sh@10 -- # set +x 00:25:43.302 17:01:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:43.302 17:01:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:43.302 17:01:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:43.302 17:01:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:43.302 17:01:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:43.302 17:01:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:43.302 17:01:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:43.302 17:01:29 -- nvmf/common.sh@294 -- # net_devs=() 00:25:43.302 17:01:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:43.302 17:01:29 -- nvmf/common.sh@295 -- # e810=() 00:25:43.302 17:01:29 -- nvmf/common.sh@295 -- # local -ga e810 00:25:43.302 17:01:29 -- nvmf/common.sh@296 -- # x722=() 00:25:43.302 17:01:29 -- nvmf/common.sh@296 -- # local -ga x722 00:25:43.302 17:01:29 -- nvmf/common.sh@297 -- # mlx=() 00:25:43.302 17:01:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:43.302 17:01:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:43.302 17:01:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:43.302 17:01:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:43.302 17:01:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:43.302 17:01:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:43.302 17:01:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:43.302 17:01:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:43.302 17:01:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:43.563 17:01:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:43.563 17:01:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:43.563 17:01:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:43.563 17:01:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:43.563 17:01:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:43.563 17:01:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:43.563 17:01:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:43.563 17:01:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:43.563 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:43.563 17:01:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:43.563 17:01:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:43.563 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:43.563 17:01:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:43.563 17:01:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:43.563 17:01:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:43.563 17:01:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:43.563 17:01:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:43.563 17:01:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:43.563 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:43.563 17:01:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:43.563 17:01:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:43.563 17:01:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:43.563 17:01:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:43.563 17:01:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:43.563 17:01:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:43.563 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:43.563 17:01:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:43.563 17:01:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:43.563 17:01:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:43.563 17:01:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:43.563 17:01:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:43.563 17:01:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:43.563 17:01:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:43.564 17:01:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:43.564 17:01:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:43.564 17:01:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:43.564 17:01:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:43.564 17:01:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:43.564 17:01:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:43.564 17:01:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:43.564 17:01:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:43.564 17:01:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:43.564 17:01:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:43.564 17:01:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:43.564 17:01:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:43.564 17:01:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:43.564 17:01:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:43.564 17:01:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:43.564 17:01:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:43.564 17:01:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:43.564 17:01:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:43.564 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:43.564 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.260 ms 00:25:43.564 00:25:43.564 --- 10.0.0.2 ping statistics --- 00:25:43.564 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.564 rtt min/avg/max/mdev = 0.260/0.260/0.260/0.000 ms 00:25:43.564 17:01:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:43.564 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:43.564 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:25:43.564 00:25:43.564 --- 10.0.0.1 ping statistics --- 00:25:43.564 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.564 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:25:43.564 17:01:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:43.564 17:01:29 -- nvmf/common.sh@410 -- # return 0 00:25:43.564 17:01:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:43.564 17:01:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:43.564 17:01:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:43.564 17:01:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:43.564 17:01:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:43.564 17:01:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:43.564 17:01:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:43.564 17:01:29 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:43.564 17:01:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:43.564 17:01:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:43.564 17:01:29 -- common/autotest_common.sh@10 -- # set +x 00:25:43.564 17:01:29 -- nvmf/common.sh@469 -- # nvmfpid=1278565 00:25:43.564 17:01:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:43.564 17:01:29 -- nvmf/common.sh@470 -- # waitforlisten 1278565 00:25:43.564 17:01:29 -- common/autotest_common.sh@829 -- # '[' -z 1278565 ']' 00:25:43.564 17:01:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:43.564 17:01:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:43.564 17:01:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:43.564 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:43.564 17:01:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:43.564 17:01:29 -- common/autotest_common.sh@10 -- # set +x 00:25:43.564 [2024-11-16 17:01:29.250262] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:43.564 [2024-11-16 17:01:29.250340] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:43.564 EAL: No free 2048 kB hugepages reported on node 1 00:25:43.824 [2024-11-16 17:01:29.315310] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:43.824 [2024-11-16 17:01:29.407343] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:43.824 [2024-11-16 17:01:29.407498] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:43.824 [2024-11-16 17:01:29.407517] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:43.824 [2024-11-16 17:01:29.407530] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:43.824 [2024-11-16 17:01:29.407583] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:43.824 [2024-11-16 17:01:29.407623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:43.824 [2024-11-16 17:01:29.407613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:44.762 17:01:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:44.762 17:01:30 -- common/autotest_common.sh@862 -- # return 0 00:25:44.762 17:01:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:44.762 17:01:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:44.762 17:01:30 -- common/autotest_common.sh@10 -- # set +x 00:25:44.762 17:01:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:44.762 17:01:30 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:44.762 17:01:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.762 17:01:30 -- common/autotest_common.sh@10 -- # set +x 00:25:44.762 [2024-11-16 17:01:30.311463] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:44.762 17:01:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.762 17:01:30 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:44.762 17:01:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.762 17:01:30 -- common/autotest_common.sh@10 -- # set +x 00:25:44.762 Malloc0 00:25:44.762 17:01:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.762 17:01:30 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:44.762 17:01:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.762 17:01:30 -- common/autotest_common.sh@10 -- # set +x 00:25:44.762 17:01:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.762 17:01:30 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:44.762 17:01:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.762 17:01:30 -- common/autotest_common.sh@10 -- # set +x 00:25:44.762 17:01:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.762 17:01:30 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:44.762 17:01:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.762 17:01:30 -- common/autotest_common.sh@10 -- # set +x 00:25:44.762 [2024-11-16 17:01:30.380822] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:44.762 17:01:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.762 17:01:30 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:44.762 17:01:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.762 17:01:30 -- common/autotest_common.sh@10 -- # set +x 00:25:44.762 [2024-11-16 17:01:30.388683] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:44.762 17:01:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.762 17:01:30 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:44.762 17:01:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.762 17:01:30 -- common/autotest_common.sh@10 -- # set +x 00:25:44.762 Malloc1 00:25:44.762 17:01:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.762 17:01:30 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:44.762 17:01:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.762 17:01:30 -- common/autotest_common.sh@10 -- # set +x 00:25:44.762 17:01:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.762 17:01:30 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:44.762 17:01:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.762 17:01:30 -- common/autotest_common.sh@10 -- # set +x 00:25:44.762 17:01:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.762 17:01:30 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:44.762 17:01:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.762 17:01:30 -- common/autotest_common.sh@10 -- # set +x 00:25:44.762 17:01:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.763 17:01:30 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:44.763 17:01:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.763 17:01:30 -- common/autotest_common.sh@10 -- # set +x 00:25:44.763 17:01:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.763 17:01:30 -- host/multicontroller.sh@44 -- # bdevperf_pid=1278719 00:25:44.763 17:01:30 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:44.763 17:01:30 -- host/multicontroller.sh@47 -- # waitforlisten 1278719 /var/tmp/bdevperf.sock 00:25:44.763 17:01:30 -- common/autotest_common.sh@829 -- # '[' -z 1278719 ']' 00:25:44.763 17:01:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:44.763 17:01:30 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:44.763 17:01:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:44.763 17:01:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:44.763 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:44.763 17:01:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:44.763 17:01:30 -- common/autotest_common.sh@10 -- # set +x 00:25:46.143 17:01:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:46.143 17:01:31 -- common/autotest_common.sh@862 -- # return 0 00:25:46.143 17:01:31 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:46.143 17:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.143 17:01:31 -- common/autotest_common.sh@10 -- # set +x 00:25:46.143 NVMe0n1 00:25:46.143 17:01:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.143 17:01:31 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:46.143 17:01:31 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:46.143 17:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.143 17:01:31 -- common/autotest_common.sh@10 -- # set +x 00:25:46.143 17:01:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.143 1 00:25:46.143 17:01:31 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:46.143 17:01:31 -- common/autotest_common.sh@650 -- # local es=0 00:25:46.143 17:01:31 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:46.143 17:01:31 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:46.143 17:01:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.143 17:01:31 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:46.143 17:01:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.143 17:01:31 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:46.143 17:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.143 17:01:31 -- common/autotest_common.sh@10 -- # set +x 00:25:46.143 request: 00:25:46.143 { 00:25:46.143 "name": "NVMe0", 00:25:46.143 "trtype": "tcp", 00:25:46.143 "traddr": "10.0.0.2", 00:25:46.143 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:46.143 "hostaddr": "10.0.0.2", 00:25:46.143 "hostsvcid": "60000", 00:25:46.143 "adrfam": "ipv4", 00:25:46.143 "trsvcid": "4420", 00:25:46.143 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:46.143 "method": "bdev_nvme_attach_controller", 00:25:46.143 "req_id": 1 00:25:46.143 } 00:25:46.143 Got JSON-RPC error response 00:25:46.143 response: 00:25:46.143 { 00:25:46.143 "code": -114, 00:25:46.143 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:46.143 } 00:25:46.143 17:01:31 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:46.143 17:01:31 -- common/autotest_common.sh@653 -- # es=1 00:25:46.143 17:01:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:46.143 17:01:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:46.143 17:01:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:46.143 17:01:31 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:46.143 17:01:31 -- common/autotest_common.sh@650 -- # local es=0 00:25:46.143 17:01:31 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:46.143 17:01:31 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:46.143 17:01:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.143 17:01:31 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:46.143 17:01:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.143 17:01:31 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:46.143 17:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.143 17:01:31 -- common/autotest_common.sh@10 -- # set +x 00:25:46.143 request: 00:25:46.143 { 00:25:46.143 "name": "NVMe0", 00:25:46.143 "trtype": "tcp", 00:25:46.143 "traddr": "10.0.0.2", 00:25:46.143 "hostaddr": "10.0.0.2", 00:25:46.143 "hostsvcid": "60000", 00:25:46.143 "adrfam": "ipv4", 00:25:46.143 "trsvcid": "4420", 00:25:46.143 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:46.143 "method": "bdev_nvme_attach_controller", 00:25:46.143 "req_id": 1 00:25:46.143 } 00:25:46.143 Got JSON-RPC error response 00:25:46.143 response: 00:25:46.143 { 00:25:46.143 "code": -114, 00:25:46.143 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:46.143 } 00:25:46.143 17:01:31 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:46.143 17:01:31 -- common/autotest_common.sh@653 -- # es=1 00:25:46.143 17:01:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:46.143 17:01:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:46.143 17:01:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:46.143 17:01:31 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:46.143 17:01:31 -- common/autotest_common.sh@650 -- # local es=0 00:25:46.143 17:01:31 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:46.143 17:01:31 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:46.143 17:01:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.143 17:01:31 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:46.143 17:01:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.143 17:01:31 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:46.143 17:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.143 17:01:31 -- common/autotest_common.sh@10 -- # set +x 00:25:46.143 request: 00:25:46.143 { 00:25:46.143 "name": "NVMe0", 00:25:46.143 "trtype": "tcp", 00:25:46.143 "traddr": "10.0.0.2", 00:25:46.143 "hostaddr": "10.0.0.2", 00:25:46.143 "hostsvcid": "60000", 00:25:46.143 "adrfam": "ipv4", 00:25:46.143 "trsvcid": "4420", 00:25:46.143 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:46.143 "multipath": "disable", 00:25:46.143 "method": "bdev_nvme_attach_controller", 00:25:46.143 "req_id": 1 00:25:46.143 } 00:25:46.143 Got JSON-RPC error response 00:25:46.143 response: 00:25:46.143 { 00:25:46.143 "code": -114, 00:25:46.143 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:46.143 } 00:25:46.143 17:01:31 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:46.143 17:01:31 -- common/autotest_common.sh@653 -- # es=1 00:25:46.143 17:01:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:46.143 17:01:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:46.143 17:01:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:46.143 17:01:31 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:46.143 17:01:31 -- common/autotest_common.sh@650 -- # local es=0 00:25:46.143 17:01:31 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:46.143 17:01:31 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:46.143 17:01:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.143 17:01:31 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:46.143 17:01:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.143 17:01:31 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:46.143 17:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.143 17:01:31 -- common/autotest_common.sh@10 -- # set +x 00:25:46.143 request: 00:25:46.143 { 00:25:46.143 "name": "NVMe0", 00:25:46.143 "trtype": "tcp", 00:25:46.143 "traddr": "10.0.0.2", 00:25:46.143 "hostaddr": "10.0.0.2", 00:25:46.143 "hostsvcid": "60000", 00:25:46.143 "adrfam": "ipv4", 00:25:46.143 "trsvcid": "4420", 00:25:46.143 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:46.143 "multipath": "failover", 00:25:46.143 "method": "bdev_nvme_attach_controller", 00:25:46.143 "req_id": 1 00:25:46.143 } 00:25:46.143 Got JSON-RPC error response 00:25:46.143 response: 00:25:46.143 { 00:25:46.143 "code": -114, 00:25:46.143 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:46.143 } 00:25:46.143 17:01:31 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:46.143 17:01:31 -- common/autotest_common.sh@653 -- # es=1 00:25:46.143 17:01:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:46.143 17:01:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:46.143 17:01:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:46.143 17:01:31 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:46.143 17:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.143 17:01:31 -- common/autotest_common.sh@10 -- # set +x 00:25:46.143 00:25:46.143 17:01:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.144 17:01:31 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:46.144 17:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.144 17:01:31 -- common/autotest_common.sh@10 -- # set +x 00:25:46.144 17:01:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.144 17:01:31 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:46.144 17:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.144 17:01:31 -- common/autotest_common.sh@10 -- # set +x 00:25:46.404 00:25:46.404 17:01:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.404 17:01:31 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:46.404 17:01:31 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:46.404 17:01:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.404 17:01:31 -- common/autotest_common.sh@10 -- # set +x 00:25:46.404 17:01:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.404 17:01:31 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:46.404 17:01:31 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:47.340 0 00:25:47.340 17:01:33 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:47.340 17:01:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.340 17:01:33 -- common/autotest_common.sh@10 -- # set +x 00:25:47.599 17:01:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.599 17:01:33 -- host/multicontroller.sh@100 -- # killprocess 1278719 00:25:47.599 17:01:33 -- common/autotest_common.sh@936 -- # '[' -z 1278719 ']' 00:25:47.599 17:01:33 -- common/autotest_common.sh@940 -- # kill -0 1278719 00:25:47.599 17:01:33 -- common/autotest_common.sh@941 -- # uname 00:25:47.599 17:01:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:47.599 17:01:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1278719 00:25:47.599 17:01:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:47.599 17:01:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:47.599 17:01:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1278719' 00:25:47.599 killing process with pid 1278719 00:25:47.599 17:01:33 -- common/autotest_common.sh@955 -- # kill 1278719 00:25:47.599 17:01:33 -- common/autotest_common.sh@960 -- # wait 1278719 00:25:47.860 17:01:33 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:47.860 17:01:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.860 17:01:33 -- common/autotest_common.sh@10 -- # set +x 00:25:47.860 17:01:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.860 17:01:33 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:47.860 17:01:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.860 17:01:33 -- common/autotest_common.sh@10 -- # set +x 00:25:47.860 17:01:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.860 17:01:33 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:47.860 17:01:33 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:47.860 17:01:33 -- common/autotest_common.sh@1607 -- # read -r file 00:25:47.860 17:01:33 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:47.860 17:01:33 -- common/autotest_common.sh@1606 -- # sort -u 00:25:47.860 17:01:33 -- common/autotest_common.sh@1608 -- # cat 00:25:47.860 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:47.860 [2024-11-16 17:01:30.492684] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:47.860 [2024-11-16 17:01:30.492800] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1278719 ] 00:25:47.860 EAL: No free 2048 kB hugepages reported on node 1 00:25:47.860 [2024-11-16 17:01:30.556089] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:47.860 [2024-11-16 17:01:30.641460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:47.860 [2024-11-16 17:01:31.944238] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name c16edaa7-e880-4465-8ebc-fdd6af7fb754 already exists 00:25:47.860 [2024-11-16 17:01:31.944281] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:c16edaa7-e880-4465-8ebc-fdd6af7fb754 alias for bdev NVMe1n1 00:25:47.860 [2024-11-16 17:01:31.944300] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:47.860 Running I/O for 1 seconds... 00:25:47.860 00:25:47.860 Latency(us) 00:25:47.860 [2024-11-16T16:01:33.610Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:47.860 [2024-11-16T16:01:33.610Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:47.860 NVMe0n1 : 1.00 19851.70 77.55 0.00 0.00 6438.83 2536.49 11602.30 00:25:47.860 [2024-11-16T16:01:33.610Z] =================================================================================================================== 00:25:47.860 [2024-11-16T16:01:33.610Z] Total : 19851.70 77.55 0.00 0.00 6438.83 2536.49 11602.30 00:25:47.860 Received shutdown signal, test time was about 1.000000 seconds 00:25:47.860 00:25:47.860 Latency(us) 00:25:47.860 [2024-11-16T16:01:33.610Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:47.860 [2024-11-16T16:01:33.610Z] =================================================================================================================== 00:25:47.860 [2024-11-16T16:01:33.610Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:47.860 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:47.860 17:01:33 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:47.860 17:01:33 -- common/autotest_common.sh@1607 -- # read -r file 00:25:47.860 17:01:33 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:47.860 17:01:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:47.860 17:01:33 -- nvmf/common.sh@116 -- # sync 00:25:47.860 17:01:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:47.860 17:01:33 -- nvmf/common.sh@119 -- # set +e 00:25:47.860 17:01:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:47.860 17:01:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:47.860 rmmod nvme_tcp 00:25:47.860 rmmod nvme_fabrics 00:25:47.860 rmmod nvme_keyring 00:25:47.860 17:01:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:47.861 17:01:33 -- nvmf/common.sh@123 -- # set -e 00:25:47.861 17:01:33 -- nvmf/common.sh@124 -- # return 0 00:25:47.861 17:01:33 -- nvmf/common.sh@477 -- # '[' -n 1278565 ']' 00:25:47.861 17:01:33 -- nvmf/common.sh@478 -- # killprocess 1278565 00:25:47.861 17:01:33 -- common/autotest_common.sh@936 -- # '[' -z 1278565 ']' 00:25:47.861 17:01:33 -- common/autotest_common.sh@940 -- # kill -0 1278565 00:25:47.861 17:01:33 -- common/autotest_common.sh@941 -- # uname 00:25:47.861 17:01:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:47.861 17:01:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1278565 00:25:47.861 17:01:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:47.861 17:01:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:47.861 17:01:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1278565' 00:25:47.861 killing process with pid 1278565 00:25:47.861 17:01:33 -- common/autotest_common.sh@955 -- # kill 1278565 00:25:47.861 17:01:33 -- common/autotest_common.sh@960 -- # wait 1278565 00:25:48.120 17:01:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:48.120 17:01:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:48.120 17:01:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:48.120 17:01:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:48.120 17:01:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:48.120 17:01:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:48.120 17:01:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:48.120 17:01:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:50.661 17:01:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:50.661 00:25:50.661 real 0m9.034s 00:25:50.661 user 0m17.219s 00:25:50.661 sys 0m2.422s 00:25:50.661 17:01:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:50.661 17:01:35 -- common/autotest_common.sh@10 -- # set +x 00:25:50.661 ************************************ 00:25:50.661 END TEST nvmf_multicontroller 00:25:50.661 ************************************ 00:25:50.661 17:01:35 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:50.661 17:01:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:50.661 17:01:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:50.661 17:01:35 -- common/autotest_common.sh@10 -- # set +x 00:25:50.661 ************************************ 00:25:50.661 START TEST nvmf_aer 00:25:50.661 ************************************ 00:25:50.661 17:01:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:50.661 * Looking for test storage... 00:25:50.661 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:50.661 17:01:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:50.661 17:01:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:50.661 17:01:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:50.661 17:01:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:50.661 17:01:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:50.661 17:01:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:50.661 17:01:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:50.661 17:01:35 -- scripts/common.sh@335 -- # IFS=.-: 00:25:50.661 17:01:35 -- scripts/common.sh@335 -- # read -ra ver1 00:25:50.661 17:01:35 -- scripts/common.sh@336 -- # IFS=.-: 00:25:50.661 17:01:35 -- scripts/common.sh@336 -- # read -ra ver2 00:25:50.661 17:01:35 -- scripts/common.sh@337 -- # local 'op=<' 00:25:50.661 17:01:35 -- scripts/common.sh@339 -- # ver1_l=2 00:25:50.661 17:01:35 -- scripts/common.sh@340 -- # ver2_l=1 00:25:50.661 17:01:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:50.661 17:01:35 -- scripts/common.sh@343 -- # case "$op" in 00:25:50.661 17:01:35 -- scripts/common.sh@344 -- # : 1 00:25:50.661 17:01:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:50.661 17:01:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:50.661 17:01:35 -- scripts/common.sh@364 -- # decimal 1 00:25:50.661 17:01:35 -- scripts/common.sh@352 -- # local d=1 00:25:50.661 17:01:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:50.661 17:01:35 -- scripts/common.sh@354 -- # echo 1 00:25:50.661 17:01:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:50.661 17:01:35 -- scripts/common.sh@365 -- # decimal 2 00:25:50.661 17:01:35 -- scripts/common.sh@352 -- # local d=2 00:25:50.661 17:01:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:50.661 17:01:35 -- scripts/common.sh@354 -- # echo 2 00:25:50.661 17:01:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:50.661 17:01:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:50.661 17:01:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:50.661 17:01:35 -- scripts/common.sh@367 -- # return 0 00:25:50.661 17:01:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:50.661 17:01:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:50.661 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:50.661 --rc genhtml_branch_coverage=1 00:25:50.661 --rc genhtml_function_coverage=1 00:25:50.661 --rc genhtml_legend=1 00:25:50.661 --rc geninfo_all_blocks=1 00:25:50.661 --rc geninfo_unexecuted_blocks=1 00:25:50.661 00:25:50.661 ' 00:25:50.661 17:01:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:50.661 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:50.661 --rc genhtml_branch_coverage=1 00:25:50.661 --rc genhtml_function_coverage=1 00:25:50.661 --rc genhtml_legend=1 00:25:50.661 --rc geninfo_all_blocks=1 00:25:50.661 --rc geninfo_unexecuted_blocks=1 00:25:50.661 00:25:50.661 ' 00:25:50.661 17:01:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:50.661 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:50.661 --rc genhtml_branch_coverage=1 00:25:50.661 --rc genhtml_function_coverage=1 00:25:50.661 --rc genhtml_legend=1 00:25:50.661 --rc geninfo_all_blocks=1 00:25:50.661 --rc geninfo_unexecuted_blocks=1 00:25:50.661 00:25:50.661 ' 00:25:50.661 17:01:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:50.661 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:50.661 --rc genhtml_branch_coverage=1 00:25:50.661 --rc genhtml_function_coverage=1 00:25:50.661 --rc genhtml_legend=1 00:25:50.661 --rc geninfo_all_blocks=1 00:25:50.661 --rc geninfo_unexecuted_blocks=1 00:25:50.661 00:25:50.661 ' 00:25:50.661 17:01:35 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:50.661 17:01:35 -- nvmf/common.sh@7 -- # uname -s 00:25:50.661 17:01:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:50.661 17:01:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:50.661 17:01:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:50.661 17:01:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:50.661 17:01:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:50.661 17:01:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:50.661 17:01:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:50.661 17:01:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:50.661 17:01:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:50.661 17:01:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:50.661 17:01:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:50.661 17:01:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:50.661 17:01:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:50.661 17:01:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:50.661 17:01:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:50.661 17:01:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:50.661 17:01:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:50.661 17:01:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:50.661 17:01:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:50.661 17:01:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:50.661 17:01:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:50.661 17:01:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:50.661 17:01:36 -- paths/export.sh@5 -- # export PATH 00:25:50.661 17:01:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:50.661 17:01:36 -- nvmf/common.sh@46 -- # : 0 00:25:50.661 17:01:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:50.661 17:01:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:50.661 17:01:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:50.661 17:01:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:50.661 17:01:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:50.661 17:01:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:50.661 17:01:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:50.661 17:01:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:50.661 17:01:36 -- host/aer.sh@11 -- # nvmftestinit 00:25:50.661 17:01:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:50.661 17:01:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:50.661 17:01:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:50.662 17:01:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:50.662 17:01:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:50.662 17:01:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:50.662 17:01:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:50.662 17:01:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:50.662 17:01:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:50.662 17:01:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:50.662 17:01:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:50.662 17:01:36 -- common/autotest_common.sh@10 -- # set +x 00:25:52.564 17:01:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:52.564 17:01:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:52.564 17:01:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:52.564 17:01:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:52.564 17:01:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:52.564 17:01:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:52.564 17:01:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:52.564 17:01:38 -- nvmf/common.sh@294 -- # net_devs=() 00:25:52.564 17:01:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:52.564 17:01:38 -- nvmf/common.sh@295 -- # e810=() 00:25:52.564 17:01:38 -- nvmf/common.sh@295 -- # local -ga e810 00:25:52.564 17:01:38 -- nvmf/common.sh@296 -- # x722=() 00:25:52.564 17:01:38 -- nvmf/common.sh@296 -- # local -ga x722 00:25:52.564 17:01:38 -- nvmf/common.sh@297 -- # mlx=() 00:25:52.564 17:01:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:52.564 17:01:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:52.564 17:01:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:52.564 17:01:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:52.564 17:01:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:52.564 17:01:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:52.564 17:01:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:52.564 17:01:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:52.564 17:01:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:52.564 17:01:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:52.564 17:01:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:52.564 17:01:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:52.564 17:01:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:52.564 17:01:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:52.564 17:01:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:52.564 17:01:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:52.564 17:01:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:52.564 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:52.564 17:01:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:52.564 17:01:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:52.564 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:52.564 17:01:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:52.564 17:01:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:52.564 17:01:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:52.564 17:01:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:52.564 17:01:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:52.564 17:01:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:52.564 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:52.564 17:01:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:52.564 17:01:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:52.564 17:01:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:52.564 17:01:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:52.564 17:01:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:52.564 17:01:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:52.564 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:52.564 17:01:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:52.564 17:01:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:52.564 17:01:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:52.564 17:01:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:52.564 17:01:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:52.564 17:01:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:52.564 17:01:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:52.564 17:01:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:52.564 17:01:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:52.564 17:01:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:52.564 17:01:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:52.564 17:01:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:52.564 17:01:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:52.564 17:01:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:52.564 17:01:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:52.564 17:01:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:52.564 17:01:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:52.564 17:01:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:52.564 17:01:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:52.564 17:01:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:52.564 17:01:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:52.564 17:01:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:52.564 17:01:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:52.564 17:01:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:52.564 17:01:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:52.564 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:52.564 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.167 ms 00:25:52.564 00:25:52.564 --- 10.0.0.2 ping statistics --- 00:25:52.564 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:52.565 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:25:52.565 17:01:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:52.565 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:52.565 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:25:52.565 00:25:52.565 --- 10.0.0.1 ping statistics --- 00:25:52.565 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:52.565 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:25:52.565 17:01:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:52.565 17:01:38 -- nvmf/common.sh@410 -- # return 0 00:25:52.565 17:01:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:52.565 17:01:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:52.565 17:01:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:52.565 17:01:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:52.565 17:01:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:52.565 17:01:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:52.565 17:01:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:52.565 17:01:38 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:25:52.565 17:01:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:52.565 17:01:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:52.565 17:01:38 -- common/autotest_common.sh@10 -- # set +x 00:25:52.565 17:01:38 -- nvmf/common.sh@469 -- # nvmfpid=1281087 00:25:52.565 17:01:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:52.565 17:01:38 -- nvmf/common.sh@470 -- # waitforlisten 1281087 00:25:52.565 17:01:38 -- common/autotest_common.sh@829 -- # '[' -z 1281087 ']' 00:25:52.565 17:01:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:52.565 17:01:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:52.565 17:01:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:52.565 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:52.565 17:01:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:52.565 17:01:38 -- common/autotest_common.sh@10 -- # set +x 00:25:52.565 [2024-11-16 17:01:38.212753] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:52.565 [2024-11-16 17:01:38.212821] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:52.565 EAL: No free 2048 kB hugepages reported on node 1 00:25:52.565 [2024-11-16 17:01:38.284160] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:52.825 [2024-11-16 17:01:38.374031] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:52.825 [2024-11-16 17:01:38.374213] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:52.825 [2024-11-16 17:01:38.374232] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:52.825 [2024-11-16 17:01:38.374248] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:52.825 [2024-11-16 17:01:38.374307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:52.825 [2024-11-16 17:01:38.374362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:52.825 [2024-11-16 17:01:38.374476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:52.825 [2024-11-16 17:01:38.374479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:53.762 17:01:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:53.762 17:01:39 -- common/autotest_common.sh@862 -- # return 0 00:25:53.762 17:01:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:53.762 17:01:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:53.762 17:01:39 -- common/autotest_common.sh@10 -- # set +x 00:25:53.762 17:01:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:53.762 17:01:39 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:53.762 17:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.762 17:01:39 -- common/autotest_common.sh@10 -- # set +x 00:25:53.762 [2024-11-16 17:01:39.242335] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:53.762 17:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.762 17:01:39 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:25:53.762 17:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.762 17:01:39 -- common/autotest_common.sh@10 -- # set +x 00:25:53.762 Malloc0 00:25:53.762 17:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.762 17:01:39 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:25:53.762 17:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.762 17:01:39 -- common/autotest_common.sh@10 -- # set +x 00:25:53.762 17:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.762 17:01:39 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:53.762 17:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.762 17:01:39 -- common/autotest_common.sh@10 -- # set +x 00:25:53.762 17:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.762 17:01:39 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:53.762 17:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.762 17:01:39 -- common/autotest_common.sh@10 -- # set +x 00:25:53.762 [2024-11-16 17:01:39.295855] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:53.762 17:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.762 17:01:39 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:25:53.762 17:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.762 17:01:39 -- common/autotest_common.sh@10 -- # set +x 00:25:53.762 [2024-11-16 17:01:39.303496] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:53.762 [ 00:25:53.762 { 00:25:53.762 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:53.762 "subtype": "Discovery", 00:25:53.762 "listen_addresses": [], 00:25:53.762 "allow_any_host": true, 00:25:53.762 "hosts": [] 00:25:53.762 }, 00:25:53.762 { 00:25:53.762 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:53.762 "subtype": "NVMe", 00:25:53.762 "listen_addresses": [ 00:25:53.762 { 00:25:53.762 "transport": "TCP", 00:25:53.762 "trtype": "TCP", 00:25:53.762 "adrfam": "IPv4", 00:25:53.762 "traddr": "10.0.0.2", 00:25:53.762 "trsvcid": "4420" 00:25:53.762 } 00:25:53.762 ], 00:25:53.762 "allow_any_host": true, 00:25:53.762 "hosts": [], 00:25:53.762 "serial_number": "SPDK00000000000001", 00:25:53.762 "model_number": "SPDK bdev Controller", 00:25:53.762 "max_namespaces": 2, 00:25:53.762 "min_cntlid": 1, 00:25:53.762 "max_cntlid": 65519, 00:25:53.762 "namespaces": [ 00:25:53.762 { 00:25:53.762 "nsid": 1, 00:25:53.762 "bdev_name": "Malloc0", 00:25:53.762 "name": "Malloc0", 00:25:53.762 "nguid": "050B3675131D48458F33FFC275BEF6E3", 00:25:53.762 "uuid": "050b3675-131d-4845-8f33-ffc275bef6e3" 00:25:53.762 } 00:25:53.762 ] 00:25:53.762 } 00:25:53.762 ] 00:25:53.762 17:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.762 17:01:39 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:25:53.762 17:01:39 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:25:53.762 17:01:39 -- host/aer.sh@33 -- # aerpid=1281250 00:25:53.762 17:01:39 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:25:53.762 17:01:39 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:25:53.762 17:01:39 -- common/autotest_common.sh@1254 -- # local i=0 00:25:53.762 17:01:39 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:53.762 17:01:39 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:25:53.762 17:01:39 -- common/autotest_common.sh@1257 -- # i=1 00:25:53.762 17:01:39 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:53.762 EAL: No free 2048 kB hugepages reported on node 1 00:25:53.762 17:01:39 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:53.762 17:01:39 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:25:53.762 17:01:39 -- common/autotest_common.sh@1257 -- # i=2 00:25:53.762 17:01:39 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:54.020 17:01:39 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:54.020 17:01:39 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:54.020 17:01:39 -- common/autotest_common.sh@1265 -- # return 0 00:25:54.020 17:01:39 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:25:54.020 17:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.020 17:01:39 -- common/autotest_common.sh@10 -- # set +x 00:25:54.020 Malloc1 00:25:54.020 17:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.020 17:01:39 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:25:54.020 17:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.020 17:01:39 -- common/autotest_common.sh@10 -- # set +x 00:25:54.020 17:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.020 17:01:39 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:25:54.020 17:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.020 17:01:39 -- common/autotest_common.sh@10 -- # set +x 00:25:54.020 Asynchronous Event Request test 00:25:54.020 Attaching to 10.0.0.2 00:25:54.020 Attached to 10.0.0.2 00:25:54.020 Registering asynchronous event callbacks... 00:25:54.020 Starting namespace attribute notice tests for all controllers... 00:25:54.020 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:25:54.020 aer_cb - Changed Namespace 00:25:54.020 Cleaning up... 00:25:54.020 [ 00:25:54.020 { 00:25:54.020 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:54.020 "subtype": "Discovery", 00:25:54.020 "listen_addresses": [], 00:25:54.020 "allow_any_host": true, 00:25:54.020 "hosts": [] 00:25:54.020 }, 00:25:54.020 { 00:25:54.020 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:54.020 "subtype": "NVMe", 00:25:54.020 "listen_addresses": [ 00:25:54.020 { 00:25:54.020 "transport": "TCP", 00:25:54.020 "trtype": "TCP", 00:25:54.020 "adrfam": "IPv4", 00:25:54.020 "traddr": "10.0.0.2", 00:25:54.020 "trsvcid": "4420" 00:25:54.020 } 00:25:54.020 ], 00:25:54.020 "allow_any_host": true, 00:25:54.020 "hosts": [], 00:25:54.020 "serial_number": "SPDK00000000000001", 00:25:54.020 "model_number": "SPDK bdev Controller", 00:25:54.020 "max_namespaces": 2, 00:25:54.020 "min_cntlid": 1, 00:25:54.020 "max_cntlid": 65519, 00:25:54.020 "namespaces": [ 00:25:54.020 { 00:25:54.020 "nsid": 1, 00:25:54.020 "bdev_name": "Malloc0", 00:25:54.020 "name": "Malloc0", 00:25:54.020 "nguid": "050B3675131D48458F33FFC275BEF6E3", 00:25:54.020 "uuid": "050b3675-131d-4845-8f33-ffc275bef6e3" 00:25:54.020 }, 00:25:54.020 { 00:25:54.020 "nsid": 2, 00:25:54.020 "bdev_name": "Malloc1", 00:25:54.020 "name": "Malloc1", 00:25:54.020 "nguid": "E05FFB8992D048A09FD8B647647FF0C0", 00:25:54.020 "uuid": "e05ffb89-92d0-48a0-9fd8-b647647ff0c0" 00:25:54.020 } 00:25:54.020 ] 00:25:54.020 } 00:25:54.020 ] 00:25:54.020 17:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.020 17:01:39 -- host/aer.sh@43 -- # wait 1281250 00:25:54.020 17:01:39 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:25:54.020 17:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.020 17:01:39 -- common/autotest_common.sh@10 -- # set +x 00:25:54.020 17:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.020 17:01:39 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:25:54.020 17:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.020 17:01:39 -- common/autotest_common.sh@10 -- # set +x 00:25:54.020 17:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.020 17:01:39 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:54.020 17:01:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.020 17:01:39 -- common/autotest_common.sh@10 -- # set +x 00:25:54.020 17:01:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.020 17:01:39 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:25:54.020 17:01:39 -- host/aer.sh@51 -- # nvmftestfini 00:25:54.020 17:01:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:54.020 17:01:39 -- nvmf/common.sh@116 -- # sync 00:25:54.020 17:01:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:54.020 17:01:39 -- nvmf/common.sh@119 -- # set +e 00:25:54.020 17:01:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:54.020 17:01:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:54.020 rmmod nvme_tcp 00:25:54.020 rmmod nvme_fabrics 00:25:54.020 rmmod nvme_keyring 00:25:54.020 17:01:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:54.020 17:01:39 -- nvmf/common.sh@123 -- # set -e 00:25:54.020 17:01:39 -- nvmf/common.sh@124 -- # return 0 00:25:54.020 17:01:39 -- nvmf/common.sh@477 -- # '[' -n 1281087 ']' 00:25:54.020 17:01:39 -- nvmf/common.sh@478 -- # killprocess 1281087 00:25:54.020 17:01:39 -- common/autotest_common.sh@936 -- # '[' -z 1281087 ']' 00:25:54.020 17:01:39 -- common/autotest_common.sh@940 -- # kill -0 1281087 00:25:54.020 17:01:39 -- common/autotest_common.sh@941 -- # uname 00:25:54.020 17:01:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:54.020 17:01:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1281087 00:25:54.020 17:01:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:54.021 17:01:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:54.021 17:01:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1281087' 00:25:54.021 killing process with pid 1281087 00:25:54.021 17:01:39 -- common/autotest_common.sh@955 -- # kill 1281087 00:25:54.021 [2024-11-16 17:01:39.752762] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:54.021 17:01:39 -- common/autotest_common.sh@960 -- # wait 1281087 00:25:54.278 17:01:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:54.278 17:01:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:54.278 17:01:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:54.278 17:01:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:54.278 17:01:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:54.278 17:01:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:54.278 17:01:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:54.278 17:01:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:56.818 17:01:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:56.818 00:25:56.818 real 0m6.163s 00:25:56.818 user 0m7.331s 00:25:56.818 sys 0m1.968s 00:25:56.818 17:01:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:56.818 17:01:42 -- common/autotest_common.sh@10 -- # set +x 00:25:56.818 ************************************ 00:25:56.818 END TEST nvmf_aer 00:25:56.818 ************************************ 00:25:56.818 17:01:42 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:56.818 17:01:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:56.818 17:01:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:56.818 17:01:42 -- common/autotest_common.sh@10 -- # set +x 00:25:56.818 ************************************ 00:25:56.818 START TEST nvmf_async_init 00:25:56.818 ************************************ 00:25:56.818 17:01:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:56.818 * Looking for test storage... 00:25:56.818 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:56.818 17:01:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:56.818 17:01:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:56.818 17:01:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:56.818 17:01:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:56.818 17:01:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:56.818 17:01:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:56.818 17:01:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:56.818 17:01:42 -- scripts/common.sh@335 -- # IFS=.-: 00:25:56.818 17:01:42 -- scripts/common.sh@335 -- # read -ra ver1 00:25:56.818 17:01:42 -- scripts/common.sh@336 -- # IFS=.-: 00:25:56.818 17:01:42 -- scripts/common.sh@336 -- # read -ra ver2 00:25:56.818 17:01:42 -- scripts/common.sh@337 -- # local 'op=<' 00:25:56.818 17:01:42 -- scripts/common.sh@339 -- # ver1_l=2 00:25:56.818 17:01:42 -- scripts/common.sh@340 -- # ver2_l=1 00:25:56.818 17:01:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:56.818 17:01:42 -- scripts/common.sh@343 -- # case "$op" in 00:25:56.818 17:01:42 -- scripts/common.sh@344 -- # : 1 00:25:56.818 17:01:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:56.818 17:01:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:56.818 17:01:42 -- scripts/common.sh@364 -- # decimal 1 00:25:56.818 17:01:42 -- scripts/common.sh@352 -- # local d=1 00:25:56.818 17:01:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:56.818 17:01:42 -- scripts/common.sh@354 -- # echo 1 00:25:56.818 17:01:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:56.818 17:01:42 -- scripts/common.sh@365 -- # decimal 2 00:25:56.818 17:01:42 -- scripts/common.sh@352 -- # local d=2 00:25:56.818 17:01:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:56.818 17:01:42 -- scripts/common.sh@354 -- # echo 2 00:25:56.818 17:01:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:56.818 17:01:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:56.818 17:01:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:56.818 17:01:42 -- scripts/common.sh@367 -- # return 0 00:25:56.818 17:01:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:56.818 17:01:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:56.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:56.818 --rc genhtml_branch_coverage=1 00:25:56.818 --rc genhtml_function_coverage=1 00:25:56.818 --rc genhtml_legend=1 00:25:56.818 --rc geninfo_all_blocks=1 00:25:56.818 --rc geninfo_unexecuted_blocks=1 00:25:56.818 00:25:56.818 ' 00:25:56.818 17:01:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:56.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:56.819 --rc genhtml_branch_coverage=1 00:25:56.819 --rc genhtml_function_coverage=1 00:25:56.819 --rc genhtml_legend=1 00:25:56.819 --rc geninfo_all_blocks=1 00:25:56.819 --rc geninfo_unexecuted_blocks=1 00:25:56.819 00:25:56.819 ' 00:25:56.819 17:01:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:56.819 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:56.819 --rc genhtml_branch_coverage=1 00:25:56.819 --rc genhtml_function_coverage=1 00:25:56.819 --rc genhtml_legend=1 00:25:56.819 --rc geninfo_all_blocks=1 00:25:56.819 --rc geninfo_unexecuted_blocks=1 00:25:56.819 00:25:56.819 ' 00:25:56.819 17:01:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:56.819 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:56.819 --rc genhtml_branch_coverage=1 00:25:56.819 --rc genhtml_function_coverage=1 00:25:56.819 --rc genhtml_legend=1 00:25:56.819 --rc geninfo_all_blocks=1 00:25:56.819 --rc geninfo_unexecuted_blocks=1 00:25:56.819 00:25:56.819 ' 00:25:56.819 17:01:42 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:56.819 17:01:42 -- nvmf/common.sh@7 -- # uname -s 00:25:56.819 17:01:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:56.819 17:01:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:56.819 17:01:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:56.819 17:01:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:56.819 17:01:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:56.819 17:01:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:56.819 17:01:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:56.819 17:01:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:56.819 17:01:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:56.819 17:01:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:56.819 17:01:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:56.819 17:01:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:56.819 17:01:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:56.819 17:01:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:56.819 17:01:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:56.819 17:01:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:56.819 17:01:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:56.819 17:01:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:56.819 17:01:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:56.819 17:01:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:56.819 17:01:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:56.819 17:01:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:56.819 17:01:42 -- paths/export.sh@5 -- # export PATH 00:25:56.819 17:01:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:56.819 17:01:42 -- nvmf/common.sh@46 -- # : 0 00:25:56.819 17:01:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:56.819 17:01:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:56.819 17:01:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:56.819 17:01:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:56.819 17:01:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:56.819 17:01:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:56.819 17:01:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:56.819 17:01:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:56.819 17:01:42 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:56.819 17:01:42 -- host/async_init.sh@14 -- # null_block_size=512 00:25:56.819 17:01:42 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:56.819 17:01:42 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:56.819 17:01:42 -- host/async_init.sh@20 -- # uuidgen 00:25:56.819 17:01:42 -- host/async_init.sh@20 -- # tr -d - 00:25:56.819 17:01:42 -- host/async_init.sh@20 -- # nguid=ef9e24351b1c482295b1997299e3c926 00:25:56.819 17:01:42 -- host/async_init.sh@22 -- # nvmftestinit 00:25:56.819 17:01:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:56.819 17:01:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:56.819 17:01:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:56.819 17:01:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:56.819 17:01:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:56.819 17:01:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:56.819 17:01:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:56.819 17:01:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:56.819 17:01:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:56.819 17:01:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:56.819 17:01:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:56.819 17:01:42 -- common/autotest_common.sh@10 -- # set +x 00:25:58.728 17:01:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:58.728 17:01:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:58.728 17:01:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:58.728 17:01:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:58.728 17:01:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:58.728 17:01:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:58.728 17:01:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:58.728 17:01:44 -- nvmf/common.sh@294 -- # net_devs=() 00:25:58.728 17:01:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:58.728 17:01:44 -- nvmf/common.sh@295 -- # e810=() 00:25:58.728 17:01:44 -- nvmf/common.sh@295 -- # local -ga e810 00:25:58.728 17:01:44 -- nvmf/common.sh@296 -- # x722=() 00:25:58.728 17:01:44 -- nvmf/common.sh@296 -- # local -ga x722 00:25:58.728 17:01:44 -- nvmf/common.sh@297 -- # mlx=() 00:25:58.728 17:01:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:58.728 17:01:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:58.728 17:01:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:58.728 17:01:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:58.728 17:01:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:58.728 17:01:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:58.728 17:01:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:58.728 17:01:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:58.728 17:01:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:58.728 17:01:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:58.728 17:01:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:58.728 17:01:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:58.728 17:01:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:58.728 17:01:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:58.728 17:01:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:58.728 17:01:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:58.728 17:01:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:58.728 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:58.728 17:01:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:58.728 17:01:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:58.728 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:58.728 17:01:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:58.728 17:01:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:58.728 17:01:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:58.728 17:01:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:58.728 17:01:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:58.728 17:01:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:58.728 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:58.728 17:01:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:58.728 17:01:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:58.728 17:01:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:58.728 17:01:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:58.728 17:01:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:58.728 17:01:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:58.728 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:58.728 17:01:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:58.728 17:01:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:58.728 17:01:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:58.728 17:01:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:58.728 17:01:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:58.728 17:01:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:58.728 17:01:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:58.728 17:01:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:58.728 17:01:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:58.728 17:01:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:58.728 17:01:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:58.728 17:01:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:58.728 17:01:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:58.728 17:01:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:58.728 17:01:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:58.728 17:01:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:58.728 17:01:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:58.728 17:01:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:58.728 17:01:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:58.728 17:01:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:58.728 17:01:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:58.728 17:01:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:58.728 17:01:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:58.728 17:01:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:58.728 17:01:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:58.728 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:58.729 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.248 ms 00:25:58.729 00:25:58.729 --- 10.0.0.2 ping statistics --- 00:25:58.729 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:58.729 rtt min/avg/max/mdev = 0.248/0.248/0.248/0.000 ms 00:25:58.729 17:01:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:58.729 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:58.729 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:25:58.729 00:25:58.729 --- 10.0.0.1 ping statistics --- 00:25:58.729 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:58.729 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:25:58.729 17:01:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:58.729 17:01:44 -- nvmf/common.sh@410 -- # return 0 00:25:58.729 17:01:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:58.729 17:01:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:58.729 17:01:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:58.729 17:01:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:58.729 17:01:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:58.729 17:01:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:58.729 17:01:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:58.729 17:01:44 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:58.729 17:01:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:58.729 17:01:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:58.729 17:01:44 -- common/autotest_common.sh@10 -- # set +x 00:25:58.729 17:01:44 -- nvmf/common.sh@469 -- # nvmfpid=1283322 00:25:58.729 17:01:44 -- nvmf/common.sh@470 -- # waitforlisten 1283322 00:25:58.729 17:01:44 -- common/autotest_common.sh@829 -- # '[' -z 1283322 ']' 00:25:58.729 17:01:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:58.729 17:01:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:58.729 17:01:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:58.729 17:01:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:58.729 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:58.729 17:01:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:58.729 17:01:44 -- common/autotest_common.sh@10 -- # set +x 00:25:58.729 [2024-11-16 17:01:44.369221] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:58.729 [2024-11-16 17:01:44.369302] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:58.729 EAL: No free 2048 kB hugepages reported on node 1 00:25:58.729 [2024-11-16 17:01:44.437674] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:58.989 [2024-11-16 17:01:44.525310] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:58.989 [2024-11-16 17:01:44.525487] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:58.989 [2024-11-16 17:01:44.525506] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:58.989 [2024-11-16 17:01:44.525521] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:58.989 [2024-11-16 17:01:44.525551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:59.925 17:01:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:59.925 17:01:45 -- common/autotest_common.sh@862 -- # return 0 00:25:59.925 17:01:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:59.925 17:01:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:59.925 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:25:59.925 17:01:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:59.925 17:01:45 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:25:59.925 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:59.925 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:25:59.925 [2024-11-16 17:01:45.393627] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:59.925 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:59.925 17:01:45 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:25:59.925 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:59.925 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:25:59.925 null0 00:25:59.925 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:59.925 17:01:45 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:25:59.925 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:59.925 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:25:59.925 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:59.925 17:01:45 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:25:59.925 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:59.925 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:25:59.925 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:59.925 17:01:45 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g ef9e24351b1c482295b1997299e3c926 00:25:59.925 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:59.925 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:25:59.925 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:59.925 17:01:45 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:59.925 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:59.925 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:25:59.925 [2024-11-16 17:01:45.433865] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:59.925 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:59.925 17:01:45 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:25:59.925 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:59.925 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:25:59.925 nvme0n1 00:25:59.925 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:59.925 17:01:45 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:59.925 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:59.925 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:25:59.925 [ 00:25:59.925 { 00:25:59.925 "name": "nvme0n1", 00:25:59.925 "aliases": [ 00:25:59.925 "ef9e2435-1b1c-4822-95b1-997299e3c926" 00:25:59.925 ], 00:25:59.925 "product_name": "NVMe disk", 00:26:00.186 "block_size": 512, 00:26:00.186 "num_blocks": 2097152, 00:26:00.186 "uuid": "ef9e2435-1b1c-4822-95b1-997299e3c926", 00:26:00.186 "assigned_rate_limits": { 00:26:00.186 "rw_ios_per_sec": 0, 00:26:00.186 "rw_mbytes_per_sec": 0, 00:26:00.186 "r_mbytes_per_sec": 0, 00:26:00.186 "w_mbytes_per_sec": 0 00:26:00.186 }, 00:26:00.186 "claimed": false, 00:26:00.186 "zoned": false, 00:26:00.186 "supported_io_types": { 00:26:00.186 "read": true, 00:26:00.186 "write": true, 00:26:00.186 "unmap": false, 00:26:00.186 "write_zeroes": true, 00:26:00.186 "flush": true, 00:26:00.186 "reset": true, 00:26:00.186 "compare": true, 00:26:00.186 "compare_and_write": true, 00:26:00.186 "abort": true, 00:26:00.186 "nvme_admin": true, 00:26:00.186 "nvme_io": true 00:26:00.186 }, 00:26:00.186 "driver_specific": { 00:26:00.186 "nvme": [ 00:26:00.186 { 00:26:00.186 "trid": { 00:26:00.186 "trtype": "TCP", 00:26:00.186 "adrfam": "IPv4", 00:26:00.186 "traddr": "10.0.0.2", 00:26:00.186 "trsvcid": "4420", 00:26:00.186 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:00.186 }, 00:26:00.186 "ctrlr_data": { 00:26:00.186 "cntlid": 1, 00:26:00.186 "vendor_id": "0x8086", 00:26:00.186 "model_number": "SPDK bdev Controller", 00:26:00.186 "serial_number": "00000000000000000000", 00:26:00.186 "firmware_revision": "24.01.1", 00:26:00.186 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:00.186 "oacs": { 00:26:00.186 "security": 0, 00:26:00.186 "format": 0, 00:26:00.186 "firmware": 0, 00:26:00.186 "ns_manage": 0 00:26:00.186 }, 00:26:00.186 "multi_ctrlr": true, 00:26:00.186 "ana_reporting": false 00:26:00.186 }, 00:26:00.186 "vs": { 00:26:00.186 "nvme_version": "1.3" 00:26:00.186 }, 00:26:00.186 "ns_data": { 00:26:00.186 "id": 1, 00:26:00.186 "can_share": true 00:26:00.186 } 00:26:00.186 } 00:26:00.186 ], 00:26:00.186 "mp_policy": "active_passive" 00:26:00.186 } 00:26:00.186 } 00:26:00.186 ] 00:26:00.186 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.186 17:01:45 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:26:00.186 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.186 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:26:00.186 [2024-11-16 17:01:45.682666] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:00.186 [2024-11-16 17:01:45.682779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b5aba0 (9): Bad file descriptor 00:26:00.186 [2024-11-16 17:01:45.814761] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:00.186 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.186 17:01:45 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:00.186 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.186 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:26:00.186 [ 00:26:00.186 { 00:26:00.186 "name": "nvme0n1", 00:26:00.186 "aliases": [ 00:26:00.186 "ef9e2435-1b1c-4822-95b1-997299e3c926" 00:26:00.186 ], 00:26:00.186 "product_name": "NVMe disk", 00:26:00.186 "block_size": 512, 00:26:00.186 "num_blocks": 2097152, 00:26:00.186 "uuid": "ef9e2435-1b1c-4822-95b1-997299e3c926", 00:26:00.186 "assigned_rate_limits": { 00:26:00.186 "rw_ios_per_sec": 0, 00:26:00.186 "rw_mbytes_per_sec": 0, 00:26:00.186 "r_mbytes_per_sec": 0, 00:26:00.186 "w_mbytes_per_sec": 0 00:26:00.186 }, 00:26:00.186 "claimed": false, 00:26:00.186 "zoned": false, 00:26:00.186 "supported_io_types": { 00:26:00.186 "read": true, 00:26:00.186 "write": true, 00:26:00.186 "unmap": false, 00:26:00.186 "write_zeroes": true, 00:26:00.186 "flush": true, 00:26:00.186 "reset": true, 00:26:00.186 "compare": true, 00:26:00.186 "compare_and_write": true, 00:26:00.186 "abort": true, 00:26:00.186 "nvme_admin": true, 00:26:00.186 "nvme_io": true 00:26:00.186 }, 00:26:00.186 "driver_specific": { 00:26:00.186 "nvme": [ 00:26:00.186 { 00:26:00.186 "trid": { 00:26:00.186 "trtype": "TCP", 00:26:00.186 "adrfam": "IPv4", 00:26:00.186 "traddr": "10.0.0.2", 00:26:00.186 "trsvcid": "4420", 00:26:00.186 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:00.186 }, 00:26:00.186 "ctrlr_data": { 00:26:00.186 "cntlid": 2, 00:26:00.186 "vendor_id": "0x8086", 00:26:00.186 "model_number": "SPDK bdev Controller", 00:26:00.186 "serial_number": "00000000000000000000", 00:26:00.186 "firmware_revision": "24.01.1", 00:26:00.186 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:00.186 "oacs": { 00:26:00.186 "security": 0, 00:26:00.186 "format": 0, 00:26:00.186 "firmware": 0, 00:26:00.186 "ns_manage": 0 00:26:00.186 }, 00:26:00.186 "multi_ctrlr": true, 00:26:00.186 "ana_reporting": false 00:26:00.186 }, 00:26:00.186 "vs": { 00:26:00.186 "nvme_version": "1.3" 00:26:00.186 }, 00:26:00.186 "ns_data": { 00:26:00.186 "id": 1, 00:26:00.186 "can_share": true 00:26:00.186 } 00:26:00.186 } 00:26:00.186 ], 00:26:00.186 "mp_policy": "active_passive" 00:26:00.186 } 00:26:00.186 } 00:26:00.186 ] 00:26:00.186 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.186 17:01:45 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:00.186 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.186 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:26:00.186 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.186 17:01:45 -- host/async_init.sh@53 -- # mktemp 00:26:00.186 17:01:45 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.o3MONfqhwL 00:26:00.187 17:01:45 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:26:00.187 17:01:45 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.o3MONfqhwL 00:26:00.187 17:01:45 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:26:00.187 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.187 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:26:00.187 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.187 17:01:45 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:26:00.187 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.187 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:26:00.187 [2024-11-16 17:01:45.859254] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:26:00.187 [2024-11-16 17:01:45.859394] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:00.187 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.187 17:01:45 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.o3MONfqhwL 00:26:00.187 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.187 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:26:00.187 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.187 17:01:45 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.o3MONfqhwL 00:26:00.187 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.187 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:26:00.187 [2024-11-16 17:01:45.875290] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:26:00.450 nvme0n1 00:26:00.450 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.450 17:01:45 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:00.450 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.450 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:26:00.450 [ 00:26:00.450 { 00:26:00.450 "name": "nvme0n1", 00:26:00.450 "aliases": [ 00:26:00.450 "ef9e2435-1b1c-4822-95b1-997299e3c926" 00:26:00.450 ], 00:26:00.450 "product_name": "NVMe disk", 00:26:00.450 "block_size": 512, 00:26:00.450 "num_blocks": 2097152, 00:26:00.450 "uuid": "ef9e2435-1b1c-4822-95b1-997299e3c926", 00:26:00.450 "assigned_rate_limits": { 00:26:00.450 "rw_ios_per_sec": 0, 00:26:00.450 "rw_mbytes_per_sec": 0, 00:26:00.450 "r_mbytes_per_sec": 0, 00:26:00.450 "w_mbytes_per_sec": 0 00:26:00.450 }, 00:26:00.450 "claimed": false, 00:26:00.450 "zoned": false, 00:26:00.450 "supported_io_types": { 00:26:00.450 "read": true, 00:26:00.450 "write": true, 00:26:00.450 "unmap": false, 00:26:00.450 "write_zeroes": true, 00:26:00.450 "flush": true, 00:26:00.450 "reset": true, 00:26:00.450 "compare": true, 00:26:00.450 "compare_and_write": true, 00:26:00.450 "abort": true, 00:26:00.450 "nvme_admin": true, 00:26:00.450 "nvme_io": true 00:26:00.450 }, 00:26:00.450 "driver_specific": { 00:26:00.450 "nvme": [ 00:26:00.450 { 00:26:00.450 "trid": { 00:26:00.450 "trtype": "TCP", 00:26:00.450 "adrfam": "IPv4", 00:26:00.450 "traddr": "10.0.0.2", 00:26:00.450 "trsvcid": "4421", 00:26:00.450 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:00.451 }, 00:26:00.451 "ctrlr_data": { 00:26:00.451 "cntlid": 3, 00:26:00.451 "vendor_id": "0x8086", 00:26:00.451 "model_number": "SPDK bdev Controller", 00:26:00.451 "serial_number": "00000000000000000000", 00:26:00.451 "firmware_revision": "24.01.1", 00:26:00.451 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:00.451 "oacs": { 00:26:00.451 "security": 0, 00:26:00.451 "format": 0, 00:26:00.451 "firmware": 0, 00:26:00.451 "ns_manage": 0 00:26:00.451 }, 00:26:00.451 "multi_ctrlr": true, 00:26:00.451 "ana_reporting": false 00:26:00.451 }, 00:26:00.451 "vs": { 00:26:00.451 "nvme_version": "1.3" 00:26:00.451 }, 00:26:00.451 "ns_data": { 00:26:00.451 "id": 1, 00:26:00.451 "can_share": true 00:26:00.451 } 00:26:00.451 } 00:26:00.451 ], 00:26:00.451 "mp_policy": "active_passive" 00:26:00.451 } 00:26:00.451 } 00:26:00.451 ] 00:26:00.451 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.451 17:01:45 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:00.451 17:01:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.451 17:01:45 -- common/autotest_common.sh@10 -- # set +x 00:26:00.451 17:01:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.451 17:01:45 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.o3MONfqhwL 00:26:00.451 17:01:45 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:26:00.451 17:01:45 -- host/async_init.sh@78 -- # nvmftestfini 00:26:00.451 17:01:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:00.451 17:01:45 -- nvmf/common.sh@116 -- # sync 00:26:00.451 17:01:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:00.451 17:01:45 -- nvmf/common.sh@119 -- # set +e 00:26:00.451 17:01:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:00.451 17:01:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:00.451 rmmod nvme_tcp 00:26:00.451 rmmod nvme_fabrics 00:26:00.451 rmmod nvme_keyring 00:26:00.451 17:01:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:00.451 17:01:46 -- nvmf/common.sh@123 -- # set -e 00:26:00.451 17:01:46 -- nvmf/common.sh@124 -- # return 0 00:26:00.451 17:01:46 -- nvmf/common.sh@477 -- # '[' -n 1283322 ']' 00:26:00.451 17:01:46 -- nvmf/common.sh@478 -- # killprocess 1283322 00:26:00.451 17:01:46 -- common/autotest_common.sh@936 -- # '[' -z 1283322 ']' 00:26:00.451 17:01:46 -- common/autotest_common.sh@940 -- # kill -0 1283322 00:26:00.451 17:01:46 -- common/autotest_common.sh@941 -- # uname 00:26:00.451 17:01:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:00.451 17:01:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1283322 00:26:00.451 17:01:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:00.451 17:01:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:00.451 17:01:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1283322' 00:26:00.451 killing process with pid 1283322 00:26:00.451 17:01:46 -- common/autotest_common.sh@955 -- # kill 1283322 00:26:00.451 17:01:46 -- common/autotest_common.sh@960 -- # wait 1283322 00:26:00.758 17:01:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:00.758 17:01:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:00.758 17:01:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:00.758 17:01:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:00.758 17:01:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:00.758 17:01:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:00.758 17:01:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:00.758 17:01:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:02.686 17:01:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:02.686 00:26:02.686 real 0m6.307s 00:26:02.686 user 0m3.102s 00:26:02.686 sys 0m1.869s 00:26:02.686 17:01:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:02.686 17:01:48 -- common/autotest_common.sh@10 -- # set +x 00:26:02.686 ************************************ 00:26:02.686 END TEST nvmf_async_init 00:26:02.686 ************************************ 00:26:02.686 17:01:48 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:02.686 17:01:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:02.686 17:01:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:02.686 17:01:48 -- common/autotest_common.sh@10 -- # set +x 00:26:02.686 ************************************ 00:26:02.686 START TEST dma 00:26:02.686 ************************************ 00:26:02.686 17:01:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:02.686 * Looking for test storage... 00:26:02.686 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:02.686 17:01:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:02.686 17:01:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:02.686 17:01:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:02.945 17:01:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:02.945 17:01:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:02.945 17:01:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:02.945 17:01:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:02.945 17:01:48 -- scripts/common.sh@335 -- # IFS=.-: 00:26:02.945 17:01:48 -- scripts/common.sh@335 -- # read -ra ver1 00:26:02.945 17:01:48 -- scripts/common.sh@336 -- # IFS=.-: 00:26:02.945 17:01:48 -- scripts/common.sh@336 -- # read -ra ver2 00:26:02.945 17:01:48 -- scripts/common.sh@337 -- # local 'op=<' 00:26:02.945 17:01:48 -- scripts/common.sh@339 -- # ver1_l=2 00:26:02.945 17:01:48 -- scripts/common.sh@340 -- # ver2_l=1 00:26:02.945 17:01:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:02.945 17:01:48 -- scripts/common.sh@343 -- # case "$op" in 00:26:02.945 17:01:48 -- scripts/common.sh@344 -- # : 1 00:26:02.945 17:01:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:02.945 17:01:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:02.945 17:01:48 -- scripts/common.sh@364 -- # decimal 1 00:26:02.945 17:01:48 -- scripts/common.sh@352 -- # local d=1 00:26:02.945 17:01:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:02.945 17:01:48 -- scripts/common.sh@354 -- # echo 1 00:26:02.945 17:01:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:02.945 17:01:48 -- scripts/common.sh@365 -- # decimal 2 00:26:02.945 17:01:48 -- scripts/common.sh@352 -- # local d=2 00:26:02.945 17:01:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:02.945 17:01:48 -- scripts/common.sh@354 -- # echo 2 00:26:02.945 17:01:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:02.945 17:01:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:02.945 17:01:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:02.945 17:01:48 -- scripts/common.sh@367 -- # return 0 00:26:02.946 17:01:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:02.946 17:01:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:02.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.946 --rc genhtml_branch_coverage=1 00:26:02.946 --rc genhtml_function_coverage=1 00:26:02.946 --rc genhtml_legend=1 00:26:02.946 --rc geninfo_all_blocks=1 00:26:02.946 --rc geninfo_unexecuted_blocks=1 00:26:02.946 00:26:02.946 ' 00:26:02.946 17:01:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:02.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.946 --rc genhtml_branch_coverage=1 00:26:02.946 --rc genhtml_function_coverage=1 00:26:02.946 --rc genhtml_legend=1 00:26:02.946 --rc geninfo_all_blocks=1 00:26:02.946 --rc geninfo_unexecuted_blocks=1 00:26:02.946 00:26:02.946 ' 00:26:02.946 17:01:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:02.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.946 --rc genhtml_branch_coverage=1 00:26:02.946 --rc genhtml_function_coverage=1 00:26:02.946 --rc genhtml_legend=1 00:26:02.946 --rc geninfo_all_blocks=1 00:26:02.946 --rc geninfo_unexecuted_blocks=1 00:26:02.946 00:26:02.946 ' 00:26:02.946 17:01:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:02.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.946 --rc genhtml_branch_coverage=1 00:26:02.946 --rc genhtml_function_coverage=1 00:26:02.946 --rc genhtml_legend=1 00:26:02.946 --rc geninfo_all_blocks=1 00:26:02.946 --rc geninfo_unexecuted_blocks=1 00:26:02.946 00:26:02.946 ' 00:26:02.946 17:01:48 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:02.946 17:01:48 -- nvmf/common.sh@7 -- # uname -s 00:26:02.946 17:01:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:02.946 17:01:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:02.946 17:01:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:02.946 17:01:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:02.946 17:01:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:02.946 17:01:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:02.946 17:01:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:02.946 17:01:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:02.946 17:01:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:02.946 17:01:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:02.946 17:01:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:02.946 17:01:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:02.946 17:01:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:02.946 17:01:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:02.946 17:01:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:02.946 17:01:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:02.946 17:01:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:02.946 17:01:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:02.946 17:01:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:02.946 17:01:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.946 17:01:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.946 17:01:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.946 17:01:48 -- paths/export.sh@5 -- # export PATH 00:26:02.946 17:01:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.946 17:01:48 -- nvmf/common.sh@46 -- # : 0 00:26:02.946 17:01:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:02.946 17:01:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:02.946 17:01:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:02.946 17:01:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:02.946 17:01:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:02.946 17:01:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:02.946 17:01:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:02.946 17:01:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:02.946 17:01:48 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:26:02.946 17:01:48 -- host/dma.sh@13 -- # exit 0 00:26:02.946 00:26:02.946 real 0m0.156s 00:26:02.946 user 0m0.102s 00:26:02.946 sys 0m0.063s 00:26:02.946 17:01:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:02.946 17:01:48 -- common/autotest_common.sh@10 -- # set +x 00:26:02.946 ************************************ 00:26:02.946 END TEST dma 00:26:02.946 ************************************ 00:26:02.946 17:01:48 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:02.946 17:01:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:02.946 17:01:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:02.946 17:01:48 -- common/autotest_common.sh@10 -- # set +x 00:26:02.946 ************************************ 00:26:02.946 START TEST nvmf_identify 00:26:02.946 ************************************ 00:26:02.946 17:01:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:02.946 * Looking for test storage... 00:26:02.946 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:02.946 17:01:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:02.946 17:01:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:02.946 17:01:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:02.946 17:01:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:02.946 17:01:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:02.946 17:01:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:02.946 17:01:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:02.946 17:01:48 -- scripts/common.sh@335 -- # IFS=.-: 00:26:02.946 17:01:48 -- scripts/common.sh@335 -- # read -ra ver1 00:26:02.946 17:01:48 -- scripts/common.sh@336 -- # IFS=.-: 00:26:02.946 17:01:48 -- scripts/common.sh@336 -- # read -ra ver2 00:26:02.946 17:01:48 -- scripts/common.sh@337 -- # local 'op=<' 00:26:02.946 17:01:48 -- scripts/common.sh@339 -- # ver1_l=2 00:26:02.946 17:01:48 -- scripts/common.sh@340 -- # ver2_l=1 00:26:02.946 17:01:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:02.946 17:01:48 -- scripts/common.sh@343 -- # case "$op" in 00:26:02.946 17:01:48 -- scripts/common.sh@344 -- # : 1 00:26:02.946 17:01:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:02.946 17:01:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:02.946 17:01:48 -- scripts/common.sh@364 -- # decimal 1 00:26:02.946 17:01:48 -- scripts/common.sh@352 -- # local d=1 00:26:02.946 17:01:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:02.946 17:01:48 -- scripts/common.sh@354 -- # echo 1 00:26:02.946 17:01:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:02.946 17:01:48 -- scripts/common.sh@365 -- # decimal 2 00:26:02.946 17:01:48 -- scripts/common.sh@352 -- # local d=2 00:26:02.946 17:01:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:02.946 17:01:48 -- scripts/common.sh@354 -- # echo 2 00:26:02.946 17:01:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:02.946 17:01:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:02.946 17:01:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:02.946 17:01:48 -- scripts/common.sh@367 -- # return 0 00:26:02.946 17:01:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:02.946 17:01:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:02.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.946 --rc genhtml_branch_coverage=1 00:26:02.946 --rc genhtml_function_coverage=1 00:26:02.946 --rc genhtml_legend=1 00:26:02.946 --rc geninfo_all_blocks=1 00:26:02.946 --rc geninfo_unexecuted_blocks=1 00:26:02.946 00:26:02.946 ' 00:26:02.946 17:01:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:02.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.946 --rc genhtml_branch_coverage=1 00:26:02.946 --rc genhtml_function_coverage=1 00:26:02.946 --rc genhtml_legend=1 00:26:02.946 --rc geninfo_all_blocks=1 00:26:02.946 --rc geninfo_unexecuted_blocks=1 00:26:02.946 00:26:02.946 ' 00:26:02.946 17:01:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:02.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.946 --rc genhtml_branch_coverage=1 00:26:02.946 --rc genhtml_function_coverage=1 00:26:02.946 --rc genhtml_legend=1 00:26:02.946 --rc geninfo_all_blocks=1 00:26:02.946 --rc geninfo_unexecuted_blocks=1 00:26:02.946 00:26:02.947 ' 00:26:02.947 17:01:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:02.947 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.947 --rc genhtml_branch_coverage=1 00:26:02.947 --rc genhtml_function_coverage=1 00:26:02.947 --rc genhtml_legend=1 00:26:02.947 --rc geninfo_all_blocks=1 00:26:02.947 --rc geninfo_unexecuted_blocks=1 00:26:02.947 00:26:02.947 ' 00:26:02.947 17:01:48 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:02.947 17:01:48 -- nvmf/common.sh@7 -- # uname -s 00:26:02.947 17:01:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:02.947 17:01:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:02.947 17:01:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:02.947 17:01:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:02.947 17:01:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:02.947 17:01:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:02.947 17:01:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:02.947 17:01:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:02.947 17:01:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:02.947 17:01:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:02.947 17:01:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:02.947 17:01:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:02.947 17:01:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:02.947 17:01:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:02.947 17:01:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:02.947 17:01:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:02.947 17:01:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:02.947 17:01:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:02.947 17:01:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:02.947 17:01:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.947 17:01:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.947 17:01:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.947 17:01:48 -- paths/export.sh@5 -- # export PATH 00:26:02.947 17:01:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.947 17:01:48 -- nvmf/common.sh@46 -- # : 0 00:26:02.947 17:01:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:02.947 17:01:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:02.947 17:01:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:02.947 17:01:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:02.947 17:01:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:02.947 17:01:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:02.947 17:01:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:02.947 17:01:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:02.947 17:01:48 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:02.947 17:01:48 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:02.947 17:01:48 -- host/identify.sh@14 -- # nvmftestinit 00:26:02.947 17:01:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:02.947 17:01:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:02.947 17:01:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:02.947 17:01:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:02.947 17:01:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:02.947 17:01:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:02.947 17:01:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:02.947 17:01:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:03.205 17:01:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:03.205 17:01:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:03.205 17:01:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:03.205 17:01:48 -- common/autotest_common.sh@10 -- # set +x 00:26:05.107 17:01:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:05.107 17:01:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:05.107 17:01:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:05.107 17:01:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:05.107 17:01:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:05.107 17:01:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:05.107 17:01:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:05.107 17:01:50 -- nvmf/common.sh@294 -- # net_devs=() 00:26:05.107 17:01:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:05.107 17:01:50 -- nvmf/common.sh@295 -- # e810=() 00:26:05.107 17:01:50 -- nvmf/common.sh@295 -- # local -ga e810 00:26:05.107 17:01:50 -- nvmf/common.sh@296 -- # x722=() 00:26:05.107 17:01:50 -- nvmf/common.sh@296 -- # local -ga x722 00:26:05.107 17:01:50 -- nvmf/common.sh@297 -- # mlx=() 00:26:05.107 17:01:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:05.107 17:01:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:05.107 17:01:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:05.107 17:01:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:05.107 17:01:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:05.107 17:01:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:05.107 17:01:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:05.107 17:01:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:05.107 17:01:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:05.107 17:01:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:05.107 17:01:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:05.107 17:01:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:05.107 17:01:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:05.107 17:01:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:05.107 17:01:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:05.107 17:01:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:05.107 17:01:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:05.107 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:05.107 17:01:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:05.107 17:01:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:05.107 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:05.107 17:01:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:05.107 17:01:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:05.107 17:01:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:05.107 17:01:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:05.107 17:01:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:05.107 17:01:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:05.107 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:05.107 17:01:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:05.107 17:01:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:05.107 17:01:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:05.107 17:01:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:05.107 17:01:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:05.107 17:01:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:05.107 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:05.107 17:01:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:05.107 17:01:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:05.107 17:01:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:05.107 17:01:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:05.107 17:01:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:05.107 17:01:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:05.107 17:01:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:05.107 17:01:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:05.108 17:01:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:05.108 17:01:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:05.108 17:01:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:05.108 17:01:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:05.108 17:01:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:05.108 17:01:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:05.108 17:01:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:05.108 17:01:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:05.108 17:01:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:05.108 17:01:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:05.108 17:01:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:05.108 17:01:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:05.108 17:01:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:05.108 17:01:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:05.366 17:01:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:05.366 17:01:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:05.366 17:01:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:05.366 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:05.366 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.187 ms 00:26:05.366 00:26:05.366 --- 10.0.0.2 ping statistics --- 00:26:05.366 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:05.366 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:26:05.366 17:01:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:05.366 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:05.366 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:26:05.366 00:26:05.366 --- 10.0.0.1 ping statistics --- 00:26:05.366 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:05.366 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:26:05.366 17:01:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:05.366 17:01:50 -- nvmf/common.sh@410 -- # return 0 00:26:05.366 17:01:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:05.366 17:01:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:05.366 17:01:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:05.366 17:01:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:05.366 17:01:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:05.366 17:01:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:05.366 17:01:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:05.366 17:01:50 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:26:05.366 17:01:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:05.366 17:01:50 -- common/autotest_common.sh@10 -- # set +x 00:26:05.366 17:01:50 -- host/identify.sh@19 -- # nvmfpid=1285512 00:26:05.366 17:01:50 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:05.366 17:01:50 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:05.366 17:01:50 -- host/identify.sh@23 -- # waitforlisten 1285512 00:26:05.366 17:01:50 -- common/autotest_common.sh@829 -- # '[' -z 1285512 ']' 00:26:05.366 17:01:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:05.366 17:01:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:05.366 17:01:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:05.366 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:05.366 17:01:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:05.366 17:01:50 -- common/autotest_common.sh@10 -- # set +x 00:26:05.366 [2024-11-16 17:01:50.956893] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:05.366 [2024-11-16 17:01:50.956983] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:05.366 EAL: No free 2048 kB hugepages reported on node 1 00:26:05.366 [2024-11-16 17:01:51.027899] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:05.626 [2024-11-16 17:01:51.117372] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:05.626 [2024-11-16 17:01:51.117527] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:05.626 [2024-11-16 17:01:51.117546] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:05.626 [2024-11-16 17:01:51.117559] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:05.626 [2024-11-16 17:01:51.117620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:05.626 [2024-11-16 17:01:51.117687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:05.626 [2024-11-16 17:01:51.117819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:05.626 [2024-11-16 17:01:51.117822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:06.571 17:01:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:06.571 17:01:51 -- common/autotest_common.sh@862 -- # return 0 00:26:06.571 17:01:51 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:06.571 17:01:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.571 17:01:51 -- common/autotest_common.sh@10 -- # set +x 00:26:06.571 [2024-11-16 17:01:51.970453] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:06.571 17:01:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.571 17:01:51 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:26:06.571 17:01:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:06.571 17:01:51 -- common/autotest_common.sh@10 -- # set +x 00:26:06.571 17:01:52 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:06.571 17:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.571 17:01:52 -- common/autotest_common.sh@10 -- # set +x 00:26:06.571 Malloc0 00:26:06.571 17:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.571 17:01:52 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:06.571 17:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.571 17:01:52 -- common/autotest_common.sh@10 -- # set +x 00:26:06.571 17:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.571 17:01:52 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:26:06.571 17:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.571 17:01:52 -- common/autotest_common.sh@10 -- # set +x 00:26:06.571 17:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.571 17:01:52 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:06.571 17:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.571 17:01:52 -- common/autotest_common.sh@10 -- # set +x 00:26:06.571 [2024-11-16 17:01:52.051255] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:06.571 17:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.571 17:01:52 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:06.571 17:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.571 17:01:52 -- common/autotest_common.sh@10 -- # set +x 00:26:06.571 17:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.571 17:01:52 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:26:06.571 17:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.571 17:01:52 -- common/autotest_common.sh@10 -- # set +x 00:26:06.571 [2024-11-16 17:01:52.066956] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:06.571 [ 00:26:06.571 { 00:26:06.571 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:06.571 "subtype": "Discovery", 00:26:06.571 "listen_addresses": [ 00:26:06.571 { 00:26:06.571 "transport": "TCP", 00:26:06.571 "trtype": "TCP", 00:26:06.571 "adrfam": "IPv4", 00:26:06.571 "traddr": "10.0.0.2", 00:26:06.571 "trsvcid": "4420" 00:26:06.571 } 00:26:06.571 ], 00:26:06.571 "allow_any_host": true, 00:26:06.571 "hosts": [] 00:26:06.571 }, 00:26:06.571 { 00:26:06.571 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:06.571 "subtype": "NVMe", 00:26:06.571 "listen_addresses": [ 00:26:06.571 { 00:26:06.571 "transport": "TCP", 00:26:06.571 "trtype": "TCP", 00:26:06.571 "adrfam": "IPv4", 00:26:06.571 "traddr": "10.0.0.2", 00:26:06.571 "trsvcid": "4420" 00:26:06.571 } 00:26:06.571 ], 00:26:06.571 "allow_any_host": true, 00:26:06.571 "hosts": [], 00:26:06.571 "serial_number": "SPDK00000000000001", 00:26:06.571 "model_number": "SPDK bdev Controller", 00:26:06.571 "max_namespaces": 32, 00:26:06.571 "min_cntlid": 1, 00:26:06.571 "max_cntlid": 65519, 00:26:06.571 "namespaces": [ 00:26:06.571 { 00:26:06.571 "nsid": 1, 00:26:06.571 "bdev_name": "Malloc0", 00:26:06.571 "name": "Malloc0", 00:26:06.571 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:26:06.571 "eui64": "ABCDEF0123456789", 00:26:06.571 "uuid": "c4f33869-fb99-40c3-9064-0eb81fdc028f" 00:26:06.571 } 00:26:06.571 ] 00:26:06.571 } 00:26:06.571 ] 00:26:06.571 17:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.571 17:01:52 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:26:06.571 [2024-11-16 17:01:52.090070] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:06.571 [2024-11-16 17:01:52.090110] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1285699 ] 00:26:06.571 EAL: No free 2048 kB hugepages reported on node 1 00:26:06.571 [2024-11-16 17:01:52.121155] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:26:06.571 [2024-11-16 17:01:52.121219] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:06.571 [2024-11-16 17:01:52.121229] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:06.571 [2024-11-16 17:01:52.121256] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:06.571 [2024-11-16 17:01:52.121270] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:06.571 [2024-11-16 17:01:52.126672] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:26:06.571 [2024-11-16 17:01:52.126738] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x10102f0 0 00:26:06.571 [2024-11-16 17:01:52.126880] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:06.571 [2024-11-16 17:01:52.126898] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:06.571 [2024-11-16 17:01:52.126907] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:06.571 [2024-11-16 17:01:52.126913] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:06.571 [2024-11-16 17:01:52.126976] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.571 [2024-11-16 17:01:52.126989] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.571 [2024-11-16 17:01:52.126997] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10102f0) 00:26:06.571 [2024-11-16 17:01:52.127016] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:06.571 [2024-11-16 17:01:52.127040] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1068ec0, cid 0, qid 0 00:26:06.571 [2024-11-16 17:01:52.134643] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.571 [2024-11-16 17:01:52.134661] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.571 [2024-11-16 17:01:52.134668] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.571 [2024-11-16 17:01:52.134675] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1068ec0) on tqpair=0x10102f0 00:26:06.571 [2024-11-16 17:01:52.134695] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:06.571 [2024-11-16 17:01:52.134721] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:26:06.571 [2024-11-16 17:01:52.134731] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:26:06.571 [2024-11-16 17:01:52.134751] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.571 [2024-11-16 17:01:52.134760] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.571 [2024-11-16 17:01:52.134766] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10102f0) 00:26:06.571 [2024-11-16 17:01:52.134778] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.571 [2024-11-16 17:01:52.134801] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1068ec0, cid 0, qid 0 00:26:06.571 [2024-11-16 17:01:52.134930] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.571 [2024-11-16 17:01:52.134943] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.571 [2024-11-16 17:01:52.134949] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.571 [2024-11-16 17:01:52.134960] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1068ec0) on tqpair=0x10102f0 00:26:06.571 [2024-11-16 17:01:52.134972] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:26:06.571 [2024-11-16 17:01:52.134985] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:26:06.571 [2024-11-16 17:01:52.134997] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.571 [2024-11-16 17:01:52.135004] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.571 [2024-11-16 17:01:52.135011] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10102f0) 00:26:06.571 [2024-11-16 17:01:52.135021] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.571 [2024-11-16 17:01:52.135041] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1068ec0, cid 0, qid 0 00:26:06.571 [2024-11-16 17:01:52.135139] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.571 [2024-11-16 17:01:52.135153] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.571 [2024-11-16 17:01:52.135159] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.571 [2024-11-16 17:01:52.135165] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1068ec0) on tqpair=0x10102f0 00:26:06.571 [2024-11-16 17:01:52.135175] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:26:06.571 [2024-11-16 17:01:52.135189] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:26:06.571 [2024-11-16 17:01:52.135201] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.571 [2024-11-16 17:01:52.135208] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.571 [2024-11-16 17:01:52.135214] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10102f0) 00:26:06.572 [2024-11-16 17:01:52.135224] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.572 [2024-11-16 17:01:52.135244] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1068ec0, cid 0, qid 0 00:26:06.572 [2024-11-16 17:01:52.135331] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.572 [2024-11-16 17:01:52.135345] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.572 [2024-11-16 17:01:52.135351] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.135358] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1068ec0) on tqpair=0x10102f0 00:26:06.572 [2024-11-16 17:01:52.135368] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:06.572 [2024-11-16 17:01:52.135384] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.135393] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.135400] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10102f0) 00:26:06.572 [2024-11-16 17:01:52.135410] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.572 [2024-11-16 17:01:52.135430] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1068ec0, cid 0, qid 0 00:26:06.572 [2024-11-16 17:01:52.135503] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.572 [2024-11-16 17:01:52.135517] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.572 [2024-11-16 17:01:52.135523] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.135530] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1068ec0) on tqpair=0x10102f0 00:26:06.572 [2024-11-16 17:01:52.135539] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:26:06.572 [2024-11-16 17:01:52.135552] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:26:06.572 [2024-11-16 17:01:52.135566] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:06.572 [2024-11-16 17:01:52.135676] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:26:06.572 [2024-11-16 17:01:52.135686] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:06.572 [2024-11-16 17:01:52.135701] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.135709] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.135715] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10102f0) 00:26:06.572 [2024-11-16 17:01:52.135725] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.572 [2024-11-16 17:01:52.135746] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1068ec0, cid 0, qid 0 00:26:06.572 [2024-11-16 17:01:52.135859] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.572 [2024-11-16 17:01:52.135871] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.572 [2024-11-16 17:01:52.135877] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.135884] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1068ec0) on tqpair=0x10102f0 00:26:06.572 [2024-11-16 17:01:52.135893] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:06.572 [2024-11-16 17:01:52.135915] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.135924] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.135930] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10102f0) 00:26:06.572 [2024-11-16 17:01:52.135940] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.572 [2024-11-16 17:01:52.135959] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1068ec0, cid 0, qid 0 00:26:06.572 [2024-11-16 17:01:52.136052] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.572 [2024-11-16 17:01:52.136066] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.572 [2024-11-16 17:01:52.136072] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136079] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1068ec0) on tqpair=0x10102f0 00:26:06.572 [2024-11-16 17:01:52.136087] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:06.572 [2024-11-16 17:01:52.136095] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:26:06.572 [2024-11-16 17:01:52.136109] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:26:06.572 [2024-11-16 17:01:52.136129] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:26:06.572 [2024-11-16 17:01:52.136144] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136152] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136158] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10102f0) 00:26:06.572 [2024-11-16 17:01:52.136169] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.572 [2024-11-16 17:01:52.136193] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1068ec0, cid 0, qid 0 00:26:06.572 [2024-11-16 17:01:52.136321] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.572 [2024-11-16 17:01:52.136340] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.572 [2024-11-16 17:01:52.136347] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136353] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10102f0): datao=0, datal=4096, cccid=0 00:26:06.572 [2024-11-16 17:01:52.136361] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1068ec0) on tqpair(0x10102f0): expected_datao=0, payload_size=4096 00:26:06.572 [2024-11-16 17:01:52.136379] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136389] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136409] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.572 [2024-11-16 17:01:52.136419] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.572 [2024-11-16 17:01:52.136425] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136431] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1068ec0) on tqpair=0x10102f0 00:26:06.572 [2024-11-16 17:01:52.136445] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:26:06.572 [2024-11-16 17:01:52.136453] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:26:06.572 [2024-11-16 17:01:52.136461] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:26:06.572 [2024-11-16 17:01:52.136470] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:26:06.572 [2024-11-16 17:01:52.136478] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:26:06.572 [2024-11-16 17:01:52.136485] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:26:06.572 [2024-11-16 17:01:52.136505] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:26:06.572 [2024-11-16 17:01:52.136518] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136526] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136532] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10102f0) 00:26:06.572 [2024-11-16 17:01:52.136543] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:06.572 [2024-11-16 17:01:52.136564] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1068ec0, cid 0, qid 0 00:26:06.572 [2024-11-16 17:01:52.136670] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.572 [2024-11-16 17:01:52.136684] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.572 [2024-11-16 17:01:52.136691] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136697] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1068ec0) on tqpair=0x10102f0 00:26:06.572 [2024-11-16 17:01:52.136711] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136718] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136724] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10102f0) 00:26:06.572 [2024-11-16 17:01:52.136734] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.572 [2024-11-16 17:01:52.136743] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136754] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136761] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x10102f0) 00:26:06.572 [2024-11-16 17:01:52.136770] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.572 [2024-11-16 17:01:52.136779] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136786] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136792] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x10102f0) 00:26:06.572 [2024-11-16 17:01:52.136800] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.572 [2024-11-16 17:01:52.136810] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136816] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136822] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.572 [2024-11-16 17:01:52.136831] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.572 [2024-11-16 17:01:52.136839] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:26:06.572 [2024-11-16 17:01:52.136858] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:06.572 [2024-11-16 17:01:52.136870] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136877] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.572 [2024-11-16 17:01:52.136884] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10102f0) 00:26:06.573 [2024-11-16 17:01:52.136894] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.573 [2024-11-16 17:01:52.136916] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1068ec0, cid 0, qid 0 00:26:06.573 [2024-11-16 17:01:52.136927] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1069020, cid 1, qid 0 00:26:06.573 [2024-11-16 17:01:52.136935] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1069180, cid 2, qid 0 00:26:06.573 [2024-11-16 17:01:52.136942] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.573 [2024-11-16 17:01:52.136949] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1069440, cid 4, qid 0 00:26:06.573 [2024-11-16 17:01:52.137087] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.573 [2024-11-16 17:01:52.137099] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.573 [2024-11-16 17:01:52.137105] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137112] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1069440) on tqpair=0x10102f0 00:26:06.573 [2024-11-16 17:01:52.137122] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:26:06.573 [2024-11-16 17:01:52.137130] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:26:06.573 [2024-11-16 17:01:52.137146] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137155] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137162] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10102f0) 00:26:06.573 [2024-11-16 17:01:52.137171] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.573 [2024-11-16 17:01:52.137191] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1069440, cid 4, qid 0 00:26:06.573 [2024-11-16 17:01:52.137283] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.573 [2024-11-16 17:01:52.137297] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.573 [2024-11-16 17:01:52.137304] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137310] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10102f0): datao=0, datal=4096, cccid=4 00:26:06.573 [2024-11-16 17:01:52.137317] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1069440) on tqpair(0x10102f0): expected_datao=0, payload_size=4096 00:26:06.573 [2024-11-16 17:01:52.137328] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137334] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137346] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.573 [2024-11-16 17:01:52.137355] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.573 [2024-11-16 17:01:52.137361] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137368] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1069440) on tqpair=0x10102f0 00:26:06.573 [2024-11-16 17:01:52.137388] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:26:06.573 [2024-11-16 17:01:52.137424] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137435] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137441] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10102f0) 00:26:06.573 [2024-11-16 17:01:52.137451] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.573 [2024-11-16 17:01:52.137463] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137469] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137475] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x10102f0) 00:26:06.573 [2024-11-16 17:01:52.137484] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.573 [2024-11-16 17:01:52.137510] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1069440, cid 4, qid 0 00:26:06.573 [2024-11-16 17:01:52.137521] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10695a0, cid 5, qid 0 00:26:06.573 [2024-11-16 17:01:52.137669] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.573 [2024-11-16 17:01:52.137684] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.573 [2024-11-16 17:01:52.137691] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137697] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10102f0): datao=0, datal=1024, cccid=4 00:26:06.573 [2024-11-16 17:01:52.137704] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1069440) on tqpair(0x10102f0): expected_datao=0, payload_size=1024 00:26:06.573 [2024-11-16 17:01:52.137714] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137721] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137730] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.573 [2024-11-16 17:01:52.137738] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.573 [2024-11-16 17:01:52.137744] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.137750] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10695a0) on tqpair=0x10102f0 00:26:06.573 [2024-11-16 17:01:52.182634] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.573 [2024-11-16 17:01:52.182654] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.573 [2024-11-16 17:01:52.182661] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.182668] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1069440) on tqpair=0x10102f0 00:26:06.573 [2024-11-16 17:01:52.182692] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.182702] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.182709] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10102f0) 00:26:06.573 [2024-11-16 17:01:52.182720] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.573 [2024-11-16 17:01:52.182749] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1069440, cid 4, qid 0 00:26:06.573 [2024-11-16 17:01:52.182874] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.573 [2024-11-16 17:01:52.182888] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.573 [2024-11-16 17:01:52.182895] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.182901] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10102f0): datao=0, datal=3072, cccid=4 00:26:06.573 [2024-11-16 17:01:52.182908] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1069440) on tqpair(0x10102f0): expected_datao=0, payload_size=3072 00:26:06.573 [2024-11-16 17:01:52.182927] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.182936] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.182960] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.573 [2024-11-16 17:01:52.182971] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.573 [2024-11-16 17:01:52.182977] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.182984] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1069440) on tqpair=0x10102f0 00:26:06.573 [2024-11-16 17:01:52.182999] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.183008] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.183014] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10102f0) 00:26:06.573 [2024-11-16 17:01:52.183024] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.573 [2024-11-16 17:01:52.183052] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1069440, cid 4, qid 0 00:26:06.573 [2024-11-16 17:01:52.183149] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.573 [2024-11-16 17:01:52.183163] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.573 [2024-11-16 17:01:52.183169] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.183176] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10102f0): datao=0, datal=8, cccid=4 00:26:06.573 [2024-11-16 17:01:52.183183] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1069440) on tqpair(0x10102f0): expected_datao=0, payload_size=8 00:26:06.573 [2024-11-16 17:01:52.183193] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.183200] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.223760] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.573 [2024-11-16 17:01:52.223779] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.573 [2024-11-16 17:01:52.223787] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.573 [2024-11-16 17:01:52.223794] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1069440) on tqpair=0x10102f0 00:26:06.573 ===================================================== 00:26:06.573 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:26:06.573 ===================================================== 00:26:06.573 Controller Capabilities/Features 00:26:06.573 ================================ 00:26:06.573 Vendor ID: 0000 00:26:06.573 Subsystem Vendor ID: 0000 00:26:06.573 Serial Number: .................... 00:26:06.573 Model Number: ........................................ 00:26:06.573 Firmware Version: 24.01.1 00:26:06.573 Recommended Arb Burst: 0 00:26:06.573 IEEE OUI Identifier: 00 00 00 00:26:06.573 Multi-path I/O 00:26:06.573 May have multiple subsystem ports: No 00:26:06.573 May have multiple controllers: No 00:26:06.573 Associated with SR-IOV VF: No 00:26:06.573 Max Data Transfer Size: 131072 00:26:06.573 Max Number of Namespaces: 0 00:26:06.573 Max Number of I/O Queues: 1024 00:26:06.573 NVMe Specification Version (VS): 1.3 00:26:06.573 NVMe Specification Version (Identify): 1.3 00:26:06.573 Maximum Queue Entries: 128 00:26:06.573 Contiguous Queues Required: Yes 00:26:06.573 Arbitration Mechanisms Supported 00:26:06.574 Weighted Round Robin: Not Supported 00:26:06.574 Vendor Specific: Not Supported 00:26:06.574 Reset Timeout: 15000 ms 00:26:06.574 Doorbell Stride: 4 bytes 00:26:06.574 NVM Subsystem Reset: Not Supported 00:26:06.574 Command Sets Supported 00:26:06.574 NVM Command Set: Supported 00:26:06.574 Boot Partition: Not Supported 00:26:06.574 Memory Page Size Minimum: 4096 bytes 00:26:06.574 Memory Page Size Maximum: 4096 bytes 00:26:06.574 Persistent Memory Region: Not Supported 00:26:06.574 Optional Asynchronous Events Supported 00:26:06.574 Namespace Attribute Notices: Not Supported 00:26:06.574 Firmware Activation Notices: Not Supported 00:26:06.574 ANA Change Notices: Not Supported 00:26:06.574 PLE Aggregate Log Change Notices: Not Supported 00:26:06.574 LBA Status Info Alert Notices: Not Supported 00:26:06.574 EGE Aggregate Log Change Notices: Not Supported 00:26:06.574 Normal NVM Subsystem Shutdown event: Not Supported 00:26:06.574 Zone Descriptor Change Notices: Not Supported 00:26:06.574 Discovery Log Change Notices: Supported 00:26:06.574 Controller Attributes 00:26:06.574 128-bit Host Identifier: Not Supported 00:26:06.574 Non-Operational Permissive Mode: Not Supported 00:26:06.574 NVM Sets: Not Supported 00:26:06.574 Read Recovery Levels: Not Supported 00:26:06.574 Endurance Groups: Not Supported 00:26:06.574 Predictable Latency Mode: Not Supported 00:26:06.574 Traffic Based Keep ALive: Not Supported 00:26:06.574 Namespace Granularity: Not Supported 00:26:06.574 SQ Associations: Not Supported 00:26:06.574 UUID List: Not Supported 00:26:06.574 Multi-Domain Subsystem: Not Supported 00:26:06.574 Fixed Capacity Management: Not Supported 00:26:06.574 Variable Capacity Management: Not Supported 00:26:06.574 Delete Endurance Group: Not Supported 00:26:06.574 Delete NVM Set: Not Supported 00:26:06.574 Extended LBA Formats Supported: Not Supported 00:26:06.574 Flexible Data Placement Supported: Not Supported 00:26:06.574 00:26:06.574 Controller Memory Buffer Support 00:26:06.574 ================================ 00:26:06.574 Supported: No 00:26:06.574 00:26:06.574 Persistent Memory Region Support 00:26:06.574 ================================ 00:26:06.574 Supported: No 00:26:06.574 00:26:06.574 Admin Command Set Attributes 00:26:06.574 ============================ 00:26:06.574 Security Send/Receive: Not Supported 00:26:06.574 Format NVM: Not Supported 00:26:06.574 Firmware Activate/Download: Not Supported 00:26:06.574 Namespace Management: Not Supported 00:26:06.574 Device Self-Test: Not Supported 00:26:06.574 Directives: Not Supported 00:26:06.574 NVMe-MI: Not Supported 00:26:06.574 Virtualization Management: Not Supported 00:26:06.574 Doorbell Buffer Config: Not Supported 00:26:06.574 Get LBA Status Capability: Not Supported 00:26:06.574 Command & Feature Lockdown Capability: Not Supported 00:26:06.574 Abort Command Limit: 1 00:26:06.574 Async Event Request Limit: 4 00:26:06.574 Number of Firmware Slots: N/A 00:26:06.574 Firmware Slot 1 Read-Only: N/A 00:26:06.574 Firmware Activation Without Reset: N/A 00:26:06.574 Multiple Update Detection Support: N/A 00:26:06.574 Firmware Update Granularity: No Information Provided 00:26:06.574 Per-Namespace SMART Log: No 00:26:06.574 Asymmetric Namespace Access Log Page: Not Supported 00:26:06.574 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:26:06.574 Command Effects Log Page: Not Supported 00:26:06.574 Get Log Page Extended Data: Supported 00:26:06.574 Telemetry Log Pages: Not Supported 00:26:06.574 Persistent Event Log Pages: Not Supported 00:26:06.574 Supported Log Pages Log Page: May Support 00:26:06.574 Commands Supported & Effects Log Page: Not Supported 00:26:06.574 Feature Identifiers & Effects Log Page:May Support 00:26:06.574 NVMe-MI Commands & Effects Log Page: May Support 00:26:06.574 Data Area 4 for Telemetry Log: Not Supported 00:26:06.574 Error Log Page Entries Supported: 128 00:26:06.574 Keep Alive: Not Supported 00:26:06.574 00:26:06.574 NVM Command Set Attributes 00:26:06.574 ========================== 00:26:06.574 Submission Queue Entry Size 00:26:06.574 Max: 1 00:26:06.574 Min: 1 00:26:06.574 Completion Queue Entry Size 00:26:06.574 Max: 1 00:26:06.574 Min: 1 00:26:06.574 Number of Namespaces: 0 00:26:06.574 Compare Command: Not Supported 00:26:06.574 Write Uncorrectable Command: Not Supported 00:26:06.574 Dataset Management Command: Not Supported 00:26:06.574 Write Zeroes Command: Not Supported 00:26:06.574 Set Features Save Field: Not Supported 00:26:06.574 Reservations: Not Supported 00:26:06.574 Timestamp: Not Supported 00:26:06.574 Copy: Not Supported 00:26:06.574 Volatile Write Cache: Not Present 00:26:06.574 Atomic Write Unit (Normal): 1 00:26:06.574 Atomic Write Unit (PFail): 1 00:26:06.574 Atomic Compare & Write Unit: 1 00:26:06.574 Fused Compare & Write: Supported 00:26:06.574 Scatter-Gather List 00:26:06.574 SGL Command Set: Supported 00:26:06.574 SGL Keyed: Supported 00:26:06.574 SGL Bit Bucket Descriptor: Not Supported 00:26:06.574 SGL Metadata Pointer: Not Supported 00:26:06.574 Oversized SGL: Not Supported 00:26:06.574 SGL Metadata Address: Not Supported 00:26:06.574 SGL Offset: Supported 00:26:06.574 Transport SGL Data Block: Not Supported 00:26:06.574 Replay Protected Memory Block: Not Supported 00:26:06.574 00:26:06.574 Firmware Slot Information 00:26:06.574 ========================= 00:26:06.574 Active slot: 0 00:26:06.574 00:26:06.574 00:26:06.574 Error Log 00:26:06.574 ========= 00:26:06.574 00:26:06.574 Active Namespaces 00:26:06.574 ================= 00:26:06.574 Discovery Log Page 00:26:06.574 ================== 00:26:06.574 Generation Counter: 2 00:26:06.574 Number of Records: 2 00:26:06.574 Record Format: 0 00:26:06.574 00:26:06.574 Discovery Log Entry 0 00:26:06.574 ---------------------- 00:26:06.574 Transport Type: 3 (TCP) 00:26:06.574 Address Family: 1 (IPv4) 00:26:06.574 Subsystem Type: 3 (Current Discovery Subsystem) 00:26:06.574 Entry Flags: 00:26:06.574 Duplicate Returned Information: 1 00:26:06.574 Explicit Persistent Connection Support for Discovery: 1 00:26:06.574 Transport Requirements: 00:26:06.574 Secure Channel: Not Required 00:26:06.574 Port ID: 0 (0x0000) 00:26:06.574 Controller ID: 65535 (0xffff) 00:26:06.574 Admin Max SQ Size: 128 00:26:06.574 Transport Service Identifier: 4420 00:26:06.574 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:26:06.574 Transport Address: 10.0.0.2 00:26:06.574 Discovery Log Entry 1 00:26:06.574 ---------------------- 00:26:06.574 Transport Type: 3 (TCP) 00:26:06.574 Address Family: 1 (IPv4) 00:26:06.574 Subsystem Type: 2 (NVM Subsystem) 00:26:06.574 Entry Flags: 00:26:06.574 Duplicate Returned Information: 0 00:26:06.574 Explicit Persistent Connection Support for Discovery: 0 00:26:06.574 Transport Requirements: 00:26:06.574 Secure Channel: Not Required 00:26:06.574 Port ID: 0 (0x0000) 00:26:06.574 Controller ID: 65535 (0xffff) 00:26:06.574 Admin Max SQ Size: 128 00:26:06.574 Transport Service Identifier: 4420 00:26:06.574 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:26:06.574 Transport Address: 10.0.0.2 [2024-11-16 17:01:52.223908] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:26:06.574 [2024-11-16 17:01:52.223940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.574 [2024-11-16 17:01:52.223953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.574 [2024-11-16 17:01:52.223966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.574 [2024-11-16 17:01:52.223977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.574 [2024-11-16 17:01:52.223990] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.574 [2024-11-16 17:01:52.223998] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.574 [2024-11-16 17:01:52.224004] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.574 [2024-11-16 17:01:52.224016] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.574 [2024-11-16 17:01:52.224056] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.574 [2024-11-16 17:01:52.224236] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.574 [2024-11-16 17:01:52.224257] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.574 [2024-11-16 17:01:52.224264] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.574 [2024-11-16 17:01:52.224271] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10692e0) on tqpair=0x10102f0 00:26:06.575 [2024-11-16 17:01:52.224284] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.224292] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.224299] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.575 [2024-11-16 17:01:52.224309] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.575 [2024-11-16 17:01:52.224335] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.575 [2024-11-16 17:01:52.224483] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.575 [2024-11-16 17:01:52.224495] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.575 [2024-11-16 17:01:52.224501] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.224508] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10692e0) on tqpair=0x10102f0 00:26:06.575 [2024-11-16 17:01:52.224518] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:26:06.575 [2024-11-16 17:01:52.224526] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:26:06.575 [2024-11-16 17:01:52.224541] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.224550] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.224556] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.575 [2024-11-16 17:01:52.224566] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.575 [2024-11-16 17:01:52.224586] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.575 [2024-11-16 17:01:52.224684] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.575 [2024-11-16 17:01:52.224699] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.575 [2024-11-16 17:01:52.224706] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.224713] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10692e0) on tqpair=0x10102f0 00:26:06.575 [2024-11-16 17:01:52.224731] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.224740] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.224746] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.575 [2024-11-16 17:01:52.224756] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.575 [2024-11-16 17:01:52.224781] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.575 [2024-11-16 17:01:52.224862] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.575 [2024-11-16 17:01:52.224874] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.575 [2024-11-16 17:01:52.224880] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.224887] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10692e0) on tqpair=0x10102f0 00:26:06.575 [2024-11-16 17:01:52.224904] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.224913] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.224919] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.575 [2024-11-16 17:01:52.224930] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.575 [2024-11-16 17:01:52.224961] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.575 [2024-11-16 17:01:52.225034] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.575 [2024-11-16 17:01:52.225046] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.575 [2024-11-16 17:01:52.225053] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225059] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10692e0) on tqpair=0x10102f0 00:26:06.575 [2024-11-16 17:01:52.225076] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225085] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225091] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.575 [2024-11-16 17:01:52.225102] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.575 [2024-11-16 17:01:52.225121] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.575 [2024-11-16 17:01:52.225247] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.575 [2024-11-16 17:01:52.225259] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.575 [2024-11-16 17:01:52.225265] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225272] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10692e0) on tqpair=0x10102f0 00:26:06.575 [2024-11-16 17:01:52.225289] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225297] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225304] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.575 [2024-11-16 17:01:52.225314] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.575 [2024-11-16 17:01:52.225334] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.575 [2024-11-16 17:01:52.225412] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.575 [2024-11-16 17:01:52.225426] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.575 [2024-11-16 17:01:52.225433] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225439] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10692e0) on tqpair=0x10102f0 00:26:06.575 [2024-11-16 17:01:52.225456] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225465] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225471] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.575 [2024-11-16 17:01:52.225482] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.575 [2024-11-16 17:01:52.225502] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.575 [2024-11-16 17:01:52.225626] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.575 [2024-11-16 17:01:52.225641] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.575 [2024-11-16 17:01:52.225648] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225654] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10692e0) on tqpair=0x10102f0 00:26:06.575 [2024-11-16 17:01:52.225672] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225681] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225688] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.575 [2024-11-16 17:01:52.225698] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.575 [2024-11-16 17:01:52.225718] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.575 [2024-11-16 17:01:52.225812] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.575 [2024-11-16 17:01:52.225824] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.575 [2024-11-16 17:01:52.225830] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225837] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10692e0) on tqpair=0x10102f0 00:26:06.575 [2024-11-16 17:01:52.225853] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225862] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.225868] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.575 [2024-11-16 17:01:52.225879] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.575 [2024-11-16 17:01:52.225909] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.575 [2024-11-16 17:01:52.225982] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.575 [2024-11-16 17:01:52.225994] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.575 [2024-11-16 17:01:52.226001] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.226007] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10692e0) on tqpair=0x10102f0 00:26:06.575 [2024-11-16 17:01:52.226024] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.575 [2024-11-16 17:01:52.226033] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.226039] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.576 [2024-11-16 17:01:52.226049] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.576 [2024-11-16 17:01:52.226069] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.576 [2024-11-16 17:01:52.226150] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.576 [2024-11-16 17:01:52.226164] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.576 [2024-11-16 17:01:52.226171] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.226177] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10692e0) on tqpair=0x10102f0 00:26:06.576 [2024-11-16 17:01:52.226194] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.226203] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.226209] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.576 [2024-11-16 17:01:52.226220] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.576 [2024-11-16 17:01:52.226240] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.576 [2024-11-16 17:01:52.226343] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.576 [2024-11-16 17:01:52.226356] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.576 [2024-11-16 17:01:52.226363] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.226369] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10692e0) on tqpair=0x10102f0 00:26:06.576 [2024-11-16 17:01:52.226386] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.226395] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.226401] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.576 [2024-11-16 17:01:52.226411] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.576 [2024-11-16 17:01:52.226431] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.576 [2024-11-16 17:01:52.226555] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.576 [2024-11-16 17:01:52.226567] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.576 [2024-11-16 17:01:52.226573] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.226580] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10692e0) on tqpair=0x10102f0 00:26:06.576 [2024-11-16 17:01:52.226596] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.230626] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.230639] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10102f0) 00:26:06.576 [2024-11-16 17:01:52.230651] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.576 [2024-11-16 17:01:52.230674] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x10692e0, cid 3, qid 0 00:26:06.576 [2024-11-16 17:01:52.230805] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.576 [2024-11-16 17:01:52.230818] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.576 [2024-11-16 17:01:52.230825] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.230831] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x10692e0) on tqpair=0x10102f0 00:26:06.576 [2024-11-16 17:01:52.230846] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:26:06.576 00:26:06.576 17:01:52 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:26:06.576 [2024-11-16 17:01:52.260520] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:06.576 [2024-11-16 17:01:52.260560] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1285778 ] 00:26:06.576 EAL: No free 2048 kB hugepages reported on node 1 00:26:06.576 [2024-11-16 17:01:52.293073] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:26:06.576 [2024-11-16 17:01:52.293120] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:06.576 [2024-11-16 17:01:52.293130] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:06.576 [2024-11-16 17:01:52.293144] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:06.576 [2024-11-16 17:01:52.293155] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:06.576 [2024-11-16 17:01:52.293355] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:26:06.576 [2024-11-16 17:01:52.293401] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x11042f0 0 00:26:06.576 [2024-11-16 17:01:52.303635] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:06.576 [2024-11-16 17:01:52.303655] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:06.576 [2024-11-16 17:01:52.303663] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:06.576 [2024-11-16 17:01:52.303669] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:06.576 [2024-11-16 17:01:52.303708] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.303720] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.303726] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11042f0) 00:26:06.576 [2024-11-16 17:01:52.303739] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:06.576 [2024-11-16 17:01:52.303766] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115cec0, cid 0, qid 0 00:26:06.576 [2024-11-16 17:01:52.311633] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.576 [2024-11-16 17:01:52.311650] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.576 [2024-11-16 17:01:52.311657] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.311664] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115cec0) on tqpair=0x11042f0 00:26:06.576 [2024-11-16 17:01:52.311684] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:06.576 [2024-11-16 17:01:52.311695] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:26:06.576 [2024-11-16 17:01:52.311703] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:26:06.576 [2024-11-16 17:01:52.311728] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.311737] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.311743] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11042f0) 00:26:06.576 [2024-11-16 17:01:52.311754] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.576 [2024-11-16 17:01:52.311777] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115cec0, cid 0, qid 0 00:26:06.576 [2024-11-16 17:01:52.311863] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.576 [2024-11-16 17:01:52.311878] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.576 [2024-11-16 17:01:52.311885] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.311892] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115cec0) on tqpair=0x11042f0 00:26:06.576 [2024-11-16 17:01:52.311901] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:26:06.576 [2024-11-16 17:01:52.311913] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:26:06.576 [2024-11-16 17:01:52.311925] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.311933] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.311939] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11042f0) 00:26:06.576 [2024-11-16 17:01:52.311949] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.576 [2024-11-16 17:01:52.311971] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115cec0, cid 0, qid 0 00:26:06.576 [2024-11-16 17:01:52.312063] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.576 [2024-11-16 17:01:52.312076] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.576 [2024-11-16 17:01:52.312087] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.312094] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115cec0) on tqpair=0x11042f0 00:26:06.576 [2024-11-16 17:01:52.312103] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:26:06.576 [2024-11-16 17:01:52.312117] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:26:06.576 [2024-11-16 17:01:52.312129] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.312136] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.312142] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11042f0) 00:26:06.576 [2024-11-16 17:01:52.312153] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.576 [2024-11-16 17:01:52.312173] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115cec0, cid 0, qid 0 00:26:06.576 [2024-11-16 17:01:52.312244] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.576 [2024-11-16 17:01:52.312257] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.576 [2024-11-16 17:01:52.312263] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.312270] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115cec0) on tqpair=0x11042f0 00:26:06.576 [2024-11-16 17:01:52.312279] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:06.576 [2024-11-16 17:01:52.312295] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.312304] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.576 [2024-11-16 17:01:52.312311] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11042f0) 00:26:06.576 [2024-11-16 17:01:52.312321] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.576 [2024-11-16 17:01:52.312341] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115cec0, cid 0, qid 0 00:26:06.577 [2024-11-16 17:01:52.312421] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.577 [2024-11-16 17:01:52.312435] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.577 [2024-11-16 17:01:52.312442] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.312448] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115cec0) on tqpair=0x11042f0 00:26:06.577 [2024-11-16 17:01:52.312458] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:26:06.577 [2024-11-16 17:01:52.312466] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:26:06.577 [2024-11-16 17:01:52.312479] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:06.577 [2024-11-16 17:01:52.312589] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:26:06.577 [2024-11-16 17:01:52.312596] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:06.577 [2024-11-16 17:01:52.312613] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.312631] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.312637] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11042f0) 00:26:06.577 [2024-11-16 17:01:52.312647] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.577 [2024-11-16 17:01:52.312669] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115cec0, cid 0, qid 0 00:26:06.577 [2024-11-16 17:01:52.312744] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.577 [2024-11-16 17:01:52.312759] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.577 [2024-11-16 17:01:52.312766] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.312772] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115cec0) on tqpair=0x11042f0 00:26:06.577 [2024-11-16 17:01:52.312781] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:06.577 [2024-11-16 17:01:52.312798] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.312807] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.312814] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11042f0) 00:26:06.577 [2024-11-16 17:01:52.312824] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.577 [2024-11-16 17:01:52.312845] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115cec0, cid 0, qid 0 00:26:06.577 [2024-11-16 17:01:52.312921] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.577 [2024-11-16 17:01:52.312934] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.577 [2024-11-16 17:01:52.312940] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.312947] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115cec0) on tqpair=0x11042f0 00:26:06.577 [2024-11-16 17:01:52.312955] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:06.577 [2024-11-16 17:01:52.312963] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:26:06.577 [2024-11-16 17:01:52.312976] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:26:06.577 [2024-11-16 17:01:52.313003] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:26:06.577 [2024-11-16 17:01:52.313016] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313023] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313030] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11042f0) 00:26:06.577 [2024-11-16 17:01:52.313040] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.577 [2024-11-16 17:01:52.313061] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115cec0, cid 0, qid 0 00:26:06.577 [2024-11-16 17:01:52.313177] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.577 [2024-11-16 17:01:52.313193] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.577 [2024-11-16 17:01:52.313199] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313206] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11042f0): datao=0, datal=4096, cccid=0 00:26:06.577 [2024-11-16 17:01:52.313213] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x115cec0) on tqpair(0x11042f0): expected_datao=0, payload_size=4096 00:26:06.577 [2024-11-16 17:01:52.313225] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313232] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313243] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.577 [2024-11-16 17:01:52.313253] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.577 [2024-11-16 17:01:52.313259] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313266] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115cec0) on tqpair=0x11042f0 00:26:06.577 [2024-11-16 17:01:52.313281] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:26:06.577 [2024-11-16 17:01:52.313290] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:26:06.577 [2024-11-16 17:01:52.313297] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:26:06.577 [2024-11-16 17:01:52.313304] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:26:06.577 [2024-11-16 17:01:52.313311] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:26:06.577 [2024-11-16 17:01:52.313319] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:26:06.577 [2024-11-16 17:01:52.313337] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:26:06.577 [2024-11-16 17:01:52.313351] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313359] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313365] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11042f0) 00:26:06.577 [2024-11-16 17:01:52.313376] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:06.577 [2024-11-16 17:01:52.313397] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115cec0, cid 0, qid 0 00:26:06.577 [2024-11-16 17:01:52.313469] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.577 [2024-11-16 17:01:52.313481] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.577 [2024-11-16 17:01:52.313488] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313494] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115cec0) on tqpair=0x11042f0 00:26:06.577 [2024-11-16 17:01:52.313505] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313513] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313519] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11042f0) 00:26:06.577 [2024-11-16 17:01:52.313528] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.577 [2024-11-16 17:01:52.313538] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313545] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313551] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x11042f0) 00:26:06.577 [2024-11-16 17:01:52.313559] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.577 [2024-11-16 17:01:52.313569] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313575] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313581] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x11042f0) 00:26:06.577 [2024-11-16 17:01:52.313589] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.577 [2024-11-16 17:01:52.313598] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313604] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313610] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.577 [2024-11-16 17:01:52.313631] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.577 [2024-11-16 17:01:52.313641] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:26:06.577 [2024-11-16 17:01:52.313663] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:06.577 [2024-11-16 17:01:52.313676] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313683] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313689] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11042f0) 00:26:06.577 [2024-11-16 17:01:52.313699] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.577 [2024-11-16 17:01:52.313721] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115cec0, cid 0, qid 0 00:26:06.577 [2024-11-16 17:01:52.313732] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d020, cid 1, qid 0 00:26:06.577 [2024-11-16 17:01:52.313740] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d180, cid 2, qid 0 00:26:06.577 [2024-11-16 17:01:52.313748] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.577 [2024-11-16 17:01:52.313755] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d440, cid 4, qid 0 00:26:06.577 [2024-11-16 17:01:52.313859] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.577 [2024-11-16 17:01:52.313872] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.577 [2024-11-16 17:01:52.313878] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.577 [2024-11-16 17:01:52.313885] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d440) on tqpair=0x11042f0 00:26:06.578 [2024-11-16 17:01:52.313894] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:26:06.578 [2024-11-16 17:01:52.313902] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.313916] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.313932] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.313943] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.313951] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.313957] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11042f0) 00:26:06.578 [2024-11-16 17:01:52.313967] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:06.578 [2024-11-16 17:01:52.313987] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d440, cid 4, qid 0 00:26:06.578 [2024-11-16 17:01:52.314063] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.578 [2024-11-16 17:01:52.314078] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.578 [2024-11-16 17:01:52.314084] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314091] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d440) on tqpair=0x11042f0 00:26:06.578 [2024-11-16 17:01:52.314155] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.314173] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.314187] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314195] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314201] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11042f0) 00:26:06.578 [2024-11-16 17:01:52.314215] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.578 [2024-11-16 17:01:52.314237] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d440, cid 4, qid 0 00:26:06.578 [2024-11-16 17:01:52.314335] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.578 [2024-11-16 17:01:52.314348] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.578 [2024-11-16 17:01:52.314354] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314360] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11042f0): datao=0, datal=4096, cccid=4 00:26:06.578 [2024-11-16 17:01:52.314368] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x115d440) on tqpair(0x11042f0): expected_datao=0, payload_size=4096 00:26:06.578 [2024-11-16 17:01:52.314379] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314386] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314398] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.578 [2024-11-16 17:01:52.314407] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.578 [2024-11-16 17:01:52.314413] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314420] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d440) on tqpair=0x11042f0 00:26:06.578 [2024-11-16 17:01:52.314440] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:26:06.578 [2024-11-16 17:01:52.314457] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.314475] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.314488] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314496] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314502] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11042f0) 00:26:06.578 [2024-11-16 17:01:52.314512] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.578 [2024-11-16 17:01:52.314533] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d440, cid 4, qid 0 00:26:06.578 [2024-11-16 17:01:52.314630] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.578 [2024-11-16 17:01:52.314644] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.578 [2024-11-16 17:01:52.314651] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314657] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11042f0): datao=0, datal=4096, cccid=4 00:26:06.578 [2024-11-16 17:01:52.314664] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x115d440) on tqpair(0x11042f0): expected_datao=0, payload_size=4096 00:26:06.578 [2024-11-16 17:01:52.314682] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314691] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314701] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.578 [2024-11-16 17:01:52.314711] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.578 [2024-11-16 17:01:52.314717] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314723] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d440) on tqpair=0x11042f0 00:26:06.578 [2024-11-16 17:01:52.314748] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.314767] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.314784] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314792] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314798] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11042f0) 00:26:06.578 [2024-11-16 17:01:52.314809] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.578 [2024-11-16 17:01:52.314830] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d440, cid 4, qid 0 00:26:06.578 [2024-11-16 17:01:52.314927] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.578 [2024-11-16 17:01:52.314941] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.578 [2024-11-16 17:01:52.314948] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314954] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11042f0): datao=0, datal=4096, cccid=4 00:26:06.578 [2024-11-16 17:01:52.314961] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x115d440) on tqpair(0x11042f0): expected_datao=0, payload_size=4096 00:26:06.578 [2024-11-16 17:01:52.314979] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314988] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.314999] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.578 [2024-11-16 17:01:52.315008] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.578 [2024-11-16 17:01:52.315015] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.315021] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d440) on tqpair=0x11042f0 00:26:06.578 [2024-11-16 17:01:52.315035] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.315051] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.315067] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.315078] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.315086] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.315095] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:26:06.578 [2024-11-16 17:01:52.315102] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:26:06.578 [2024-11-16 17:01:52.315116] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:26:06.578 [2024-11-16 17:01:52.315134] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.315143] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.315149] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11042f0) 00:26:06.578 [2024-11-16 17:01:52.315159] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.578 [2024-11-16 17:01:52.315169] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.315176] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.315182] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x11042f0) 00:26:06.578 [2024-11-16 17:01:52.315191] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.578 [2024-11-16 17:01:52.315231] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d440, cid 4, qid 0 00:26:06.578 [2024-11-16 17:01:52.315246] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d5a0, cid 5, qid 0 00:26:06.578 [2024-11-16 17:01:52.315347] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.578 [2024-11-16 17:01:52.315360] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.578 [2024-11-16 17:01:52.315366] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.315372] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d440) on tqpair=0x11042f0 00:26:06.578 [2024-11-16 17:01:52.315384] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.578 [2024-11-16 17:01:52.315393] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.578 [2024-11-16 17:01:52.315399] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.315405] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d5a0) on tqpair=0x11042f0 00:26:06.578 [2024-11-16 17:01:52.315421] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.578 [2024-11-16 17:01:52.315429] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.579 [2024-11-16 17:01:52.315436] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x11042f0) 00:26:06.579 [2024-11-16 17:01:52.315445] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.579 [2024-11-16 17:01:52.315466] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d5a0, cid 5, qid 0 00:26:06.579 [2024-11-16 17:01:52.315549] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.579 [2024-11-16 17:01:52.315562] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.579 [2024-11-16 17:01:52.315569] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.579 [2024-11-16 17:01:52.315575] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d5a0) on tqpair=0x11042f0 00:26:06.579 [2024-11-16 17:01:52.315591] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.579 [2024-11-16 17:01:52.315600] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.579 [2024-11-16 17:01:52.315606] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x11042f0) 00:26:06.839 [2024-11-16 17:01:52.317660] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.839 [2024-11-16 17:01:52.317691] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d5a0, cid 5, qid 0 00:26:06.839 [2024-11-16 17:01:52.317768] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.839 [2024-11-16 17:01:52.317781] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.839 [2024-11-16 17:01:52.317788] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.839 [2024-11-16 17:01:52.317794] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d5a0) on tqpair=0x11042f0 00:26:06.839 [2024-11-16 17:01:52.317811] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.839 [2024-11-16 17:01:52.317820] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.839 [2024-11-16 17:01:52.317836] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x11042f0) 00:26:06.839 [2024-11-16 17:01:52.317846] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.839 [2024-11-16 17:01:52.317867] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d5a0, cid 5, qid 0 00:26:06.839 [2024-11-16 17:01:52.317951] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.839 [2024-11-16 17:01:52.317966] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.839 [2024-11-16 17:01:52.317972] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.839 [2024-11-16 17:01:52.317979] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d5a0) on tqpair=0x11042f0 00:26:06.839 [2024-11-16 17:01:52.318003] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.839 [2024-11-16 17:01:52.318014] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.839 [2024-11-16 17:01:52.318021] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x11042f0) 00:26:06.839 [2024-11-16 17:01:52.318031] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.839 [2024-11-16 17:01:52.318042] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.839 [2024-11-16 17:01:52.318049] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.839 [2024-11-16 17:01:52.318055] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11042f0) 00:26:06.839 [2024-11-16 17:01:52.318064] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.839 [2024-11-16 17:01:52.318075] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.839 [2024-11-16 17:01:52.318082] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.839 [2024-11-16 17:01:52.318088] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x11042f0) 00:26:06.839 [2024-11-16 17:01:52.318097] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.839 [2024-11-16 17:01:52.318108] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.839 [2024-11-16 17:01:52.318115] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.839 [2024-11-16 17:01:52.318121] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x11042f0) 00:26:06.839 [2024-11-16 17:01:52.318130] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.839 [2024-11-16 17:01:52.318162] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d5a0, cid 5, qid 0 00:26:06.839 [2024-11-16 17:01:52.318173] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d440, cid 4, qid 0 00:26:06.840 [2024-11-16 17:01:52.318181] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d700, cid 6, qid 0 00:26:06.840 [2024-11-16 17:01:52.318188] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d860, cid 7, qid 0 00:26:06.840 [2024-11-16 17:01:52.318339] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.840 [2024-11-16 17:01:52.318354] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.840 [2024-11-16 17:01:52.318361] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318367] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11042f0): datao=0, datal=8192, cccid=5 00:26:06.840 [2024-11-16 17:01:52.318375] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x115d5a0) on tqpair(0x11042f0): expected_datao=0, payload_size=8192 00:26:06.840 [2024-11-16 17:01:52.318394] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318403] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318415] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.840 [2024-11-16 17:01:52.318425] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.840 [2024-11-16 17:01:52.318431] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318438] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11042f0): datao=0, datal=512, cccid=4 00:26:06.840 [2024-11-16 17:01:52.318445] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x115d440) on tqpair(0x11042f0): expected_datao=0, payload_size=512 00:26:06.840 [2024-11-16 17:01:52.318455] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318462] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318474] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.840 [2024-11-16 17:01:52.318483] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.840 [2024-11-16 17:01:52.318489] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318495] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11042f0): datao=0, datal=512, cccid=6 00:26:06.840 [2024-11-16 17:01:52.318503] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x115d700) on tqpair(0x11042f0): expected_datao=0, payload_size=512 00:26:06.840 [2024-11-16 17:01:52.318513] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318519] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318527] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.840 [2024-11-16 17:01:52.318536] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.840 [2024-11-16 17:01:52.318542] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318548] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11042f0): datao=0, datal=4096, cccid=7 00:26:06.840 [2024-11-16 17:01:52.318555] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x115d860) on tqpair(0x11042f0): expected_datao=0, payload_size=4096 00:26:06.840 [2024-11-16 17:01:52.318565] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318572] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318583] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.840 [2024-11-16 17:01:52.318593] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.840 [2024-11-16 17:01:52.318599] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318605] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d5a0) on tqpair=0x11042f0 00:26:06.840 [2024-11-16 17:01:52.318634] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.840 [2024-11-16 17:01:52.318646] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.840 [2024-11-16 17:01:52.318653] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318659] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d440) on tqpair=0x11042f0 00:26:06.840 [2024-11-16 17:01:52.318674] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.840 [2024-11-16 17:01:52.318685] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.840 [2024-11-16 17:01:52.318691] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318697] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d700) on tqpair=0x11042f0 00:26:06.840 [2024-11-16 17:01:52.318708] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.840 [2024-11-16 17:01:52.318718] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.840 [2024-11-16 17:01:52.318724] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.840 [2024-11-16 17:01:52.318730] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d860) on tqpair=0x11042f0 00:26:06.840 ===================================================== 00:26:06.840 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:06.840 ===================================================== 00:26:06.840 Controller Capabilities/Features 00:26:06.840 ================================ 00:26:06.840 Vendor ID: 8086 00:26:06.840 Subsystem Vendor ID: 8086 00:26:06.840 Serial Number: SPDK00000000000001 00:26:06.840 Model Number: SPDK bdev Controller 00:26:06.840 Firmware Version: 24.01.1 00:26:06.840 Recommended Arb Burst: 6 00:26:06.840 IEEE OUI Identifier: e4 d2 5c 00:26:06.840 Multi-path I/O 00:26:06.840 May have multiple subsystem ports: Yes 00:26:06.840 May have multiple controllers: Yes 00:26:06.840 Associated with SR-IOV VF: No 00:26:06.840 Max Data Transfer Size: 131072 00:26:06.840 Max Number of Namespaces: 32 00:26:06.840 Max Number of I/O Queues: 127 00:26:06.840 NVMe Specification Version (VS): 1.3 00:26:06.840 NVMe Specification Version (Identify): 1.3 00:26:06.840 Maximum Queue Entries: 128 00:26:06.840 Contiguous Queues Required: Yes 00:26:06.840 Arbitration Mechanisms Supported 00:26:06.840 Weighted Round Robin: Not Supported 00:26:06.840 Vendor Specific: Not Supported 00:26:06.840 Reset Timeout: 15000 ms 00:26:06.840 Doorbell Stride: 4 bytes 00:26:06.840 NVM Subsystem Reset: Not Supported 00:26:06.840 Command Sets Supported 00:26:06.840 NVM Command Set: Supported 00:26:06.840 Boot Partition: Not Supported 00:26:06.840 Memory Page Size Minimum: 4096 bytes 00:26:06.840 Memory Page Size Maximum: 4096 bytes 00:26:06.840 Persistent Memory Region: Not Supported 00:26:06.840 Optional Asynchronous Events Supported 00:26:06.840 Namespace Attribute Notices: Supported 00:26:06.840 Firmware Activation Notices: Not Supported 00:26:06.840 ANA Change Notices: Not Supported 00:26:06.840 PLE Aggregate Log Change Notices: Not Supported 00:26:06.840 LBA Status Info Alert Notices: Not Supported 00:26:06.840 EGE Aggregate Log Change Notices: Not Supported 00:26:06.840 Normal NVM Subsystem Shutdown event: Not Supported 00:26:06.840 Zone Descriptor Change Notices: Not Supported 00:26:06.840 Discovery Log Change Notices: Not Supported 00:26:06.840 Controller Attributes 00:26:06.840 128-bit Host Identifier: Supported 00:26:06.840 Non-Operational Permissive Mode: Not Supported 00:26:06.840 NVM Sets: Not Supported 00:26:06.840 Read Recovery Levels: Not Supported 00:26:06.840 Endurance Groups: Not Supported 00:26:06.840 Predictable Latency Mode: Not Supported 00:26:06.840 Traffic Based Keep ALive: Not Supported 00:26:06.840 Namespace Granularity: Not Supported 00:26:06.840 SQ Associations: Not Supported 00:26:06.840 UUID List: Not Supported 00:26:06.840 Multi-Domain Subsystem: Not Supported 00:26:06.840 Fixed Capacity Management: Not Supported 00:26:06.840 Variable Capacity Management: Not Supported 00:26:06.840 Delete Endurance Group: Not Supported 00:26:06.840 Delete NVM Set: Not Supported 00:26:06.840 Extended LBA Formats Supported: Not Supported 00:26:06.840 Flexible Data Placement Supported: Not Supported 00:26:06.840 00:26:06.840 Controller Memory Buffer Support 00:26:06.840 ================================ 00:26:06.840 Supported: No 00:26:06.840 00:26:06.840 Persistent Memory Region Support 00:26:06.840 ================================ 00:26:06.840 Supported: No 00:26:06.840 00:26:06.840 Admin Command Set Attributes 00:26:06.840 ============================ 00:26:06.840 Security Send/Receive: Not Supported 00:26:06.840 Format NVM: Not Supported 00:26:06.840 Firmware Activate/Download: Not Supported 00:26:06.840 Namespace Management: Not Supported 00:26:06.840 Device Self-Test: Not Supported 00:26:06.840 Directives: Not Supported 00:26:06.840 NVMe-MI: Not Supported 00:26:06.840 Virtualization Management: Not Supported 00:26:06.840 Doorbell Buffer Config: Not Supported 00:26:06.840 Get LBA Status Capability: Not Supported 00:26:06.840 Command & Feature Lockdown Capability: Not Supported 00:26:06.840 Abort Command Limit: 4 00:26:06.840 Async Event Request Limit: 4 00:26:06.840 Number of Firmware Slots: N/A 00:26:06.840 Firmware Slot 1 Read-Only: N/A 00:26:06.840 Firmware Activation Without Reset: N/A 00:26:06.840 Multiple Update Detection Support: N/A 00:26:06.840 Firmware Update Granularity: No Information Provided 00:26:06.840 Per-Namespace SMART Log: No 00:26:06.840 Asymmetric Namespace Access Log Page: Not Supported 00:26:06.840 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:26:06.840 Command Effects Log Page: Supported 00:26:06.840 Get Log Page Extended Data: Supported 00:26:06.840 Telemetry Log Pages: Not Supported 00:26:06.840 Persistent Event Log Pages: Not Supported 00:26:06.840 Supported Log Pages Log Page: May Support 00:26:06.840 Commands Supported & Effects Log Page: Not Supported 00:26:06.840 Feature Identifiers & Effects Log Page:May Support 00:26:06.840 NVMe-MI Commands & Effects Log Page: May Support 00:26:06.840 Data Area 4 for Telemetry Log: Not Supported 00:26:06.840 Error Log Page Entries Supported: 128 00:26:06.840 Keep Alive: Supported 00:26:06.840 Keep Alive Granularity: 10000 ms 00:26:06.840 00:26:06.841 NVM Command Set Attributes 00:26:06.841 ========================== 00:26:06.841 Submission Queue Entry Size 00:26:06.841 Max: 64 00:26:06.841 Min: 64 00:26:06.841 Completion Queue Entry Size 00:26:06.841 Max: 16 00:26:06.841 Min: 16 00:26:06.841 Number of Namespaces: 32 00:26:06.841 Compare Command: Supported 00:26:06.841 Write Uncorrectable Command: Not Supported 00:26:06.841 Dataset Management Command: Supported 00:26:06.841 Write Zeroes Command: Supported 00:26:06.841 Set Features Save Field: Not Supported 00:26:06.841 Reservations: Supported 00:26:06.841 Timestamp: Not Supported 00:26:06.841 Copy: Supported 00:26:06.841 Volatile Write Cache: Present 00:26:06.841 Atomic Write Unit (Normal): 1 00:26:06.841 Atomic Write Unit (PFail): 1 00:26:06.841 Atomic Compare & Write Unit: 1 00:26:06.841 Fused Compare & Write: Supported 00:26:06.841 Scatter-Gather List 00:26:06.841 SGL Command Set: Supported 00:26:06.841 SGL Keyed: Supported 00:26:06.841 SGL Bit Bucket Descriptor: Not Supported 00:26:06.841 SGL Metadata Pointer: Not Supported 00:26:06.841 Oversized SGL: Not Supported 00:26:06.841 SGL Metadata Address: Not Supported 00:26:06.841 SGL Offset: Supported 00:26:06.841 Transport SGL Data Block: Not Supported 00:26:06.841 Replay Protected Memory Block: Not Supported 00:26:06.841 00:26:06.841 Firmware Slot Information 00:26:06.841 ========================= 00:26:06.841 Active slot: 1 00:26:06.841 Slot 1 Firmware Revision: 24.01.1 00:26:06.841 00:26:06.841 00:26:06.841 Commands Supported and Effects 00:26:06.841 ============================== 00:26:06.841 Admin Commands 00:26:06.841 -------------- 00:26:06.841 Get Log Page (02h): Supported 00:26:06.841 Identify (06h): Supported 00:26:06.841 Abort (08h): Supported 00:26:06.841 Set Features (09h): Supported 00:26:06.841 Get Features (0Ah): Supported 00:26:06.841 Asynchronous Event Request (0Ch): Supported 00:26:06.841 Keep Alive (18h): Supported 00:26:06.841 I/O Commands 00:26:06.841 ------------ 00:26:06.841 Flush (00h): Supported LBA-Change 00:26:06.841 Write (01h): Supported LBA-Change 00:26:06.841 Read (02h): Supported 00:26:06.841 Compare (05h): Supported 00:26:06.841 Write Zeroes (08h): Supported LBA-Change 00:26:06.841 Dataset Management (09h): Supported LBA-Change 00:26:06.841 Copy (19h): Supported LBA-Change 00:26:06.841 Unknown (79h): Supported LBA-Change 00:26:06.841 Unknown (7Ah): Supported 00:26:06.841 00:26:06.841 Error Log 00:26:06.841 ========= 00:26:06.841 00:26:06.841 Arbitration 00:26:06.841 =========== 00:26:06.841 Arbitration Burst: 1 00:26:06.841 00:26:06.841 Power Management 00:26:06.841 ================ 00:26:06.841 Number of Power States: 1 00:26:06.841 Current Power State: Power State #0 00:26:06.841 Power State #0: 00:26:06.841 Max Power: 0.00 W 00:26:06.841 Non-Operational State: Operational 00:26:06.841 Entry Latency: Not Reported 00:26:06.841 Exit Latency: Not Reported 00:26:06.841 Relative Read Throughput: 0 00:26:06.841 Relative Read Latency: 0 00:26:06.841 Relative Write Throughput: 0 00:26:06.841 Relative Write Latency: 0 00:26:06.841 Idle Power: Not Reported 00:26:06.841 Active Power: Not Reported 00:26:06.841 Non-Operational Permissive Mode: Not Supported 00:26:06.841 00:26:06.841 Health Information 00:26:06.841 ================== 00:26:06.841 Critical Warnings: 00:26:06.841 Available Spare Space: OK 00:26:06.841 Temperature: OK 00:26:06.841 Device Reliability: OK 00:26:06.841 Read Only: No 00:26:06.841 Volatile Memory Backup: OK 00:26:06.841 Current Temperature: 0 Kelvin (-273 Celsius) 00:26:06.841 Temperature Threshold: [2024-11-16 17:01:52.318850] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.318862] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.318869] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x11042f0) 00:26:06.841 [2024-11-16 17:01:52.318879] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.841 [2024-11-16 17:01:52.318901] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d860, cid 7, qid 0 00:26:06.841 [2024-11-16 17:01:52.318996] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.841 [2024-11-16 17:01:52.319012] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.841 [2024-11-16 17:01:52.319018] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.319025] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d860) on tqpair=0x11042f0 00:26:06.841 [2024-11-16 17:01:52.319069] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:26:06.841 [2024-11-16 17:01:52.319090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.841 [2024-11-16 17:01:52.319102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.841 [2024-11-16 17:01:52.319112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.841 [2024-11-16 17:01:52.319121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.841 [2024-11-16 17:01:52.319134] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.319142] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.319148] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.841 [2024-11-16 17:01:52.319158] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.841 [2024-11-16 17:01:52.319180] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.841 [2024-11-16 17:01:52.319267] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.841 [2024-11-16 17:01:52.319281] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.841 [2024-11-16 17:01:52.319288] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.319294] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.841 [2024-11-16 17:01:52.319306] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.319314] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.319320] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.841 [2024-11-16 17:01:52.319331] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.841 [2024-11-16 17:01:52.319356] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.841 [2024-11-16 17:01:52.319455] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.841 [2024-11-16 17:01:52.319467] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.841 [2024-11-16 17:01:52.319473] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.319479] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.841 [2024-11-16 17:01:52.319488] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:26:06.841 [2024-11-16 17:01:52.319496] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:26:06.841 [2024-11-16 17:01:52.319511] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.319520] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.319526] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.841 [2024-11-16 17:01:52.319536] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.841 [2024-11-16 17:01:52.319556] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.841 [2024-11-16 17:01:52.319649] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.841 [2024-11-16 17:01:52.319664] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.841 [2024-11-16 17:01:52.319671] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.319678] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.841 [2024-11-16 17:01:52.319700] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.319710] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.319716] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.841 [2024-11-16 17:01:52.319727] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.841 [2024-11-16 17:01:52.319747] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.841 [2024-11-16 17:01:52.319820] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.841 [2024-11-16 17:01:52.319832] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.841 [2024-11-16 17:01:52.319839] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.319845] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.841 [2024-11-16 17:01:52.319862] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.841 [2024-11-16 17:01:52.319871] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.319877] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.842 [2024-11-16 17:01:52.319887] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.842 [2024-11-16 17:01:52.319907] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.842 [2024-11-16 17:01:52.319982] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.842 [2024-11-16 17:01:52.319996] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.842 [2024-11-16 17:01:52.320003] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320009] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.842 [2024-11-16 17:01:52.320026] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320035] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320041] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.842 [2024-11-16 17:01:52.320051] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.842 [2024-11-16 17:01:52.320071] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.842 [2024-11-16 17:01:52.320144] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.842 [2024-11-16 17:01:52.320156] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.842 [2024-11-16 17:01:52.320162] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320169] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.842 [2024-11-16 17:01:52.320185] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320194] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320200] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.842 [2024-11-16 17:01:52.320210] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.842 [2024-11-16 17:01:52.320230] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.842 [2024-11-16 17:01:52.320306] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.842 [2024-11-16 17:01:52.320321] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.842 [2024-11-16 17:01:52.320327] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320334] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.842 [2024-11-16 17:01:52.320351] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320364] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320371] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.842 [2024-11-16 17:01:52.320381] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.842 [2024-11-16 17:01:52.320401] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.842 [2024-11-16 17:01:52.320476] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.842 [2024-11-16 17:01:52.320491] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.842 [2024-11-16 17:01:52.320497] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320504] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.842 [2024-11-16 17:01:52.320521] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320530] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320537] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.842 [2024-11-16 17:01:52.320547] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.842 [2024-11-16 17:01:52.320567] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.842 [2024-11-16 17:01:52.320647] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.842 [2024-11-16 17:01:52.320661] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.842 [2024-11-16 17:01:52.320667] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320674] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.842 [2024-11-16 17:01:52.320690] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320699] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320706] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.842 [2024-11-16 17:01:52.320715] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.842 [2024-11-16 17:01:52.320736] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.842 [2024-11-16 17:01:52.320805] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.842 [2024-11-16 17:01:52.320817] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.842 [2024-11-16 17:01:52.320824] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320830] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.842 [2024-11-16 17:01:52.320847] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320855] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320862] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.842 [2024-11-16 17:01:52.320872] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.842 [2024-11-16 17:01:52.320891] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.842 [2024-11-16 17:01:52.320964] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.842 [2024-11-16 17:01:52.320976] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.842 [2024-11-16 17:01:52.320982] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.320989] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.842 [2024-11-16 17:01:52.321005] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.321018] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.321025] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.842 [2024-11-16 17:01:52.321035] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.842 [2024-11-16 17:01:52.321055] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.842 [2024-11-16 17:01:52.321129] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.842 [2024-11-16 17:01:52.321144] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.842 [2024-11-16 17:01:52.321150] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.321157] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.842 [2024-11-16 17:01:52.321174] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.321183] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.321190] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.842 [2024-11-16 17:01:52.321200] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.842 [2024-11-16 17:01:52.321220] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.842 [2024-11-16 17:01:52.321298] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.842 [2024-11-16 17:01:52.321310] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.842 [2024-11-16 17:01:52.321317] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.321323] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.842 [2024-11-16 17:01:52.321340] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.321349] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.321355] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.842 [2024-11-16 17:01:52.321365] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.842 [2024-11-16 17:01:52.321385] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.842 [2024-11-16 17:01:52.321451] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.842 [2024-11-16 17:01:52.321463] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.842 [2024-11-16 17:01:52.321470] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.321476] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.842 [2024-11-16 17:01:52.321493] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.321502] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.321508] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.842 [2024-11-16 17:01:52.321518] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.842 [2024-11-16 17:01:52.321538] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.842 [2024-11-16 17:01:52.327627] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.842 [2024-11-16 17:01:52.327645] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.842 [2024-11-16 17:01:52.327652] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.327659] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.842 [2024-11-16 17:01:52.327679] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.327688] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.842 [2024-11-16 17:01:52.327699] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11042f0) 00:26:06.842 [2024-11-16 17:01:52.327710] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.842 [2024-11-16 17:01:52.327732] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x115d2e0, cid 3, qid 0 00:26:06.842 [2024-11-16 17:01:52.327806] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.843 [2024-11-16 17:01:52.327819] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.843 [2024-11-16 17:01:52.327826] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.843 [2024-11-16 17:01:52.327832] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x115d2e0) on tqpair=0x11042f0 00:26:06.843 [2024-11-16 17:01:52.327846] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 8 milliseconds 00:26:06.843 0 Kelvin (-273 Celsius) 00:26:06.843 Available Spare: 0% 00:26:06.843 Available Spare Threshold: 0% 00:26:06.843 Life Percentage Used: 0% 00:26:06.843 Data Units Read: 0 00:26:06.843 Data Units Written: 0 00:26:06.843 Host Read Commands: 0 00:26:06.843 Host Write Commands: 0 00:26:06.843 Controller Busy Time: 0 minutes 00:26:06.843 Power Cycles: 0 00:26:06.843 Power On Hours: 0 hours 00:26:06.843 Unsafe Shutdowns: 0 00:26:06.843 Unrecoverable Media Errors: 0 00:26:06.843 Lifetime Error Log Entries: 0 00:26:06.843 Warning Temperature Time: 0 minutes 00:26:06.843 Critical Temperature Time: 0 minutes 00:26:06.843 00:26:06.843 Number of Queues 00:26:06.843 ================ 00:26:06.843 Number of I/O Submission Queues: 127 00:26:06.843 Number of I/O Completion Queues: 127 00:26:06.843 00:26:06.843 Active Namespaces 00:26:06.843 ================= 00:26:06.843 Namespace ID:1 00:26:06.843 Error Recovery Timeout: Unlimited 00:26:06.843 Command Set Identifier: NVM (00h) 00:26:06.843 Deallocate: Supported 00:26:06.843 Deallocated/Unwritten Error: Not Supported 00:26:06.843 Deallocated Read Value: Unknown 00:26:06.843 Deallocate in Write Zeroes: Not Supported 00:26:06.843 Deallocated Guard Field: 0xFFFF 00:26:06.843 Flush: Supported 00:26:06.843 Reservation: Supported 00:26:06.843 Namespace Sharing Capabilities: Multiple Controllers 00:26:06.843 Size (in LBAs): 131072 (0GiB) 00:26:06.843 Capacity (in LBAs): 131072 (0GiB) 00:26:06.843 Utilization (in LBAs): 131072 (0GiB) 00:26:06.843 NGUID: ABCDEF0123456789ABCDEF0123456789 00:26:06.843 EUI64: ABCDEF0123456789 00:26:06.843 UUID: c4f33869-fb99-40c3-9064-0eb81fdc028f 00:26:06.843 Thin Provisioning: Not Supported 00:26:06.843 Per-NS Atomic Units: Yes 00:26:06.843 Atomic Boundary Size (Normal): 0 00:26:06.843 Atomic Boundary Size (PFail): 0 00:26:06.843 Atomic Boundary Offset: 0 00:26:06.843 Maximum Single Source Range Length: 65535 00:26:06.843 Maximum Copy Length: 65535 00:26:06.843 Maximum Source Range Count: 1 00:26:06.843 NGUID/EUI64 Never Reused: No 00:26:06.843 Namespace Write Protected: No 00:26:06.843 Number of LBA Formats: 1 00:26:06.843 Current LBA Format: LBA Format #00 00:26:06.843 LBA Format #00: Data Size: 512 Metadata Size: 0 00:26:06.843 00:26:06.843 17:01:52 -- host/identify.sh@51 -- # sync 00:26:06.843 17:01:52 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:06.843 17:01:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.843 17:01:52 -- common/autotest_common.sh@10 -- # set +x 00:26:06.843 17:01:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.843 17:01:52 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:26:06.843 17:01:52 -- host/identify.sh@56 -- # nvmftestfini 00:26:06.843 17:01:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:06.843 17:01:52 -- nvmf/common.sh@116 -- # sync 00:26:06.843 17:01:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:06.843 17:01:52 -- nvmf/common.sh@119 -- # set +e 00:26:06.843 17:01:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:06.843 17:01:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:06.843 rmmod nvme_tcp 00:26:06.843 rmmod nvme_fabrics 00:26:06.843 rmmod nvme_keyring 00:26:06.843 17:01:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:06.843 17:01:52 -- nvmf/common.sh@123 -- # set -e 00:26:06.843 17:01:52 -- nvmf/common.sh@124 -- # return 0 00:26:06.843 17:01:52 -- nvmf/common.sh@477 -- # '[' -n 1285512 ']' 00:26:06.843 17:01:52 -- nvmf/common.sh@478 -- # killprocess 1285512 00:26:06.843 17:01:52 -- common/autotest_common.sh@936 -- # '[' -z 1285512 ']' 00:26:06.843 17:01:52 -- common/autotest_common.sh@940 -- # kill -0 1285512 00:26:06.843 17:01:52 -- common/autotest_common.sh@941 -- # uname 00:26:06.843 17:01:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:06.843 17:01:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1285512 00:26:06.843 17:01:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:06.843 17:01:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:06.843 17:01:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1285512' 00:26:06.843 killing process with pid 1285512 00:26:06.843 17:01:52 -- common/autotest_common.sh@955 -- # kill 1285512 00:26:06.843 [2024-11-16 17:01:52.432999] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:06.843 17:01:52 -- common/autotest_common.sh@960 -- # wait 1285512 00:26:07.103 17:01:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:07.103 17:01:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:07.103 17:01:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:07.103 17:01:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:07.103 17:01:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:07.103 17:01:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:07.103 17:01:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:07.103 17:01:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:09.007 17:01:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:09.007 00:26:09.007 real 0m6.155s 00:26:09.007 user 0m7.186s 00:26:09.007 sys 0m1.946s 00:26:09.007 17:01:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:09.007 17:01:54 -- common/autotest_common.sh@10 -- # set +x 00:26:09.007 ************************************ 00:26:09.007 END TEST nvmf_identify 00:26:09.007 ************************************ 00:26:09.007 17:01:54 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:09.007 17:01:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:09.007 17:01:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:09.007 17:01:54 -- common/autotest_common.sh@10 -- # set +x 00:26:09.007 ************************************ 00:26:09.007 START TEST nvmf_perf 00:26:09.007 ************************************ 00:26:09.007 17:01:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:09.266 * Looking for test storage... 00:26:09.266 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:09.266 17:01:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:09.266 17:01:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:09.266 17:01:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:09.266 17:01:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:09.266 17:01:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:09.266 17:01:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:09.266 17:01:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:09.266 17:01:54 -- scripts/common.sh@335 -- # IFS=.-: 00:26:09.266 17:01:54 -- scripts/common.sh@335 -- # read -ra ver1 00:26:09.266 17:01:54 -- scripts/common.sh@336 -- # IFS=.-: 00:26:09.266 17:01:54 -- scripts/common.sh@336 -- # read -ra ver2 00:26:09.266 17:01:54 -- scripts/common.sh@337 -- # local 'op=<' 00:26:09.266 17:01:54 -- scripts/common.sh@339 -- # ver1_l=2 00:26:09.266 17:01:54 -- scripts/common.sh@340 -- # ver2_l=1 00:26:09.266 17:01:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:09.266 17:01:54 -- scripts/common.sh@343 -- # case "$op" in 00:26:09.266 17:01:54 -- scripts/common.sh@344 -- # : 1 00:26:09.266 17:01:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:09.266 17:01:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:09.266 17:01:54 -- scripts/common.sh@364 -- # decimal 1 00:26:09.266 17:01:54 -- scripts/common.sh@352 -- # local d=1 00:26:09.266 17:01:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:09.266 17:01:54 -- scripts/common.sh@354 -- # echo 1 00:26:09.266 17:01:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:09.266 17:01:54 -- scripts/common.sh@365 -- # decimal 2 00:26:09.266 17:01:54 -- scripts/common.sh@352 -- # local d=2 00:26:09.266 17:01:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:09.266 17:01:54 -- scripts/common.sh@354 -- # echo 2 00:26:09.266 17:01:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:09.266 17:01:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:09.266 17:01:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:09.266 17:01:54 -- scripts/common.sh@367 -- # return 0 00:26:09.267 17:01:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:09.267 17:01:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:09.267 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:09.267 --rc genhtml_branch_coverage=1 00:26:09.267 --rc genhtml_function_coverage=1 00:26:09.267 --rc genhtml_legend=1 00:26:09.267 --rc geninfo_all_blocks=1 00:26:09.267 --rc geninfo_unexecuted_blocks=1 00:26:09.267 00:26:09.267 ' 00:26:09.267 17:01:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:09.267 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:09.267 --rc genhtml_branch_coverage=1 00:26:09.267 --rc genhtml_function_coverage=1 00:26:09.267 --rc genhtml_legend=1 00:26:09.267 --rc geninfo_all_blocks=1 00:26:09.267 --rc geninfo_unexecuted_blocks=1 00:26:09.267 00:26:09.267 ' 00:26:09.267 17:01:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:09.267 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:09.267 --rc genhtml_branch_coverage=1 00:26:09.267 --rc genhtml_function_coverage=1 00:26:09.267 --rc genhtml_legend=1 00:26:09.267 --rc geninfo_all_blocks=1 00:26:09.267 --rc geninfo_unexecuted_blocks=1 00:26:09.267 00:26:09.267 ' 00:26:09.267 17:01:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:09.267 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:09.267 --rc genhtml_branch_coverage=1 00:26:09.267 --rc genhtml_function_coverage=1 00:26:09.267 --rc genhtml_legend=1 00:26:09.267 --rc geninfo_all_blocks=1 00:26:09.267 --rc geninfo_unexecuted_blocks=1 00:26:09.267 00:26:09.267 ' 00:26:09.267 17:01:54 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:09.267 17:01:54 -- nvmf/common.sh@7 -- # uname -s 00:26:09.267 17:01:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:09.267 17:01:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:09.267 17:01:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:09.267 17:01:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:09.267 17:01:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:09.267 17:01:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:09.267 17:01:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:09.267 17:01:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:09.267 17:01:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:09.267 17:01:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:09.267 17:01:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:09.267 17:01:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:09.267 17:01:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:09.267 17:01:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:09.267 17:01:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:09.267 17:01:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:09.267 17:01:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:09.267 17:01:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:09.267 17:01:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:09.267 17:01:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:09.267 17:01:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:09.267 17:01:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:09.267 17:01:54 -- paths/export.sh@5 -- # export PATH 00:26:09.267 17:01:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:09.267 17:01:54 -- nvmf/common.sh@46 -- # : 0 00:26:09.267 17:01:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:09.267 17:01:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:09.267 17:01:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:09.267 17:01:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:09.267 17:01:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:09.267 17:01:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:09.267 17:01:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:09.267 17:01:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:09.267 17:01:54 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:26:09.267 17:01:54 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:26:09.267 17:01:54 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:09.267 17:01:54 -- host/perf.sh@17 -- # nvmftestinit 00:26:09.267 17:01:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:09.267 17:01:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:09.267 17:01:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:09.267 17:01:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:09.267 17:01:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:09.267 17:01:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:09.267 17:01:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:09.267 17:01:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:09.267 17:01:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:09.267 17:01:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:09.267 17:01:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:09.267 17:01:54 -- common/autotest_common.sh@10 -- # set +x 00:26:11.176 17:01:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:11.176 17:01:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:11.176 17:01:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:11.176 17:01:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:11.176 17:01:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:11.176 17:01:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:11.176 17:01:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:11.176 17:01:56 -- nvmf/common.sh@294 -- # net_devs=() 00:26:11.176 17:01:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:11.176 17:01:56 -- nvmf/common.sh@295 -- # e810=() 00:26:11.176 17:01:56 -- nvmf/common.sh@295 -- # local -ga e810 00:26:11.176 17:01:56 -- nvmf/common.sh@296 -- # x722=() 00:26:11.176 17:01:56 -- nvmf/common.sh@296 -- # local -ga x722 00:26:11.176 17:01:56 -- nvmf/common.sh@297 -- # mlx=() 00:26:11.176 17:01:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:11.176 17:01:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:11.176 17:01:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:11.176 17:01:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:11.176 17:01:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:11.176 17:01:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:11.176 17:01:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:11.176 17:01:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:11.176 17:01:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:11.176 17:01:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:11.176 17:01:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:11.176 17:01:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:11.176 17:01:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:11.176 17:01:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:11.176 17:01:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:11.176 17:01:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:11.176 17:01:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:11.176 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:11.176 17:01:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:11.176 17:01:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:11.176 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:11.176 17:01:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:11.176 17:01:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:11.176 17:01:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:11.177 17:01:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:11.177 17:01:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:11.177 17:01:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:11.177 17:01:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:11.177 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:11.177 17:01:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:11.177 17:01:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:11.177 17:01:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:11.177 17:01:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:11.177 17:01:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:11.177 17:01:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:11.177 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:11.177 17:01:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:11.177 17:01:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:11.177 17:01:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:11.177 17:01:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:11.177 17:01:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:11.177 17:01:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:11.177 17:01:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:11.177 17:01:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:11.177 17:01:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:11.177 17:01:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:11.177 17:01:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:11.177 17:01:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:11.177 17:01:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:11.177 17:01:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:11.177 17:01:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:11.177 17:01:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:11.177 17:01:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:11.177 17:01:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:11.177 17:01:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:11.435 17:01:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:11.436 17:01:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:11.436 17:01:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:11.436 17:01:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:11.436 17:01:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:11.436 17:01:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:11.436 17:01:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:11.436 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:11.436 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.197 ms 00:26:11.436 00:26:11.436 --- 10.0.0.2 ping statistics --- 00:26:11.436 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:11.436 rtt min/avg/max/mdev = 0.197/0.197/0.197/0.000 ms 00:26:11.436 17:01:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:11.436 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:11.436 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:26:11.436 00:26:11.436 --- 10.0.0.1 ping statistics --- 00:26:11.436 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:11.436 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:26:11.436 17:01:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:11.436 17:01:56 -- nvmf/common.sh@410 -- # return 0 00:26:11.436 17:01:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:11.436 17:01:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:11.436 17:01:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:11.436 17:01:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:11.436 17:01:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:11.436 17:01:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:11.436 17:01:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:11.436 17:01:57 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:26:11.436 17:01:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:11.436 17:01:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:11.436 17:01:57 -- common/autotest_common.sh@10 -- # set +x 00:26:11.436 17:01:57 -- nvmf/common.sh@469 -- # nvmfpid=1287725 00:26:11.436 17:01:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:11.436 17:01:57 -- nvmf/common.sh@470 -- # waitforlisten 1287725 00:26:11.436 17:01:57 -- common/autotest_common.sh@829 -- # '[' -z 1287725 ']' 00:26:11.436 17:01:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:11.436 17:01:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:11.436 17:01:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:11.436 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:11.436 17:01:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:11.436 17:01:57 -- common/autotest_common.sh@10 -- # set +x 00:26:11.436 [2024-11-16 17:01:57.057811] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:11.436 [2024-11-16 17:01:57.057875] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:11.436 EAL: No free 2048 kB hugepages reported on node 1 00:26:11.436 [2024-11-16 17:01:57.124359] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:11.694 [2024-11-16 17:01:57.213978] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:11.694 [2024-11-16 17:01:57.214139] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:11.694 [2024-11-16 17:01:57.214157] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:11.694 [2024-11-16 17:01:57.214172] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:11.694 [2024-11-16 17:01:57.214231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:11.694 [2024-11-16 17:01:57.214289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:11.694 [2024-11-16 17:01:57.214330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:11.694 [2024-11-16 17:01:57.214332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:12.630 17:01:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:12.631 17:01:58 -- common/autotest_common.sh@862 -- # return 0 00:26:12.631 17:01:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:12.631 17:01:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:12.631 17:01:58 -- common/autotest_common.sh@10 -- # set +x 00:26:12.631 17:01:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:12.631 17:01:58 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:12.631 17:01:58 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:26:15.919 17:02:01 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:26:15.919 17:02:01 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:26:15.919 17:02:01 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:26:15.919 17:02:01 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:26:16.177 17:02:01 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:26:16.177 17:02:01 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:26:16.177 17:02:01 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:26:16.177 17:02:01 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:26:16.177 17:02:01 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:26:16.435 [2024-11-16 17:02:01.966821] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:16.435 17:02:01 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:16.693 17:02:02 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:16.693 17:02:02 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:16.951 17:02:02 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:16.951 17:02:02 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:26:17.209 17:02:02 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:17.467 [2024-11-16 17:02:02.990757] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:17.467 17:02:03 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:17.726 17:02:03 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:26:17.726 17:02:03 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:17.726 17:02:03 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:26:17.726 17:02:03 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:19.106 Initializing NVMe Controllers 00:26:19.106 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:26:19.106 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:26:19.106 Initialization complete. Launching workers. 00:26:19.106 ======================================================== 00:26:19.106 Latency(us) 00:26:19.106 Device Information : IOPS MiB/s Average min max 00:26:19.106 PCIE (0000:88:00.0) NSID 1 from core 0: 85754.43 334.98 372.37 21.92 4465.74 00:26:19.106 ======================================================== 00:26:19.106 Total : 85754.43 334.98 372.37 21.92 4465.74 00:26:19.106 00:26:19.106 17:02:04 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:19.106 EAL: No free 2048 kB hugepages reported on node 1 00:26:20.484 Initializing NVMe Controllers 00:26:20.484 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:20.484 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:20.484 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:20.484 Initialization complete. Launching workers. 00:26:20.484 ======================================================== 00:26:20.484 Latency(us) 00:26:20.484 Device Information : IOPS MiB/s Average min max 00:26:20.484 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 92.00 0.36 11299.39 151.96 47498.30 00:26:20.484 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 62.00 0.24 16329.91 5515.53 49834.08 00:26:20.484 ======================================================== 00:26:20.484 Total : 154.00 0.60 13324.66 151.96 49834.08 00:26:20.484 00:26:20.484 17:02:05 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:20.484 EAL: No free 2048 kB hugepages reported on node 1 00:26:21.418 Initializing NVMe Controllers 00:26:21.418 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:21.418 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:21.418 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:21.418 Initialization complete. Launching workers. 00:26:21.418 ======================================================== 00:26:21.418 Latency(us) 00:26:21.418 Device Information : IOPS MiB/s Average min max 00:26:21.418 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8728.00 34.09 3676.79 576.83 8905.27 00:26:21.418 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3872.00 15.12 8303.39 7084.07 16123.77 00:26:21.418 ======================================================== 00:26:21.418 Total : 12600.00 49.22 5098.55 576.83 16123.77 00:26:21.418 00:26:21.418 17:02:07 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:26:21.418 17:02:07 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:26:21.418 17:02:07 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:21.418 EAL: No free 2048 kB hugepages reported on node 1 00:26:23.950 Initializing NVMe Controllers 00:26:23.950 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:23.950 Controller IO queue size 128, less than required. 00:26:23.950 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:23.950 Controller IO queue size 128, less than required. 00:26:23.950 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:23.950 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:23.950 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:23.950 Initialization complete. Launching workers. 00:26:23.950 ======================================================== 00:26:23.950 Latency(us) 00:26:23.950 Device Information : IOPS MiB/s Average min max 00:26:23.950 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1754.14 438.53 73882.90 46823.14 135870.21 00:26:23.950 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 583.05 145.76 228420.34 95716.35 399783.58 00:26:23.950 ======================================================== 00:26:23.950 Total : 2337.18 584.30 112434.67 46823.14 399783.58 00:26:23.950 00:26:23.950 17:02:09 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:26:23.950 EAL: No free 2048 kB hugepages reported on node 1 00:26:23.950 No valid NVMe controllers or AIO or URING devices found 00:26:23.950 Initializing NVMe Controllers 00:26:23.950 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:23.950 Controller IO queue size 128, less than required. 00:26:23.950 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:23.950 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:26:23.950 Controller IO queue size 128, less than required. 00:26:23.950 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:23.950 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:26:23.950 WARNING: Some requested NVMe devices were skipped 00:26:23.950 17:02:09 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:26:24.208 EAL: No free 2048 kB hugepages reported on node 1 00:26:26.740 Initializing NVMe Controllers 00:26:26.740 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:26.740 Controller IO queue size 128, less than required. 00:26:26.740 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:26.740 Controller IO queue size 128, less than required. 00:26:26.740 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:26.740 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:26.740 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:26.740 Initialization complete. Launching workers. 00:26:26.740 00:26:26.740 ==================== 00:26:26.740 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:26.740 TCP transport: 00:26:26.740 polls: 9495 00:26:26.740 idle_polls: 6510 00:26:26.740 sock_completions: 2985 00:26:26.740 nvme_completions: 5734 00:26:26.740 submitted_requests: 8890 00:26:26.740 queued_requests: 1 00:26:26.740 00:26:26.740 ==================== 00:26:26.740 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:26.740 TCP transport: 00:26:26.740 polls: 11716 00:26:26.740 idle_polls: 8043 00:26:26.740 sock_completions: 3673 00:26:26.740 nvme_completions: 6199 00:26:26.740 submitted_requests: 9381 00:26:26.740 queued_requests: 1 00:26:26.740 ======================================================== 00:26:26.740 Latency(us) 00:26:26.740 Device Information : IOPS MiB/s Average min max 00:26:26.740 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1495.27 373.82 88058.55 46935.98 151445.14 00:26:26.740 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1611.63 402.91 79844.99 34652.60 119723.56 00:26:26.740 ======================================================== 00:26:26.740 Total : 3106.90 776.73 83797.96 34652.60 151445.14 00:26:26.740 00:26:26.740 17:02:12 -- host/perf.sh@66 -- # sync 00:26:26.740 17:02:12 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:26.998 17:02:12 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:26.998 17:02:12 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:26.998 17:02:12 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:30.284 17:02:15 -- host/perf.sh@72 -- # ls_guid=d4b7e99f-1483-4374-9657-a1baa78e6c3d 00:26:30.284 17:02:15 -- host/perf.sh@73 -- # get_lvs_free_mb d4b7e99f-1483-4374-9657-a1baa78e6c3d 00:26:30.284 17:02:15 -- common/autotest_common.sh@1353 -- # local lvs_uuid=d4b7e99f-1483-4374-9657-a1baa78e6c3d 00:26:30.284 17:02:15 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:30.284 17:02:15 -- common/autotest_common.sh@1355 -- # local fc 00:26:30.284 17:02:15 -- common/autotest_common.sh@1356 -- # local cs 00:26:30.284 17:02:15 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:30.542 17:02:16 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:30.542 { 00:26:30.542 "uuid": "d4b7e99f-1483-4374-9657-a1baa78e6c3d", 00:26:30.542 "name": "lvs_0", 00:26:30.542 "base_bdev": "Nvme0n1", 00:26:30.542 "total_data_clusters": 238234, 00:26:30.542 "free_clusters": 238234, 00:26:30.542 "block_size": 512, 00:26:30.542 "cluster_size": 4194304 00:26:30.542 } 00:26:30.542 ]' 00:26:30.542 17:02:16 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="d4b7e99f-1483-4374-9657-a1baa78e6c3d") .free_clusters' 00:26:30.542 17:02:16 -- common/autotest_common.sh@1358 -- # fc=238234 00:26:30.542 17:02:16 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="d4b7e99f-1483-4374-9657-a1baa78e6c3d") .cluster_size' 00:26:30.802 17:02:16 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:30.802 17:02:16 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:26:30.802 17:02:16 -- common/autotest_common.sh@1363 -- # echo 952936 00:26:30.802 952936 00:26:30.802 17:02:16 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:30.802 17:02:16 -- host/perf.sh@78 -- # free_mb=20480 00:26:30.802 17:02:16 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u d4b7e99f-1483-4374-9657-a1baa78e6c3d lbd_0 20480 00:26:31.369 17:02:16 -- host/perf.sh@80 -- # lb_guid=bae5a7cb-517b-480f-84f0-1dba252abff6 00:26:31.369 17:02:16 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore bae5a7cb-517b-480f-84f0-1dba252abff6 lvs_n_0 00:26:31.934 17:02:17 -- host/perf.sh@83 -- # ls_nested_guid=f47e403e-f3d2-43f2-a6c8-4606c4cc57c0 00:26:31.934 17:02:17 -- host/perf.sh@84 -- # get_lvs_free_mb f47e403e-f3d2-43f2-a6c8-4606c4cc57c0 00:26:31.934 17:02:17 -- common/autotest_common.sh@1353 -- # local lvs_uuid=f47e403e-f3d2-43f2-a6c8-4606c4cc57c0 00:26:31.934 17:02:17 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:31.934 17:02:17 -- common/autotest_common.sh@1355 -- # local fc 00:26:31.934 17:02:17 -- common/autotest_common.sh@1356 -- # local cs 00:26:31.934 17:02:17 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:32.192 17:02:17 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:32.192 { 00:26:32.192 "uuid": "d4b7e99f-1483-4374-9657-a1baa78e6c3d", 00:26:32.192 "name": "lvs_0", 00:26:32.192 "base_bdev": "Nvme0n1", 00:26:32.192 "total_data_clusters": 238234, 00:26:32.192 "free_clusters": 233114, 00:26:32.192 "block_size": 512, 00:26:32.192 "cluster_size": 4194304 00:26:32.192 }, 00:26:32.192 { 00:26:32.192 "uuid": "f47e403e-f3d2-43f2-a6c8-4606c4cc57c0", 00:26:32.192 "name": "lvs_n_0", 00:26:32.192 "base_bdev": "bae5a7cb-517b-480f-84f0-1dba252abff6", 00:26:32.192 "total_data_clusters": 5114, 00:26:32.192 "free_clusters": 5114, 00:26:32.192 "block_size": 512, 00:26:32.192 "cluster_size": 4194304 00:26:32.192 } 00:26:32.192 ]' 00:26:32.192 17:02:17 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="f47e403e-f3d2-43f2-a6c8-4606c4cc57c0") .free_clusters' 00:26:32.450 17:02:17 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:32.450 17:02:17 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="f47e403e-f3d2-43f2-a6c8-4606c4cc57c0") .cluster_size' 00:26:32.450 17:02:17 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:32.450 17:02:17 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:32.450 17:02:17 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:32.450 20456 00:26:32.450 17:02:17 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:32.450 17:02:18 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u f47e403e-f3d2-43f2-a6c8-4606c4cc57c0 lbd_nest_0 20456 00:26:32.708 17:02:18 -- host/perf.sh@88 -- # lb_nested_guid=efabf46d-7ad1-46b9-b2aa-bb68afbb22aa 00:26:32.708 17:02:18 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:32.966 17:02:18 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:32.966 17:02:18 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 efabf46d-7ad1-46b9-b2aa-bb68afbb22aa 00:26:33.224 17:02:18 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:33.483 17:02:19 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:33.483 17:02:19 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:33.483 17:02:19 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:33.483 17:02:19 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:33.483 17:02:19 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:33.483 EAL: No free 2048 kB hugepages reported on node 1 00:26:45.738 Initializing NVMe Controllers 00:26:45.738 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:45.738 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:45.738 Initialization complete. Launching workers. 00:26:45.738 ======================================================== 00:26:45.738 Latency(us) 00:26:45.738 Device Information : IOPS MiB/s Average min max 00:26:45.738 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 45.30 0.02 22086.68 163.26 47893.80 00:26:45.738 ======================================================== 00:26:45.738 Total : 45.30 0.02 22086.68 163.26 47893.80 00:26:45.738 00:26:45.738 17:02:29 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:45.738 17:02:29 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:45.738 EAL: No free 2048 kB hugepages reported on node 1 00:26:55.710 Initializing NVMe Controllers 00:26:55.710 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:55.710 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:55.710 Initialization complete. Launching workers. 00:26:55.710 ======================================================== 00:26:55.710 Latency(us) 00:26:55.711 Device Information : IOPS MiB/s Average min max 00:26:55.711 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 78.47 9.81 12793.62 2808.79 47899.35 00:26:55.711 ======================================================== 00:26:55.711 Total : 78.47 9.81 12793.62 2808.79 47899.35 00:26:55.711 00:26:55.711 17:02:39 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:55.711 17:02:39 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:55.711 17:02:39 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:55.711 EAL: No free 2048 kB hugepages reported on node 1 00:27:05.695 Initializing NVMe Controllers 00:27:05.695 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:05.695 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:05.695 Initialization complete. Launching workers. 00:27:05.695 ======================================================== 00:27:05.695 Latency(us) 00:27:05.695 Device Information : IOPS MiB/s Average min max 00:27:05.695 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7870.90 3.84 4065.31 425.66 11434.03 00:27:05.695 ======================================================== 00:27:05.695 Total : 7870.90 3.84 4065.31 425.66 11434.03 00:27:05.695 00:27:05.695 17:02:50 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:05.695 17:02:50 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:05.695 EAL: No free 2048 kB hugepages reported on node 1 00:27:15.674 Initializing NVMe Controllers 00:27:15.674 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:15.674 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:15.674 Initialization complete. Launching workers. 00:27:15.674 ======================================================== 00:27:15.674 Latency(us) 00:27:15.674 Device Information : IOPS MiB/s Average min max 00:27:15.674 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4076.50 509.56 7852.85 801.76 19228.86 00:27:15.674 ======================================================== 00:27:15.674 Total : 4076.50 509.56 7852.85 801.76 19228.86 00:27:15.674 00:27:15.674 17:03:00 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:15.674 17:03:00 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:15.674 17:03:00 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:15.674 EAL: No free 2048 kB hugepages reported on node 1 00:27:25.654 Initializing NVMe Controllers 00:27:25.654 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:25.654 Controller IO queue size 128, less than required. 00:27:25.654 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:25.654 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:25.654 Initialization complete. Launching workers. 00:27:25.654 ======================================================== 00:27:25.654 Latency(us) 00:27:25.654 Device Information : IOPS MiB/s Average min max 00:27:25.654 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12050.90 5.88 10627.97 1719.48 26147.74 00:27:25.654 ======================================================== 00:27:25.654 Total : 12050.90 5.88 10627.97 1719.48 26147.74 00:27:25.654 00:27:25.654 17:03:10 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:25.654 17:03:10 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:25.654 EAL: No free 2048 kB hugepages reported on node 1 00:27:35.617 Initializing NVMe Controllers 00:27:35.618 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:35.618 Controller IO queue size 128, less than required. 00:27:35.618 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:35.618 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:35.618 Initialization complete. Launching workers. 00:27:35.618 ======================================================== 00:27:35.618 Latency(us) 00:27:35.618 Device Information : IOPS MiB/s Average min max 00:27:35.618 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1174.83 146.85 109473.45 15890.34 221134.49 00:27:35.618 ======================================================== 00:27:35.618 Total : 1174.83 146.85 109473.45 15890.34 221134.49 00:27:35.618 00:27:35.618 17:03:21 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:35.618 17:03:21 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete efabf46d-7ad1-46b9-b2aa-bb68afbb22aa 00:27:36.551 17:03:22 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:36.809 17:03:22 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete bae5a7cb-517b-480f-84f0-1dba252abff6 00:27:37.067 17:03:22 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:37.325 17:03:22 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:37.325 17:03:22 -- host/perf.sh@114 -- # nvmftestfini 00:27:37.325 17:03:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:37.325 17:03:22 -- nvmf/common.sh@116 -- # sync 00:27:37.325 17:03:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:37.325 17:03:22 -- nvmf/common.sh@119 -- # set +e 00:27:37.325 17:03:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:37.325 17:03:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:37.325 rmmod nvme_tcp 00:27:37.325 rmmod nvme_fabrics 00:27:37.325 rmmod nvme_keyring 00:27:37.325 17:03:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:37.325 17:03:22 -- nvmf/common.sh@123 -- # set -e 00:27:37.325 17:03:22 -- nvmf/common.sh@124 -- # return 0 00:27:37.325 17:03:22 -- nvmf/common.sh@477 -- # '[' -n 1287725 ']' 00:27:37.325 17:03:22 -- nvmf/common.sh@478 -- # killprocess 1287725 00:27:37.325 17:03:22 -- common/autotest_common.sh@936 -- # '[' -z 1287725 ']' 00:27:37.325 17:03:22 -- common/autotest_common.sh@940 -- # kill -0 1287725 00:27:37.325 17:03:22 -- common/autotest_common.sh@941 -- # uname 00:27:37.325 17:03:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:37.325 17:03:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1287725 00:27:37.325 17:03:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:37.325 17:03:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:37.325 17:03:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1287725' 00:27:37.325 killing process with pid 1287725 00:27:37.325 17:03:23 -- common/autotest_common.sh@955 -- # kill 1287725 00:27:37.325 17:03:23 -- common/autotest_common.sh@960 -- # wait 1287725 00:27:39.224 17:03:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:39.224 17:03:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:39.224 17:03:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:39.224 17:03:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:39.224 17:03:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:39.224 17:03:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:39.224 17:03:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:39.224 17:03:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:41.126 17:03:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:41.126 00:27:41.126 real 1m31.950s 00:27:41.126 user 5m39.911s 00:27:41.126 sys 0m15.587s 00:27:41.127 17:03:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:41.127 17:03:26 -- common/autotest_common.sh@10 -- # set +x 00:27:41.127 ************************************ 00:27:41.127 END TEST nvmf_perf 00:27:41.127 ************************************ 00:27:41.127 17:03:26 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:41.127 17:03:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:41.127 17:03:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:41.127 17:03:26 -- common/autotest_common.sh@10 -- # set +x 00:27:41.127 ************************************ 00:27:41.127 START TEST nvmf_fio_host 00:27:41.127 ************************************ 00:27:41.127 17:03:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:41.127 * Looking for test storage... 00:27:41.127 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:41.127 17:03:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:41.127 17:03:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:41.127 17:03:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:41.127 17:03:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:41.127 17:03:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:41.127 17:03:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:41.127 17:03:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:41.127 17:03:26 -- scripts/common.sh@335 -- # IFS=.-: 00:27:41.127 17:03:26 -- scripts/common.sh@335 -- # read -ra ver1 00:27:41.127 17:03:26 -- scripts/common.sh@336 -- # IFS=.-: 00:27:41.127 17:03:26 -- scripts/common.sh@336 -- # read -ra ver2 00:27:41.127 17:03:26 -- scripts/common.sh@337 -- # local 'op=<' 00:27:41.127 17:03:26 -- scripts/common.sh@339 -- # ver1_l=2 00:27:41.127 17:03:26 -- scripts/common.sh@340 -- # ver2_l=1 00:27:41.127 17:03:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:41.127 17:03:26 -- scripts/common.sh@343 -- # case "$op" in 00:27:41.127 17:03:26 -- scripts/common.sh@344 -- # : 1 00:27:41.127 17:03:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:41.127 17:03:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:41.127 17:03:26 -- scripts/common.sh@364 -- # decimal 1 00:27:41.127 17:03:26 -- scripts/common.sh@352 -- # local d=1 00:27:41.127 17:03:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:41.127 17:03:26 -- scripts/common.sh@354 -- # echo 1 00:27:41.127 17:03:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:41.127 17:03:26 -- scripts/common.sh@365 -- # decimal 2 00:27:41.127 17:03:26 -- scripts/common.sh@352 -- # local d=2 00:27:41.127 17:03:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:41.127 17:03:26 -- scripts/common.sh@354 -- # echo 2 00:27:41.127 17:03:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:41.127 17:03:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:41.127 17:03:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:41.127 17:03:26 -- scripts/common.sh@367 -- # return 0 00:27:41.127 17:03:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:41.127 17:03:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:41.127 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:41.127 --rc genhtml_branch_coverage=1 00:27:41.127 --rc genhtml_function_coverage=1 00:27:41.127 --rc genhtml_legend=1 00:27:41.127 --rc geninfo_all_blocks=1 00:27:41.127 --rc geninfo_unexecuted_blocks=1 00:27:41.127 00:27:41.127 ' 00:27:41.127 17:03:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:41.127 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:41.127 --rc genhtml_branch_coverage=1 00:27:41.127 --rc genhtml_function_coverage=1 00:27:41.127 --rc genhtml_legend=1 00:27:41.127 --rc geninfo_all_blocks=1 00:27:41.127 --rc geninfo_unexecuted_blocks=1 00:27:41.127 00:27:41.127 ' 00:27:41.127 17:03:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:41.127 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:41.127 --rc genhtml_branch_coverage=1 00:27:41.127 --rc genhtml_function_coverage=1 00:27:41.127 --rc genhtml_legend=1 00:27:41.127 --rc geninfo_all_blocks=1 00:27:41.127 --rc geninfo_unexecuted_blocks=1 00:27:41.127 00:27:41.127 ' 00:27:41.127 17:03:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:41.127 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:41.127 --rc genhtml_branch_coverage=1 00:27:41.127 --rc genhtml_function_coverage=1 00:27:41.127 --rc genhtml_legend=1 00:27:41.127 --rc geninfo_all_blocks=1 00:27:41.127 --rc geninfo_unexecuted_blocks=1 00:27:41.127 00:27:41.127 ' 00:27:41.127 17:03:26 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:41.127 17:03:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:41.127 17:03:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:41.127 17:03:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:41.127 17:03:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.127 17:03:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.127 17:03:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.127 17:03:26 -- paths/export.sh@5 -- # export PATH 00:27:41.127 17:03:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.127 17:03:26 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:41.127 17:03:26 -- nvmf/common.sh@7 -- # uname -s 00:27:41.127 17:03:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:41.127 17:03:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:41.127 17:03:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:41.127 17:03:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:41.127 17:03:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:41.127 17:03:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:41.127 17:03:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:41.127 17:03:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:41.127 17:03:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:41.127 17:03:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:41.127 17:03:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:41.127 17:03:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:41.127 17:03:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:41.127 17:03:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:41.127 17:03:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:41.127 17:03:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:41.127 17:03:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:41.127 17:03:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:41.128 17:03:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:41.128 17:03:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.128 17:03:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.128 17:03:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.128 17:03:26 -- paths/export.sh@5 -- # export PATH 00:27:41.128 17:03:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.128 17:03:26 -- nvmf/common.sh@46 -- # : 0 00:27:41.128 17:03:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:41.128 17:03:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:41.128 17:03:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:41.128 17:03:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:41.128 17:03:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:41.128 17:03:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:41.128 17:03:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:41.128 17:03:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:41.128 17:03:26 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:41.128 17:03:26 -- host/fio.sh@14 -- # nvmftestinit 00:27:41.128 17:03:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:41.128 17:03:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:41.128 17:03:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:41.128 17:03:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:41.128 17:03:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:41.128 17:03:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:41.128 17:03:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:41.128 17:03:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:41.128 17:03:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:41.128 17:03:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:41.128 17:03:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:41.128 17:03:26 -- common/autotest_common.sh@10 -- # set +x 00:27:43.703 17:03:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:43.703 17:03:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:43.703 17:03:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:43.703 17:03:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:43.703 17:03:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:43.703 17:03:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:43.703 17:03:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:43.703 17:03:28 -- nvmf/common.sh@294 -- # net_devs=() 00:27:43.703 17:03:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:43.703 17:03:28 -- nvmf/common.sh@295 -- # e810=() 00:27:43.703 17:03:28 -- nvmf/common.sh@295 -- # local -ga e810 00:27:43.703 17:03:28 -- nvmf/common.sh@296 -- # x722=() 00:27:43.703 17:03:28 -- nvmf/common.sh@296 -- # local -ga x722 00:27:43.703 17:03:28 -- nvmf/common.sh@297 -- # mlx=() 00:27:43.703 17:03:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:43.703 17:03:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:43.703 17:03:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:43.703 17:03:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:43.703 17:03:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:43.703 17:03:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:43.703 17:03:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:43.703 17:03:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:43.703 17:03:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:43.703 17:03:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:43.703 17:03:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:43.703 17:03:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:43.703 17:03:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:43.703 17:03:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:43.703 17:03:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:43.703 17:03:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:43.703 17:03:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:43.703 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:43.703 17:03:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:43.703 17:03:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:43.703 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:43.703 17:03:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:43.703 17:03:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:43.703 17:03:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:43.703 17:03:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:43.703 17:03:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:43.703 17:03:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:43.703 17:03:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:43.703 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:43.703 17:03:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:43.704 17:03:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:43.704 17:03:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:43.704 17:03:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:43.704 17:03:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:43.704 17:03:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:43.704 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:43.704 17:03:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:43.704 17:03:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:43.704 17:03:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:43.704 17:03:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:43.704 17:03:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:43.704 17:03:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:43.704 17:03:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:43.704 17:03:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:43.704 17:03:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:43.704 17:03:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:43.704 17:03:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:43.704 17:03:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:43.704 17:03:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:43.704 17:03:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:43.704 17:03:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:43.704 17:03:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:43.704 17:03:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:43.704 17:03:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:43.704 17:03:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:43.704 17:03:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:43.704 17:03:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:43.704 17:03:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:43.704 17:03:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:43.704 17:03:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:43.704 17:03:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:43.704 17:03:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:43.704 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:43.704 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.269 ms 00:27:43.704 00:27:43.704 --- 10.0.0.2 ping statistics --- 00:27:43.704 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:43.704 rtt min/avg/max/mdev = 0.269/0.269/0.269/0.000 ms 00:27:43.704 17:03:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:43.704 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:43.704 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:27:43.704 00:27:43.704 --- 10.0.0.1 ping statistics --- 00:27:43.704 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:43.704 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:27:43.704 17:03:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:43.704 17:03:28 -- nvmf/common.sh@410 -- # return 0 00:27:43.704 17:03:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:43.704 17:03:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:43.704 17:03:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:43.704 17:03:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:43.704 17:03:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:43.704 17:03:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:43.704 17:03:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:43.704 17:03:28 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:43.704 17:03:28 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:43.704 17:03:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:43.704 17:03:28 -- common/autotest_common.sh@10 -- # set +x 00:27:43.704 17:03:28 -- host/fio.sh@24 -- # nvmfpid=1300801 00:27:43.704 17:03:28 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:43.704 17:03:28 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:43.704 17:03:28 -- host/fio.sh@28 -- # waitforlisten 1300801 00:27:43.704 17:03:28 -- common/autotest_common.sh@829 -- # '[' -z 1300801 ']' 00:27:43.704 17:03:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:43.704 17:03:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:43.704 17:03:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:43.704 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:43.704 17:03:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:43.704 17:03:28 -- common/autotest_common.sh@10 -- # set +x 00:27:43.704 [2024-11-16 17:03:28.984186] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:43.704 [2024-11-16 17:03:28.984256] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:43.704 EAL: No free 2048 kB hugepages reported on node 1 00:27:43.704 [2024-11-16 17:03:29.045586] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:43.704 [2024-11-16 17:03:29.129342] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:43.704 [2024-11-16 17:03:29.129489] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:43.704 [2024-11-16 17:03:29.129506] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:43.704 [2024-11-16 17:03:29.129519] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:43.704 [2024-11-16 17:03:29.129571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:43.704 [2024-11-16 17:03:29.129648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:43.704 [2024-11-16 17:03:29.129696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:43.704 [2024-11-16 17:03:29.129699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:44.275 17:03:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:44.275 17:03:29 -- common/autotest_common.sh@862 -- # return 0 00:27:44.275 17:03:29 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:44.534 [2024-11-16 17:03:30.217212] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:44.534 17:03:30 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:44.534 17:03:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:44.534 17:03:30 -- common/autotest_common.sh@10 -- # set +x 00:27:44.534 17:03:30 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:44.793 Malloc1 00:27:45.051 17:03:30 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:45.309 17:03:30 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:45.568 17:03:31 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:45.568 [2024-11-16 17:03:31.316338] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:45.828 17:03:31 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:46.087 17:03:31 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:46.087 17:03:31 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:46.088 17:03:31 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:46.088 17:03:31 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:46.088 17:03:31 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:46.088 17:03:31 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:46.088 17:03:31 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:46.088 17:03:31 -- common/autotest_common.sh@1330 -- # shift 00:27:46.088 17:03:31 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:46.088 17:03:31 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:46.088 17:03:31 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:46.088 17:03:31 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:46.088 17:03:31 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:46.088 17:03:31 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:46.088 17:03:31 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:46.088 17:03:31 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:46.088 17:03:31 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:46.088 17:03:31 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:46.088 17:03:31 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:46.088 17:03:31 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:46.088 17:03:31 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:46.088 17:03:31 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:46.088 17:03:31 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:46.088 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:46.088 fio-3.35 00:27:46.088 Starting 1 thread 00:27:46.346 EAL: No free 2048 kB hugepages reported on node 1 00:27:48.879 00:27:48.879 test: (groupid=0, jobs=1): err= 0: pid=1301300: Sat Nov 16 17:03:34 2024 00:27:48.879 read: IOPS=8956, BW=35.0MiB/s (36.7MB/s)(70.2MiB/2006msec) 00:27:48.879 slat (nsec): min=1770, max=118245, avg=2354.64, stdev=1408.59 00:27:48.879 clat (usec): min=2419, max=13225, avg=7849.99, stdev=626.66 00:27:48.879 lat (usec): min=2437, max=13228, avg=7852.34, stdev=626.60 00:27:48.879 clat percentiles (usec): 00:27:48.879 | 1.00th=[ 6456], 5.00th=[ 6849], 10.00th=[ 7046], 20.00th=[ 7373], 00:27:48.879 | 30.00th=[ 7570], 40.00th=[ 7701], 50.00th=[ 7898], 60.00th=[ 8029], 00:27:48.879 | 70.00th=[ 8160], 80.00th=[ 8356], 90.00th=[ 8586], 95.00th=[ 8848], 00:27:48.879 | 99.00th=[ 9241], 99.50th=[ 9372], 99.90th=[11600], 99.95th=[12518], 00:27:48.879 | 99.99th=[13173] 00:27:48.879 bw ( KiB/s): min=35032, max=36272, per=99.95%, avg=35808.00, stdev=548.02, samples=4 00:27:48.879 iops : min= 8758, max= 9068, avg=8952.00, stdev=137.01, samples=4 00:27:48.879 write: IOPS=8978, BW=35.1MiB/s (36.8MB/s)(70.4MiB/2006msec); 0 zone resets 00:27:48.879 slat (nsec): min=1883, max=94611, avg=2455.70, stdev=1103.64 00:27:48.879 clat (usec): min=931, max=12321, avg=6389.22, stdev=522.50 00:27:48.879 lat (usec): min=936, max=12324, avg=6391.68, stdev=522.48 00:27:48.879 clat percentiles (usec): 00:27:48.879 | 1.00th=[ 5211], 5.00th=[ 5604], 10.00th=[ 5800], 20.00th=[ 5997], 00:27:48.879 | 30.00th=[ 6128], 40.00th=[ 6259], 50.00th=[ 6390], 60.00th=[ 6521], 00:27:48.879 | 70.00th=[ 6652], 80.00th=[ 6783], 90.00th=[ 6980], 95.00th=[ 7177], 00:27:48.879 | 99.00th=[ 7504], 99.50th=[ 7701], 99.90th=[10028], 99.95th=[10290], 00:27:48.879 | 99.99th=[11731] 00:27:48.879 bw ( KiB/s): min=35520, max=36224, per=99.94%, avg=35894.00, stdev=291.63, samples=4 00:27:48.879 iops : min= 8880, max= 9056, avg=8973.50, stdev=72.91, samples=4 00:27:48.879 lat (usec) : 1000=0.01% 00:27:48.879 lat (msec) : 2=0.02%, 4=0.10%, 10=99.75%, 20=0.12% 00:27:48.879 cpu : usr=62.79%, sys=35.46%, ctx=73, majf=0, minf=36 00:27:48.879 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:48.879 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:48.879 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:48.879 issued rwts: total=17967,18011,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:48.879 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:48.879 00:27:48.879 Run status group 0 (all jobs): 00:27:48.879 READ: bw=35.0MiB/s (36.7MB/s), 35.0MiB/s-35.0MiB/s (36.7MB/s-36.7MB/s), io=70.2MiB (73.6MB), run=2006-2006msec 00:27:48.879 WRITE: bw=35.1MiB/s (36.8MB/s), 35.1MiB/s-35.1MiB/s (36.8MB/s-36.8MB/s), io=70.4MiB (73.8MB), run=2006-2006msec 00:27:48.879 17:03:34 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:48.879 17:03:34 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:48.879 17:03:34 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:48.879 17:03:34 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:48.879 17:03:34 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:48.879 17:03:34 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:48.879 17:03:34 -- common/autotest_common.sh@1330 -- # shift 00:27:48.879 17:03:34 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:48.879 17:03:34 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:48.879 17:03:34 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:48.879 17:03:34 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:48.879 17:03:34 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:48.879 17:03:34 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:48.879 17:03:34 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:48.879 17:03:34 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:48.879 17:03:34 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:48.879 17:03:34 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:48.879 17:03:34 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:48.879 17:03:34 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:48.879 17:03:34 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:48.879 17:03:34 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:48.879 17:03:34 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:48.879 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:48.879 fio-3.35 00:27:48.880 Starting 1 thread 00:27:48.880 EAL: No free 2048 kB hugepages reported on node 1 00:27:51.410 00:27:51.410 test: (groupid=0, jobs=1): err= 0: pid=1301641: Sat Nov 16 17:03:36 2024 00:27:51.410 read: IOPS=8979, BW=140MiB/s (147MB/s)(282MiB/2009msec) 00:27:51.410 slat (usec): min=2, max=110, avg= 3.59, stdev= 1.93 00:27:51.410 clat (usec): min=2080, max=15670, avg=8257.96, stdev=1948.67 00:27:51.410 lat (usec): min=2083, max=15676, avg=8261.55, stdev=1948.77 00:27:51.410 clat percentiles (usec): 00:27:51.410 | 1.00th=[ 4359], 5.00th=[ 5276], 10.00th=[ 5800], 20.00th=[ 6521], 00:27:51.410 | 30.00th=[ 7111], 40.00th=[ 7635], 50.00th=[ 8291], 60.00th=[ 8717], 00:27:51.410 | 70.00th=[ 9241], 80.00th=[ 9765], 90.00th=[10683], 95.00th=[11600], 00:27:51.410 | 99.00th=[13435], 99.50th=[14091], 99.90th=[15008], 99.95th=[15139], 00:27:51.410 | 99.99th=[15664] 00:27:51.410 bw ( KiB/s): min=66208, max=76640, per=49.25%, avg=70752.00, stdev=4773.62, samples=4 00:27:51.410 iops : min= 4138, max= 4790, avg=4422.00, stdev=298.35, samples=4 00:27:51.410 write: IOPS=5146, BW=80.4MiB/s (84.3MB/s)(145MiB/1799msec); 0 zone resets 00:27:51.410 slat (usec): min=30, max=187, avg=33.75, stdev= 5.78 00:27:51.410 clat (usec): min=4082, max=18225, avg=10696.72, stdev=1792.38 00:27:51.410 lat (usec): min=4113, max=18256, avg=10730.47, stdev=1792.73 00:27:51.410 clat percentiles (usec): 00:27:51.410 | 1.00th=[ 6849], 5.00th=[ 8094], 10.00th=[ 8586], 20.00th=[ 9241], 00:27:51.410 | 30.00th=[ 9634], 40.00th=[10159], 50.00th=[10552], 60.00th=[10945], 00:27:51.410 | 70.00th=[11469], 80.00th=[12125], 90.00th=[13042], 95.00th=[13829], 00:27:51.410 | 99.00th=[15664], 99.50th=[16581], 99.90th=[17957], 99.95th=[17957], 00:27:51.410 | 99.99th=[18220] 00:27:51.410 bw ( KiB/s): min=69216, max=79872, per=89.23%, avg=73472.00, stdev=5103.77, samples=4 00:27:51.410 iops : min= 4326, max= 4992, avg=4592.00, stdev=318.99, samples=4 00:27:51.410 lat (msec) : 4=0.39%, 10=67.77%, 20=31.84% 00:27:51.410 cpu : usr=78.69%, sys=20.12%, ctx=46, majf=0, minf=52 00:27:51.410 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:27:51.410 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:51.410 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:51.410 issued rwts: total=18040,9258,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:51.410 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:51.410 00:27:51.410 Run status group 0 (all jobs): 00:27:51.410 READ: bw=140MiB/s (147MB/s), 140MiB/s-140MiB/s (147MB/s-147MB/s), io=282MiB (296MB), run=2009-2009msec 00:27:51.410 WRITE: bw=80.4MiB/s (84.3MB/s), 80.4MiB/s-80.4MiB/s (84.3MB/s-84.3MB/s), io=145MiB (152MB), run=1799-1799msec 00:27:51.410 17:03:36 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:51.410 17:03:36 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:27:51.410 17:03:36 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:27:51.410 17:03:36 -- host/fio.sh@51 -- # get_nvme_bdfs 00:27:51.410 17:03:36 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:51.410 17:03:36 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:51.410 17:03:36 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:51.410 17:03:36 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:51.410 17:03:36 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:51.410 17:03:37 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:51.410 17:03:37 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:51.410 17:03:37 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:27:54.698 Nvme0n1 00:27:54.698 17:03:40 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:57.990 17:03:43 -- host/fio.sh@53 -- # ls_guid=e284e2a8-367b-4d69-b213-8b65a4e9cb75 00:27:57.990 17:03:43 -- host/fio.sh@54 -- # get_lvs_free_mb e284e2a8-367b-4d69-b213-8b65a4e9cb75 00:27:57.990 17:03:43 -- common/autotest_common.sh@1353 -- # local lvs_uuid=e284e2a8-367b-4d69-b213-8b65a4e9cb75 00:27:57.990 17:03:43 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:57.990 17:03:43 -- common/autotest_common.sh@1355 -- # local fc 00:27:57.990 17:03:43 -- common/autotest_common.sh@1356 -- # local cs 00:27:57.990 17:03:43 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:57.990 17:03:43 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:57.990 { 00:27:57.990 "uuid": "e284e2a8-367b-4d69-b213-8b65a4e9cb75", 00:27:57.990 "name": "lvs_0", 00:27:57.990 "base_bdev": "Nvme0n1", 00:27:57.990 "total_data_clusters": 930, 00:27:57.990 "free_clusters": 930, 00:27:57.990 "block_size": 512, 00:27:57.990 "cluster_size": 1073741824 00:27:57.990 } 00:27:57.990 ]' 00:27:57.990 17:03:43 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="e284e2a8-367b-4d69-b213-8b65a4e9cb75") .free_clusters' 00:27:57.990 17:03:43 -- common/autotest_common.sh@1358 -- # fc=930 00:27:57.990 17:03:43 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="e284e2a8-367b-4d69-b213-8b65a4e9cb75") .cluster_size' 00:27:57.990 17:03:43 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:27:57.990 17:03:43 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:27:57.990 17:03:43 -- common/autotest_common.sh@1363 -- # echo 952320 00:27:57.990 952320 00:27:57.990 17:03:43 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:58.250 570463e8-52b5-4ae9-b44f-243e4d333203 00:27:58.250 17:03:43 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:58.509 17:03:44 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:58.768 17:03:44 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:59.026 17:03:44 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:59.026 17:03:44 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:59.026 17:03:44 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:59.026 17:03:44 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:59.026 17:03:44 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:59.026 17:03:44 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:59.026 17:03:44 -- common/autotest_common.sh@1330 -- # shift 00:27:59.026 17:03:44 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:59.026 17:03:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:59.026 17:03:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:59.026 17:03:44 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:59.026 17:03:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:59.026 17:03:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:59.026 17:03:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:59.026 17:03:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:59.026 17:03:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:59.026 17:03:44 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:59.026 17:03:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:59.026 17:03:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:59.026 17:03:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:59.026 17:03:44 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:59.026 17:03:44 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:59.026 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:59.026 fio-3.35 00:27:59.026 Starting 1 thread 00:27:59.026 EAL: No free 2048 kB hugepages reported on node 1 00:28:01.556 00:28:01.556 test: (groupid=0, jobs=1): err= 0: pid=1302963: Sat Nov 16 17:03:47 2024 00:28:01.556 read: IOPS=6043, BW=23.6MiB/s (24.8MB/s)(47.4MiB/2008msec) 00:28:01.556 slat (nsec): min=1859, max=140891, avg=2523.82, stdev=1914.69 00:28:01.556 clat (usec): min=907, max=170921, avg=11574.88, stdev=11598.59 00:28:01.556 lat (usec): min=909, max=170943, avg=11577.40, stdev=11598.83 00:28:01.556 clat percentiles (msec): 00:28:01.556 | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 10], 20.00th=[ 10], 00:28:01.556 | 30.00th=[ 11], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:28:01.556 | 70.00th=[ 12], 80.00th=[ 12], 90.00th=[ 12], 95.00th=[ 13], 00:28:01.556 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:28:01.556 | 99.99th=[ 171] 00:28:01.556 bw ( KiB/s): min=16976, max=26576, per=99.77%, avg=24118.00, stdev=4762.46, samples=4 00:28:01.556 iops : min= 4244, max= 6644, avg=6029.50, stdev=1190.62, samples=4 00:28:01.556 write: IOPS=6024, BW=23.5MiB/s (24.7MB/s)(47.3MiB/2008msec); 0 zone resets 00:28:01.556 slat (usec): min=2, max=108, avg= 2.55, stdev= 1.32 00:28:01.556 clat (usec): min=249, max=169238, avg=9481.14, stdev=10898.10 00:28:01.556 lat (usec): min=252, max=169243, avg=9483.69, stdev=10898.31 00:28:01.556 clat percentiles (msec): 00:28:01.556 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9], 00:28:01.556 | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:28:01.556 | 70.00th=[ 10], 80.00th=[ 10], 90.00th=[ 10], 95.00th=[ 10], 00:28:01.556 | 99.00th=[ 11], 99.50th=[ 16], 99.90th=[ 169], 99.95th=[ 169], 00:28:01.556 | 99.99th=[ 169] 00:28:01.556 bw ( KiB/s): min=18024, max=26368, per=99.97%, avg=24090.00, stdev=4050.37, samples=4 00:28:01.556 iops : min= 4506, max= 6592, avg=6022.50, stdev=1012.59, samples=4 00:28:01.556 lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01% 00:28:01.556 lat (msec) : 2=0.04%, 4=0.12%, 10=58.79%, 20=40.50%, 250=0.53% 00:28:01.556 cpu : usr=62.58%, sys=35.92%, ctx=95, majf=0, minf=36 00:28:01.556 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:01.556 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:01.556 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:01.556 issued rwts: total=12135,12097,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:01.556 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:01.556 00:28:01.556 Run status group 0 (all jobs): 00:28:01.556 READ: bw=23.6MiB/s (24.8MB/s), 23.6MiB/s-23.6MiB/s (24.8MB/s-24.8MB/s), io=47.4MiB (49.7MB), run=2008-2008msec 00:28:01.556 WRITE: bw=23.5MiB/s (24.7MB/s), 23.5MiB/s-23.5MiB/s (24.7MB/s-24.7MB/s), io=47.3MiB (49.5MB), run=2008-2008msec 00:28:01.556 17:03:47 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:01.815 17:03:47 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:28:03.189 17:03:48 -- host/fio.sh@64 -- # ls_nested_guid=0a3fb13c-8002-445b-a701-1657fc80ecd9 00:28:03.189 17:03:48 -- host/fio.sh@65 -- # get_lvs_free_mb 0a3fb13c-8002-445b-a701-1657fc80ecd9 00:28:03.189 17:03:48 -- common/autotest_common.sh@1353 -- # local lvs_uuid=0a3fb13c-8002-445b-a701-1657fc80ecd9 00:28:03.189 17:03:48 -- common/autotest_common.sh@1354 -- # local lvs_info 00:28:03.189 17:03:48 -- common/autotest_common.sh@1355 -- # local fc 00:28:03.189 17:03:48 -- common/autotest_common.sh@1356 -- # local cs 00:28:03.189 17:03:48 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:03.189 17:03:48 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:28:03.189 { 00:28:03.189 "uuid": "e284e2a8-367b-4d69-b213-8b65a4e9cb75", 00:28:03.189 "name": "lvs_0", 00:28:03.189 "base_bdev": "Nvme0n1", 00:28:03.189 "total_data_clusters": 930, 00:28:03.189 "free_clusters": 0, 00:28:03.189 "block_size": 512, 00:28:03.189 "cluster_size": 1073741824 00:28:03.189 }, 00:28:03.189 { 00:28:03.189 "uuid": "0a3fb13c-8002-445b-a701-1657fc80ecd9", 00:28:03.189 "name": "lvs_n_0", 00:28:03.189 "base_bdev": "570463e8-52b5-4ae9-b44f-243e4d333203", 00:28:03.189 "total_data_clusters": 237847, 00:28:03.189 "free_clusters": 237847, 00:28:03.189 "block_size": 512, 00:28:03.189 "cluster_size": 4194304 00:28:03.189 } 00:28:03.189 ]' 00:28:03.189 17:03:48 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="0a3fb13c-8002-445b-a701-1657fc80ecd9") .free_clusters' 00:28:03.189 17:03:48 -- common/autotest_common.sh@1358 -- # fc=237847 00:28:03.189 17:03:48 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="0a3fb13c-8002-445b-a701-1657fc80ecd9") .cluster_size' 00:28:03.189 17:03:48 -- common/autotest_common.sh@1359 -- # cs=4194304 00:28:03.189 17:03:48 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:28:03.189 17:03:48 -- common/autotest_common.sh@1363 -- # echo 951388 00:28:03.189 951388 00:28:03.189 17:03:48 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:28:04.128 2b715cc2-0947-42a9-84f7-7d1f5c08cfee 00:28:04.128 17:03:49 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:28:04.128 17:03:49 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:28:04.387 17:03:50 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:28:04.645 17:03:50 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:04.645 17:03:50 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:04.645 17:03:50 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:04.645 17:03:50 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:04.645 17:03:50 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:04.645 17:03:50 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:04.645 17:03:50 -- common/autotest_common.sh@1330 -- # shift 00:28:04.645 17:03:50 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:04.645 17:03:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:04.645 17:03:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:04.645 17:03:50 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:04.645 17:03:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:04.645 17:03:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:04.645 17:03:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:04.645 17:03:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:04.645 17:03:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:04.645 17:03:50 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:04.645 17:03:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:04.905 17:03:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:04.905 17:03:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:04.905 17:03:50 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:04.905 17:03:50 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:04.905 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:04.905 fio-3.35 00:28:04.905 Starting 1 thread 00:28:04.905 EAL: No free 2048 kB hugepages reported on node 1 00:28:07.438 00:28:07.438 test: (groupid=0, jobs=1): err= 0: pid=1303715: Sat Nov 16 17:03:52 2024 00:28:07.438 read: IOPS=6124, BW=23.9MiB/s (25.1MB/s)(48.0MiB/2008msec) 00:28:07.438 slat (nsec): min=1936, max=143002, avg=2565.55, stdev=2020.92 00:28:07.438 clat (usec): min=4460, max=18705, avg=11544.14, stdev=1010.67 00:28:07.438 lat (usec): min=4471, max=18707, avg=11546.71, stdev=1010.58 00:28:07.438 clat percentiles (usec): 00:28:07.438 | 1.00th=[ 9241], 5.00th=[10028], 10.00th=[10290], 20.00th=[10683], 00:28:07.438 | 30.00th=[11076], 40.00th=[11338], 50.00th=[11600], 60.00th=[11731], 00:28:07.438 | 70.00th=[11994], 80.00th=[12387], 90.00th=[12780], 95.00th=[13042], 00:28:07.438 | 99.00th=[13829], 99.50th=[13960], 99.90th=[17433], 99.95th=[18482], 00:28:07.438 | 99.99th=[18744] 00:28:07.438 bw ( KiB/s): min=23256, max=24920, per=99.84%, avg=24458.00, stdev=802.51, samples=4 00:28:07.438 iops : min= 5814, max= 6230, avg=6114.50, stdev=200.63, samples=4 00:28:07.438 write: IOPS=6106, BW=23.9MiB/s (25.0MB/s)(47.9MiB/2008msec); 0 zone resets 00:28:07.438 slat (usec): min=2, max=121, avg= 2.65, stdev= 1.52 00:28:07.438 clat (usec): min=2247, max=17236, avg=9274.82, stdev=849.38 00:28:07.438 lat (usec): min=2253, max=17238, avg=9277.47, stdev=849.33 00:28:07.438 clat percentiles (usec): 00:28:07.438 | 1.00th=[ 7373], 5.00th=[ 7963], 10.00th=[ 8291], 20.00th=[ 8586], 00:28:07.438 | 30.00th=[ 8848], 40.00th=[ 9110], 50.00th=[ 9241], 60.00th=[ 9503], 00:28:07.438 | 70.00th=[ 9634], 80.00th=[ 9896], 90.00th=[10290], 95.00th=[10552], 00:28:07.438 | 99.00th=[11207], 99.50th=[11469], 99.90th=[14353], 99.95th=[14615], 00:28:07.438 | 99.99th=[17171] 00:28:07.438 bw ( KiB/s): min=24304, max=24528, per=99.93%, avg=24406.00, stdev=101.48, samples=4 00:28:07.438 iops : min= 6076, max= 6132, avg=6101.50, stdev=25.37, samples=4 00:28:07.438 lat (msec) : 4=0.04%, 10=43.74%, 20=56.22% 00:28:07.438 cpu : usr=63.08%, sys=35.58%, ctx=107, majf=0, minf=36 00:28:07.438 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:07.438 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:07.438 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:07.438 issued rwts: total=12298,12261,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:07.438 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:07.438 00:28:07.438 Run status group 0 (all jobs): 00:28:07.438 READ: bw=23.9MiB/s (25.1MB/s), 23.9MiB/s-23.9MiB/s (25.1MB/s-25.1MB/s), io=48.0MiB (50.4MB), run=2008-2008msec 00:28:07.438 WRITE: bw=23.9MiB/s (25.0MB/s), 23.9MiB/s-23.9MiB/s (25.0MB/s-25.0MB/s), io=47.9MiB (50.2MB), run=2008-2008msec 00:28:07.438 17:03:52 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:28:07.438 17:03:53 -- host/fio.sh@74 -- # sync 00:28:07.697 17:03:53 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:28:11.891 17:03:57 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:28:11.891 17:03:57 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:28:14.426 17:04:00 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:28:14.684 17:04:00 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:28:16.589 17:04:02 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:28:16.589 17:04:02 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:28:16.589 17:04:02 -- host/fio.sh@86 -- # nvmftestfini 00:28:16.589 17:04:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:16.589 17:04:02 -- nvmf/common.sh@116 -- # sync 00:28:16.589 17:04:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:16.589 17:04:02 -- nvmf/common.sh@119 -- # set +e 00:28:16.589 17:04:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:16.589 17:04:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:16.589 rmmod nvme_tcp 00:28:16.847 rmmod nvme_fabrics 00:28:16.847 rmmod nvme_keyring 00:28:16.847 17:04:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:16.847 17:04:02 -- nvmf/common.sh@123 -- # set -e 00:28:16.847 17:04:02 -- nvmf/common.sh@124 -- # return 0 00:28:16.847 17:04:02 -- nvmf/common.sh@477 -- # '[' -n 1300801 ']' 00:28:16.847 17:04:02 -- nvmf/common.sh@478 -- # killprocess 1300801 00:28:16.847 17:04:02 -- common/autotest_common.sh@936 -- # '[' -z 1300801 ']' 00:28:16.847 17:04:02 -- common/autotest_common.sh@940 -- # kill -0 1300801 00:28:16.847 17:04:02 -- common/autotest_common.sh@941 -- # uname 00:28:16.847 17:04:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:16.847 17:04:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1300801 00:28:16.847 17:04:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:16.847 17:04:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:16.847 17:04:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1300801' 00:28:16.847 killing process with pid 1300801 00:28:16.847 17:04:02 -- common/autotest_common.sh@955 -- # kill 1300801 00:28:16.847 17:04:02 -- common/autotest_common.sh@960 -- # wait 1300801 00:28:17.106 17:04:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:17.106 17:04:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:17.106 17:04:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:17.106 17:04:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:17.106 17:04:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:17.106 17:04:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:17.106 17:04:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:17.106 17:04:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:19.051 17:04:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:19.051 00:28:19.051 real 0m37.972s 00:28:19.051 user 2m25.908s 00:28:19.051 sys 0m7.006s 00:28:19.051 17:04:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:19.051 17:04:04 -- common/autotest_common.sh@10 -- # set +x 00:28:19.051 ************************************ 00:28:19.051 END TEST nvmf_fio_host 00:28:19.051 ************************************ 00:28:19.051 17:04:04 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:19.051 17:04:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:19.051 17:04:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:19.051 17:04:04 -- common/autotest_common.sh@10 -- # set +x 00:28:19.051 ************************************ 00:28:19.051 START TEST nvmf_failover 00:28:19.051 ************************************ 00:28:19.051 17:04:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:19.051 * Looking for test storage... 00:28:19.051 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:19.051 17:04:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:19.051 17:04:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:19.051 17:04:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:19.339 17:04:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:19.339 17:04:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:19.339 17:04:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:19.339 17:04:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:19.339 17:04:04 -- scripts/common.sh@335 -- # IFS=.-: 00:28:19.339 17:04:04 -- scripts/common.sh@335 -- # read -ra ver1 00:28:19.339 17:04:04 -- scripts/common.sh@336 -- # IFS=.-: 00:28:19.339 17:04:04 -- scripts/common.sh@336 -- # read -ra ver2 00:28:19.339 17:04:04 -- scripts/common.sh@337 -- # local 'op=<' 00:28:19.339 17:04:04 -- scripts/common.sh@339 -- # ver1_l=2 00:28:19.339 17:04:04 -- scripts/common.sh@340 -- # ver2_l=1 00:28:19.339 17:04:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:19.339 17:04:04 -- scripts/common.sh@343 -- # case "$op" in 00:28:19.339 17:04:04 -- scripts/common.sh@344 -- # : 1 00:28:19.339 17:04:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:19.339 17:04:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:19.339 17:04:04 -- scripts/common.sh@364 -- # decimal 1 00:28:19.339 17:04:04 -- scripts/common.sh@352 -- # local d=1 00:28:19.339 17:04:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:19.339 17:04:04 -- scripts/common.sh@354 -- # echo 1 00:28:19.339 17:04:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:19.339 17:04:04 -- scripts/common.sh@365 -- # decimal 2 00:28:19.339 17:04:04 -- scripts/common.sh@352 -- # local d=2 00:28:19.339 17:04:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:19.339 17:04:04 -- scripts/common.sh@354 -- # echo 2 00:28:19.339 17:04:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:19.339 17:04:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:19.339 17:04:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:19.339 17:04:04 -- scripts/common.sh@367 -- # return 0 00:28:19.340 17:04:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:19.340 17:04:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:19.340 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:19.340 --rc genhtml_branch_coverage=1 00:28:19.340 --rc genhtml_function_coverage=1 00:28:19.340 --rc genhtml_legend=1 00:28:19.340 --rc geninfo_all_blocks=1 00:28:19.340 --rc geninfo_unexecuted_blocks=1 00:28:19.340 00:28:19.340 ' 00:28:19.340 17:04:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:19.340 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:19.340 --rc genhtml_branch_coverage=1 00:28:19.340 --rc genhtml_function_coverage=1 00:28:19.340 --rc genhtml_legend=1 00:28:19.340 --rc geninfo_all_blocks=1 00:28:19.340 --rc geninfo_unexecuted_blocks=1 00:28:19.340 00:28:19.340 ' 00:28:19.340 17:04:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:19.340 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:19.340 --rc genhtml_branch_coverage=1 00:28:19.340 --rc genhtml_function_coverage=1 00:28:19.340 --rc genhtml_legend=1 00:28:19.340 --rc geninfo_all_blocks=1 00:28:19.340 --rc geninfo_unexecuted_blocks=1 00:28:19.340 00:28:19.340 ' 00:28:19.340 17:04:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:19.340 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:19.340 --rc genhtml_branch_coverage=1 00:28:19.340 --rc genhtml_function_coverage=1 00:28:19.340 --rc genhtml_legend=1 00:28:19.340 --rc geninfo_all_blocks=1 00:28:19.340 --rc geninfo_unexecuted_blocks=1 00:28:19.340 00:28:19.340 ' 00:28:19.340 17:04:04 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:19.340 17:04:04 -- nvmf/common.sh@7 -- # uname -s 00:28:19.340 17:04:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:19.340 17:04:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:19.340 17:04:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:19.340 17:04:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:19.340 17:04:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:19.340 17:04:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:19.340 17:04:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:19.340 17:04:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:19.340 17:04:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:19.340 17:04:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:19.340 17:04:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:19.340 17:04:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:19.340 17:04:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:19.340 17:04:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:19.340 17:04:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:19.340 17:04:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:19.340 17:04:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:19.340 17:04:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:19.340 17:04:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:19.340 17:04:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.340 17:04:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.340 17:04:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.340 17:04:04 -- paths/export.sh@5 -- # export PATH 00:28:19.340 17:04:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.340 17:04:04 -- nvmf/common.sh@46 -- # : 0 00:28:19.340 17:04:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:19.340 17:04:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:19.340 17:04:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:19.340 17:04:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:19.340 17:04:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:19.340 17:04:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:19.340 17:04:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:19.340 17:04:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:19.340 17:04:04 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:28:19.340 17:04:04 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:28:19.340 17:04:04 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:19.340 17:04:04 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:28:19.340 17:04:04 -- host/failover.sh@18 -- # nvmftestinit 00:28:19.340 17:04:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:19.340 17:04:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:19.340 17:04:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:19.340 17:04:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:19.340 17:04:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:19.340 17:04:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:19.340 17:04:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:19.340 17:04:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:19.340 17:04:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:19.340 17:04:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:19.340 17:04:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:19.340 17:04:04 -- common/autotest_common.sh@10 -- # set +x 00:28:21.244 17:04:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:21.244 17:04:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:21.244 17:04:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:21.244 17:04:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:21.244 17:04:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:21.244 17:04:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:21.244 17:04:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:21.244 17:04:06 -- nvmf/common.sh@294 -- # net_devs=() 00:28:21.244 17:04:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:21.244 17:04:06 -- nvmf/common.sh@295 -- # e810=() 00:28:21.244 17:04:06 -- nvmf/common.sh@295 -- # local -ga e810 00:28:21.244 17:04:06 -- nvmf/common.sh@296 -- # x722=() 00:28:21.244 17:04:06 -- nvmf/common.sh@296 -- # local -ga x722 00:28:21.244 17:04:06 -- nvmf/common.sh@297 -- # mlx=() 00:28:21.244 17:04:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:21.244 17:04:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:21.244 17:04:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:21.244 17:04:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:21.244 17:04:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:21.244 17:04:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:21.244 17:04:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:21.244 17:04:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:21.244 17:04:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:21.244 17:04:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:21.244 17:04:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:21.245 17:04:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:21.245 17:04:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:21.245 17:04:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:21.245 17:04:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:21.245 17:04:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:21.245 17:04:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:21.245 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:21.245 17:04:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:21.245 17:04:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:21.245 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:21.245 17:04:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:21.245 17:04:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:21.245 17:04:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:21.245 17:04:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:21.245 17:04:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:21.245 17:04:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:21.245 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:21.245 17:04:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:21.245 17:04:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:21.245 17:04:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:21.245 17:04:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:21.245 17:04:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:21.245 17:04:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:21.245 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:21.245 17:04:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:21.245 17:04:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:21.245 17:04:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:21.245 17:04:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:21.245 17:04:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:21.245 17:04:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:21.245 17:04:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:21.245 17:04:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:21.245 17:04:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:21.245 17:04:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:21.245 17:04:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:21.245 17:04:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:21.245 17:04:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:21.245 17:04:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:21.245 17:04:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:21.245 17:04:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:21.245 17:04:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:21.245 17:04:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:21.245 17:04:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:21.245 17:04:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:21.245 17:04:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:21.245 17:04:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:21.503 17:04:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:21.503 17:04:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:21.503 17:04:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:21.503 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:21.503 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.277 ms 00:28:21.503 00:28:21.503 --- 10.0.0.2 ping statistics --- 00:28:21.503 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:21.503 rtt min/avg/max/mdev = 0.277/0.277/0.277/0.000 ms 00:28:21.503 17:04:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:21.503 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:21.503 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.158 ms 00:28:21.503 00:28:21.503 --- 10.0.0.1 ping statistics --- 00:28:21.503 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:21.503 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:28:21.503 17:04:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:21.503 17:04:07 -- nvmf/common.sh@410 -- # return 0 00:28:21.503 17:04:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:21.503 17:04:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:21.503 17:04:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:21.503 17:04:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:21.503 17:04:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:21.503 17:04:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:21.503 17:04:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:21.503 17:04:07 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:28:21.503 17:04:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:21.503 17:04:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:21.504 17:04:07 -- common/autotest_common.sh@10 -- # set +x 00:28:21.504 17:04:07 -- nvmf/common.sh@469 -- # nvmfpid=1307140 00:28:21.504 17:04:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:21.504 17:04:07 -- nvmf/common.sh@470 -- # waitforlisten 1307140 00:28:21.504 17:04:07 -- common/autotest_common.sh@829 -- # '[' -z 1307140 ']' 00:28:21.504 17:04:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:21.504 17:04:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:21.504 17:04:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:21.504 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:21.504 17:04:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:21.504 17:04:07 -- common/autotest_common.sh@10 -- # set +x 00:28:21.504 [2024-11-16 17:04:07.089258] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:21.504 [2024-11-16 17:04:07.089333] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:21.504 EAL: No free 2048 kB hugepages reported on node 1 00:28:21.504 [2024-11-16 17:04:07.158201] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:21.504 [2024-11-16 17:04:07.247160] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:21.504 [2024-11-16 17:04:07.247344] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:21.504 [2024-11-16 17:04:07.247365] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:21.504 [2024-11-16 17:04:07.247379] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:21.504 [2024-11-16 17:04:07.247479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:21.504 [2024-11-16 17:04:07.247574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:21.504 [2024-11-16 17:04:07.247577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:22.441 17:04:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:22.441 17:04:08 -- common/autotest_common.sh@862 -- # return 0 00:28:22.441 17:04:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:22.441 17:04:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:22.441 17:04:08 -- common/autotest_common.sh@10 -- # set +x 00:28:22.441 17:04:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:22.441 17:04:08 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:22.699 [2024-11-16 17:04:08.328424] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:22.699 17:04:08 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:22.957 Malloc0 00:28:22.957 17:04:08 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:23.215 17:04:08 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:23.474 17:04:09 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:23.732 [2024-11-16 17:04:09.358464] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:23.732 17:04:09 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:23.990 [2024-11-16 17:04:09.611221] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:23.990 17:04:09 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:24.248 [2024-11-16 17:04:09.856089] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:24.248 17:04:09 -- host/failover.sh@31 -- # bdevperf_pid=1307453 00:28:24.248 17:04:09 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:24.248 17:04:09 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:24.248 17:04:09 -- host/failover.sh@34 -- # waitforlisten 1307453 /var/tmp/bdevperf.sock 00:28:24.248 17:04:09 -- common/autotest_common.sh@829 -- # '[' -z 1307453 ']' 00:28:24.248 17:04:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:24.248 17:04:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:24.248 17:04:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:24.248 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:24.248 17:04:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:24.248 17:04:09 -- common/autotest_common.sh@10 -- # set +x 00:28:25.185 17:04:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:25.185 17:04:10 -- common/autotest_common.sh@862 -- # return 0 00:28:25.185 17:04:10 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:25.751 NVMe0n1 00:28:25.751 17:04:11 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:26.317 00:28:26.317 17:04:11 -- host/failover.sh@39 -- # run_test_pid=1307727 00:28:26.317 17:04:11 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:26.317 17:04:11 -- host/failover.sh@41 -- # sleep 1 00:28:27.253 17:04:12 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:27.512 [2024-11-16 17:04:13.073004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.512 [2024-11-16 17:04:13.073082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 [2024-11-16 17:04:13.073399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6cf180 is same with the state(5) to be set 00:28:27.513 17:04:13 -- host/failover.sh@45 -- # sleep 3 00:28:30.792 17:04:16 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:30.792 00:28:30.792 17:04:16 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:31.052 [2024-11-16 17:04:16.647855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.647932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.647947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.647960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.647987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.647999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648071] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.052 [2024-11-16 17:04:16.648260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 [2024-11-16 17:04:16.648540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6d0530 is same with the state(5) to be set 00:28:31.053 17:04:16 -- host/failover.sh@50 -- # sleep 3 00:28:34.356 17:04:19 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:34.356 [2024-11-16 17:04:19.918835] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:34.356 17:04:19 -- host/failover.sh@55 -- # sleep 1 00:28:35.293 17:04:20 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:35.552 [2024-11-16 17:04:21.181604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.181998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 [2024-11-16 17:04:21.182248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8865e0 is same with the state(5) to be set 00:28:35.552 17:04:21 -- host/failover.sh@59 -- # wait 1307727 00:28:42.126 0 00:28:42.126 17:04:26 -- host/failover.sh@61 -- # killprocess 1307453 00:28:42.126 17:04:26 -- common/autotest_common.sh@936 -- # '[' -z 1307453 ']' 00:28:42.126 17:04:26 -- common/autotest_common.sh@940 -- # kill -0 1307453 00:28:42.126 17:04:26 -- common/autotest_common.sh@941 -- # uname 00:28:42.126 17:04:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:42.126 17:04:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1307453 00:28:42.126 17:04:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:42.126 17:04:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:42.126 17:04:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1307453' 00:28:42.126 killing process with pid 1307453 00:28:42.126 17:04:27 -- common/autotest_common.sh@955 -- # kill 1307453 00:28:42.126 17:04:27 -- common/autotest_common.sh@960 -- # wait 1307453 00:28:42.126 17:04:27 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:42.126 [2024-11-16 17:04:09.916198] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:42.126 [2024-11-16 17:04:09.916292] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1307453 ] 00:28:42.126 EAL: No free 2048 kB hugepages reported on node 1 00:28:42.126 [2024-11-16 17:04:09.976235] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:42.126 [2024-11-16 17:04:10.071015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:42.126 Running I/O for 15 seconds... 00:28:42.126 [2024-11-16 17:04:13.073747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:118512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.073789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.073819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:118536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.073836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.073853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:118544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.073868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.073884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:118560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.073898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.073929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:118576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.073943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.073958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:117888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.073972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.074002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:117896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.074016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.074030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:117904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.074043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.074058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:117912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.074071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.074086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:117920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.074099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.074113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:117936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.074126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.074149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:117944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.074163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.074177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:117960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.074190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.074205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:117968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.074218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.074232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:117976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.074245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.074259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:117984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.074272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.126 [2024-11-16 17:04:13.074287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:118016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.126 [2024-11-16 17:04:13.074301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:118032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.074331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.074359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:118072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.074387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:118088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.074414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:118592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.074441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:118600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.074469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:118608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.074501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:118616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.074530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:118640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.127 [2024-11-16 17:04:13.074557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:118648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.127 [2024-11-16 17:04:13.074585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:118656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.074639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:118664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.074669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:118672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.127 [2024-11-16 17:04:13.074700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:118680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.127 [2024-11-16 17:04:13.074729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:118688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.074760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:118696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.127 [2024-11-16 17:04:13.074789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:118704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.074819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:118712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.074848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:118720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.127 [2024-11-16 17:04:13.074877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:118728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.127 [2024-11-16 17:04:13.074936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:118736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.127 [2024-11-16 17:04:13.074965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.074980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:118744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.074993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:118752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.075021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:118760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.075050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:118768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.075078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:118776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.075107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:118784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.075135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:118792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.075180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:118800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.127 [2024-11-16 17:04:13.075210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:118808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.127 [2024-11-16 17:04:13.075239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:118816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.127 [2024-11-16 17:04:13.075269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:118824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.127 [2024-11-16 17:04:13.075307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:118128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.075338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:118136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.075367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:118144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.075396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:118152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.075425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:118168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.075455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:118184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.075499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:118192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.127 [2024-11-16 17:04:13.075529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.127 [2024-11-16 17:04:13.075544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:118200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.075557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:118216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.075585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:118240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.075614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:118248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.075657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:118256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.075686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:118264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.075720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:118272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.075749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:118288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.075777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:118304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.075806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:118832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.075835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:118840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.128 [2024-11-16 17:04:13.075864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:118848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.075891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:118856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.128 [2024-11-16 17:04:13.075919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:118864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.075948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:118872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.075975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.075990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:118880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.128 [2024-11-16 17:04:13.076003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:118888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.128 [2024-11-16 17:04:13.076032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:118896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:118904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:118912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.128 [2024-11-16 17:04:13.076122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:118920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:118928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:118936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.128 [2024-11-16 17:04:13.076210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:118944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.128 [2024-11-16 17:04:13.076238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:118312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:118328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:118344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:118368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:118376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:118384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:118400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:118408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:118416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:118424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:118432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:118440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:118448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:118456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:118488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.128 [2024-11-16 17:04:13.076716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:118496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.128 [2024-11-16 17:04:13.076730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.076746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:118952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.129 [2024-11-16 17:04:13.076760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.076775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:118960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.076789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.076804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:118968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.076819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.076839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:118976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.076854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.076869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:118984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.076883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.076899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:118992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.076913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.076944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:119000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.076958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.076973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:119008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.076987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:119016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.129 [2024-11-16 17:04:13.077015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:119024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.077045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:119032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.077074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:119040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.077110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:119048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.129 [2024-11-16 17:04:13.077141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:119056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.077169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:119064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.077198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:119072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.077231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:119080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.129 [2024-11-16 17:04:13.077261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:119088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.129 [2024-11-16 17:04:13.077297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:119096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.077325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:119104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.129 [2024-11-16 17:04:13.077357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:119112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.129 [2024-11-16 17:04:13.077386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:119120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.077414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:119128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.077443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:119136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.129 [2024-11-16 17:04:13.077471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:118504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.129 [2024-11-16 17:04:13.077500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:118520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.129 [2024-11-16 17:04:13.077529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:118528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.129 [2024-11-16 17:04:13.077557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:118552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.129 [2024-11-16 17:04:13.077591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:118568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.129 [2024-11-16 17:04:13.077651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:118584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.129 [2024-11-16 17:04:13.077681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:118624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.129 [2024-11-16 17:04:13.077710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13d5c70 is same with the state(5) to be set 00:28:42.129 [2024-11-16 17:04:13.077743] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:42.129 [2024-11-16 17:04:13.077756] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:42.129 [2024-11-16 17:04:13.077768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118632 len:8 PRP1 0x0 PRP2 0x0 00:28:42.129 [2024-11-16 17:04:13.077782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077845] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x13d5c70 was disconnected and freed. reset controller. 00:28:42.129 [2024-11-16 17:04:13.077872] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:42.129 [2024-11-16 17:04:13.077925] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.129 [2024-11-16 17:04:13.077943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.077958] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.129 [2024-11-16 17:04:13.077987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.078001] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.129 [2024-11-16 17:04:13.078015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.078029] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.129 [2024-11-16 17:04:13.078043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.129 [2024-11-16 17:04:13.078056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:42.129 [2024-11-16 17:04:13.078096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13b6600 (9): Bad file descriptor 00:28:42.129 [2024-11-16 17:04:13.080360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:42.130 [2024-11-16 17:04:13.188988] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:42.130 [2024-11-16 17:04:16.648705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:4296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.648751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.648789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:4312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.648807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.648825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:4344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.648839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.648854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:4352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.648869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.648884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:4368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.648898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.648913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:3776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.648942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.648957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:3784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.648972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:3792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:3848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:3864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:3888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:4376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:4408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:4416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:4440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:4448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:4464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:4472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:4480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:4496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:4504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:4512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:4528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:4544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:4560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:4568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.130 [2024-11-16 17:04:16.649571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:4584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.130 [2024-11-16 17:04:16.649650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:4592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.130 [2024-11-16 17:04:16.649681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:4600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.130 [2024-11-16 17:04:16.649708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.130 [2024-11-16 17:04:16.649724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:3904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.649738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.649753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.649766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.649781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:3944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.649794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.649809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:3952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.649823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.649838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:3968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.649852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.649867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:3984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.649880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.649895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:4016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.649909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.649928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:4032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.649956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.649971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:4608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.649984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.649999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:4616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.650012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:4624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:4632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.650068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:4640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.650096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:4648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:4656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.650150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:4664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.650177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:4040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:4056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:4064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:4096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:4120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:4136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:4144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:4672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.650431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:4680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.650458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:4688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.650486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:4696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.650512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:4704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.650540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:4712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.650567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:4720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.650596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:4728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.650651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:4736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.131 [2024-11-16 17:04:16.650686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:4152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:4168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:4192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:4224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:4232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:4272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.131 [2024-11-16 17:04:16.650885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.131 [2024-11-16 17:04:16.650901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:4280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.650915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.650944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:4744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.650958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.650972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:4752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.650986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:4760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.132 [2024-11-16 17:04:16.651012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:4768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:4776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:4792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.132 [2024-11-16 17:04:16.651128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:4800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.132 [2024-11-16 17:04:16.651156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:4808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:4816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:4824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.132 [2024-11-16 17:04:16.651238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:4832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:4840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.132 [2024-11-16 17:04:16.651294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:4848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.132 [2024-11-16 17:04:16.651321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:4856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:4864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:4872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:4880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:4888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:4896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.132 [2024-11-16 17:04:16.651490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:4904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:4912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.132 [2024-11-16 17:04:16.651544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:4288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:4320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:4328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:4336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:4360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:4384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:4392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:4928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.651877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:4936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.132 [2024-11-16 17:04:16.651906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:4944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.132 [2024-11-16 17:04:16.651951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.651973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:4952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.652003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.652018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:4960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.652032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.652046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.652059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.652073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:4976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.132 [2024-11-16 17:04:16.652086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.132 [2024-11-16 17:04:16.652100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:4984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:16.652114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:4992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.133 [2024-11-16 17:04:16.652140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:16.652168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:5008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.133 [2024-11-16 17:04:16.652195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:5016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.133 [2024-11-16 17:04:16.652227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:5024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:16.652255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:5032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:16.652281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:5040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.133 [2024-11-16 17:04:16.652308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:5048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:16.652335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:16.652362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:4424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:16.652390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:4432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:16.652416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:4456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:16.652449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:16.652477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:4520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:16.652504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:4536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:16.652531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652545] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c2a90 is same with the state(5) to be set 00:28:42.133 [2024-11-16 17:04:16.652566] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:42.133 [2024-11-16 17:04:16.652578] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:42.133 [2024-11-16 17:04:16.652589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4552 len:8 PRP1 0x0 PRP2 0x0 00:28:42.133 [2024-11-16 17:04:16.652624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652709] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x13c2a90 was disconnected and freed. reset controller. 00:28:42.133 [2024-11-16 17:04:16.652730] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:42.133 [2024-11-16 17:04:16.652767] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.133 [2024-11-16 17:04:16.652786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652801] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.133 [2024-11-16 17:04:16.652816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652831] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.133 [2024-11-16 17:04:16.652844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652858] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.133 [2024-11-16 17:04:16.652871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:16.652884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:42.133 [2024-11-16 17:04:16.654961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:42.133 [2024-11-16 17:04:16.655004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13b6600 (9): Bad file descriptor 00:28:42.133 [2024-11-16 17:04:16.769774] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:42.133 [2024-11-16 17:04:21.182377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:123496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:21.182416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:21.182445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:123504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:21.182462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:21.182479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:123512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:21.182493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:21.182508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:123520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:21.182522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:21.182537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:123528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:21.182556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:21.182572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:123536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:21.182585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:21.182600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:123560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:21.182636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:21.182653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:122960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:21.182667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:21.182697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:122992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:21.182711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:21.182726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:123016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:21.182741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:21.182756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:123024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:21.182769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:21.182784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:123032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:21.182797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.133 [2024-11-16 17:04:21.182812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:123072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.133 [2024-11-16 17:04:21.182826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.182841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:123112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.182855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.182869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:123136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.182883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.182908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:123584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.182921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.182936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:123608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.182950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.182970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:123624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:123632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:123648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:123688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:123696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:123720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:123728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:123744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.134 [2024-11-16 17:04:21.183192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:123752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.134 [2024-11-16 17:04:21.183220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:123760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.134 [2024-11-16 17:04:21.183247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:123768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:123776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.134 [2024-11-16 17:04:21.183310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:123784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:123792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.134 [2024-11-16 17:04:21.183376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:123800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:123808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:123816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.134 [2024-11-16 17:04:21.183462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:123824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:123832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:123840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:123848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.134 [2024-11-16 17:04:21.183576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:123856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.134 [2024-11-16 17:04:21.183603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:123864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.134 [2024-11-16 17:04:21.183656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:123872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.134 [2024-11-16 17:04:21.183685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:123880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.134 [2024-11-16 17:04:21.183713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:123888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:123896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:123904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:123912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.134 [2024-11-16 17:04:21.183839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:123920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.134 [2024-11-16 17:04:21.183868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:123928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:123936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:123944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.183983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:123952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.134 [2024-11-16 17:04:21.183996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.184011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:123960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.134 [2024-11-16 17:04:21.184024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.134 [2024-11-16 17:04:21.184038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:123968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:123976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:123152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:123184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:123208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:123224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:123232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:123240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:123256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:123272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:123280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:123296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:123312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:123320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:123328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:123336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:123344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:123360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:123984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.135 [2024-11-16 17:04:21.184561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:123992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:124000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.135 [2024-11-16 17:04:21.184637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:124008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:124016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.135 [2024-11-16 17:04:21.184698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:124024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.135 [2024-11-16 17:04:21.184732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:124032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.135 [2024-11-16 17:04:21.184761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:124040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.135 [2024-11-16 17:04:21.184789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:124048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.135 [2024-11-16 17:04:21.184817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:124056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.135 [2024-11-16 17:04:21.184845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:124064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:124072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:124080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:124088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.135 [2024-11-16 17:04:21.184978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.184992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:124096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.135 [2024-11-16 17:04:21.185005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.185020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:124104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.135 [2024-11-16 17:04:21.185033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.135 [2024-11-16 17:04:21.185047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:123368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:123376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:123384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:123392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:123416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:123424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:123456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:123480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:124112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.136 [2024-11-16 17:04:21.185294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:124120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:124128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:123488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:123544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:123552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:123568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:123576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:123592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:123600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:123616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:124136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.136 [2024-11-16 17:04:21.185622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:124144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:124152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:124160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:124168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:124176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:124184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.136 [2024-11-16 17:04:21.185828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:124192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:124200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.136 [2024-11-16 17:04:21.185888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:124208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:124216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.185962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.185977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:124224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.186006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.186022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:124232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.136 [2024-11-16 17:04:21.186038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.186054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:124240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.136 [2024-11-16 17:04:21.186067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.186082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:124248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:42.136 [2024-11-16 17:04:21.186095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.186110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:123640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.186123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.186137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:123656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.186151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.186165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:123664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.186178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.186193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:123672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.186205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.186220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:123680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.136 [2024-11-16 17:04:21.186233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.136 [2024-11-16 17:04:21.186247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:123704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.137 [2024-11-16 17:04:21.186260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.137 [2024-11-16 17:04:21.186274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:123712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:42.137 [2024-11-16 17:04:21.186292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.137 [2024-11-16 17:04:21.186307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13d7c50 is same with the state(5) to be set 00:28:42.137 [2024-11-16 17:04:21.186324] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:42.137 [2024-11-16 17:04:21.186335] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:42.137 [2024-11-16 17:04:21.186346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:123736 len:8 PRP1 0x0 PRP2 0x0 00:28:42.137 [2024-11-16 17:04:21.186358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.137 [2024-11-16 17:04:21.186415] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x13d7c50 was disconnected and freed. reset controller. 00:28:42.137 [2024-11-16 17:04:21.186434] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:42.137 [2024-11-16 17:04:21.186481] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.137 [2024-11-16 17:04:21.186503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.137 [2024-11-16 17:04:21.186519] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.137 [2024-11-16 17:04:21.186546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.137 [2024-11-16 17:04:21.186562] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.137 [2024-11-16 17:04:21.186575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.137 [2024-11-16 17:04:21.186589] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.137 [2024-11-16 17:04:21.186602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.137 [2024-11-16 17:04:21.186627] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:42.137 [2024-11-16 17:04:21.186683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13b6600 (9): Bad file descriptor 00:28:42.137 [2024-11-16 17:04:21.189069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:42.137 [2024-11-16 17:04:21.220672] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:42.137 00:28:42.137 Latency(us) 00:28:42.137 [2024-11-16T16:04:27.887Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:42.137 [2024-11-16T16:04:27.887Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:42.137 Verification LBA range: start 0x0 length 0x4000 00:28:42.137 NVMe0n1 : 15.01 12780.31 49.92 990.81 0.00 9277.75 552.20 15631.55 00:28:42.137 [2024-11-16T16:04:27.887Z] =================================================================================================================== 00:28:42.137 [2024-11-16T16:04:27.887Z] Total : 12780.31 49.92 990.81 0.00 9277.75 552.20 15631.55 00:28:42.137 Received shutdown signal, test time was about 15.000000 seconds 00:28:42.137 00:28:42.137 Latency(us) 00:28:42.137 [2024-11-16T16:04:27.887Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:42.137 [2024-11-16T16:04:27.887Z] =================================================================================================================== 00:28:42.137 [2024-11-16T16:04:27.887Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:42.137 17:04:27 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:42.137 17:04:27 -- host/failover.sh@65 -- # count=3 00:28:42.137 17:04:27 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:42.137 17:04:27 -- host/failover.sh@73 -- # bdevperf_pid=1309617 00:28:42.137 17:04:27 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:42.137 17:04:27 -- host/failover.sh@75 -- # waitforlisten 1309617 /var/tmp/bdevperf.sock 00:28:42.137 17:04:27 -- common/autotest_common.sh@829 -- # '[' -z 1309617 ']' 00:28:42.137 17:04:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:42.137 17:04:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:42.137 17:04:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:42.137 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:42.137 17:04:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:42.137 17:04:27 -- common/autotest_common.sh@10 -- # set +x 00:28:42.703 17:04:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:42.703 17:04:28 -- common/autotest_common.sh@862 -- # return 0 00:28:42.703 17:04:28 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:42.962 [2024-11-16 17:04:28.518935] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:42.962 17:04:28 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:43.218 [2024-11-16 17:04:28.763540] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:43.218 17:04:28 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:43.476 NVMe0n1 00:28:43.476 17:04:29 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:44.044 00:28:44.045 17:04:29 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:44.303 00:28:44.303 17:04:29 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:44.303 17:04:29 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:44.560 17:04:30 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:44.818 17:04:30 -- host/failover.sh@87 -- # sleep 3 00:28:48.109 17:04:33 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:48.109 17:04:33 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:48.109 17:04:33 -- host/failover.sh@90 -- # run_test_pid=1310321 00:28:48.109 17:04:33 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:48.109 17:04:33 -- host/failover.sh@92 -- # wait 1310321 00:28:49.051 0 00:28:49.051 17:04:34 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:49.051 [2024-11-16 17:04:27.283250] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:49.051 [2024-11-16 17:04:27.283341] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1309617 ] 00:28:49.051 EAL: No free 2048 kB hugepages reported on node 1 00:28:49.051 [2024-11-16 17:04:27.341380] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:49.051 [2024-11-16 17:04:27.422455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:49.051 [2024-11-16 17:04:30.343364] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:49.051 [2024-11-16 17:04:30.343487] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:49.051 [2024-11-16 17:04:30.343511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:49.051 [2024-11-16 17:04:30.343546] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:49.051 [2024-11-16 17:04:30.343560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:49.051 [2024-11-16 17:04:30.343575] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:49.051 [2024-11-16 17:04:30.343588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:49.051 [2024-11-16 17:04:30.343603] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:49.051 [2024-11-16 17:04:30.343624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:49.051 [2024-11-16 17:04:30.343641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:49.051 [2024-11-16 17:04:30.343688] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:49.051 [2024-11-16 17:04:30.343724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1dae600 (9): Bad file descriptor 00:28:49.051 [2024-11-16 17:04:30.393023] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:49.051 Running I/O for 1 seconds... 00:28:49.051 00:28:49.051 Latency(us) 00:28:49.051 [2024-11-16T16:04:34.801Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:49.051 [2024-11-16T16:04:34.801Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:49.051 Verification LBA range: start 0x0 length 0x4000 00:28:49.051 NVMe0n1 : 1.01 12477.82 48.74 0.00 0.00 10206.01 1365.33 12039.21 00:28:49.051 [2024-11-16T16:04:34.801Z] =================================================================================================================== 00:28:49.051 [2024-11-16T16:04:34.801Z] Total : 12477.82 48.74 0.00 0.00 10206.01 1365.33 12039.21 00:28:49.051 17:04:34 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:49.051 17:04:34 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:49.621 17:04:35 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:49.881 17:04:35 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:49.881 17:04:35 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:50.139 17:04:35 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:50.397 17:04:35 -- host/failover.sh@101 -- # sleep 3 00:28:53.721 17:04:38 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:53.721 17:04:38 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:53.721 17:04:39 -- host/failover.sh@108 -- # killprocess 1309617 00:28:53.721 17:04:39 -- common/autotest_common.sh@936 -- # '[' -z 1309617 ']' 00:28:53.721 17:04:39 -- common/autotest_common.sh@940 -- # kill -0 1309617 00:28:53.721 17:04:39 -- common/autotest_common.sh@941 -- # uname 00:28:53.721 17:04:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:53.721 17:04:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1309617 00:28:53.721 17:04:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:53.721 17:04:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:53.721 17:04:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1309617' 00:28:53.721 killing process with pid 1309617 00:28:53.721 17:04:39 -- common/autotest_common.sh@955 -- # kill 1309617 00:28:53.721 17:04:39 -- common/autotest_common.sh@960 -- # wait 1309617 00:28:53.721 17:04:39 -- host/failover.sh@110 -- # sync 00:28:53.721 17:04:39 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:53.979 17:04:39 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:53.979 17:04:39 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:53.979 17:04:39 -- host/failover.sh@116 -- # nvmftestfini 00:28:53.979 17:04:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:53.979 17:04:39 -- nvmf/common.sh@116 -- # sync 00:28:53.979 17:04:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:53.979 17:04:39 -- nvmf/common.sh@119 -- # set +e 00:28:53.979 17:04:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:53.979 17:04:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:53.979 rmmod nvme_tcp 00:28:54.239 rmmod nvme_fabrics 00:28:54.239 rmmod nvme_keyring 00:28:54.239 17:04:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:54.239 17:04:39 -- nvmf/common.sh@123 -- # set -e 00:28:54.239 17:04:39 -- nvmf/common.sh@124 -- # return 0 00:28:54.239 17:04:39 -- nvmf/common.sh@477 -- # '[' -n 1307140 ']' 00:28:54.239 17:04:39 -- nvmf/common.sh@478 -- # killprocess 1307140 00:28:54.239 17:04:39 -- common/autotest_common.sh@936 -- # '[' -z 1307140 ']' 00:28:54.239 17:04:39 -- common/autotest_common.sh@940 -- # kill -0 1307140 00:28:54.239 17:04:39 -- common/autotest_common.sh@941 -- # uname 00:28:54.239 17:04:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:54.239 17:04:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1307140 00:28:54.239 17:04:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:54.239 17:04:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:54.239 17:04:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1307140' 00:28:54.239 killing process with pid 1307140 00:28:54.239 17:04:39 -- common/autotest_common.sh@955 -- # kill 1307140 00:28:54.239 17:04:39 -- common/autotest_common.sh@960 -- # wait 1307140 00:28:54.500 17:04:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:54.500 17:04:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:54.500 17:04:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:54.500 17:04:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:54.500 17:04:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:54.500 17:04:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:54.500 17:04:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:54.500 17:04:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:56.407 17:04:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:56.407 00:28:56.407 real 0m37.396s 00:28:56.407 user 2m12.387s 00:28:56.407 sys 0m6.056s 00:28:56.407 17:04:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:56.407 17:04:42 -- common/autotest_common.sh@10 -- # set +x 00:28:56.407 ************************************ 00:28:56.407 END TEST nvmf_failover 00:28:56.407 ************************************ 00:28:56.407 17:04:42 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:56.407 17:04:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:56.407 17:04:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:56.407 17:04:42 -- common/autotest_common.sh@10 -- # set +x 00:28:56.407 ************************************ 00:28:56.407 START TEST nvmf_discovery 00:28:56.407 ************************************ 00:28:56.407 17:04:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:56.666 * Looking for test storage... 00:28:56.666 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:56.666 17:04:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:56.666 17:04:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:56.666 17:04:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:56.666 17:04:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:56.666 17:04:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:56.666 17:04:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:56.666 17:04:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:56.666 17:04:42 -- scripts/common.sh@335 -- # IFS=.-: 00:28:56.666 17:04:42 -- scripts/common.sh@335 -- # read -ra ver1 00:28:56.666 17:04:42 -- scripts/common.sh@336 -- # IFS=.-: 00:28:56.666 17:04:42 -- scripts/common.sh@336 -- # read -ra ver2 00:28:56.666 17:04:42 -- scripts/common.sh@337 -- # local 'op=<' 00:28:56.666 17:04:42 -- scripts/common.sh@339 -- # ver1_l=2 00:28:56.666 17:04:42 -- scripts/common.sh@340 -- # ver2_l=1 00:28:56.666 17:04:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:56.666 17:04:42 -- scripts/common.sh@343 -- # case "$op" in 00:28:56.666 17:04:42 -- scripts/common.sh@344 -- # : 1 00:28:56.666 17:04:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:56.666 17:04:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:56.666 17:04:42 -- scripts/common.sh@364 -- # decimal 1 00:28:56.666 17:04:42 -- scripts/common.sh@352 -- # local d=1 00:28:56.666 17:04:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:56.666 17:04:42 -- scripts/common.sh@354 -- # echo 1 00:28:56.666 17:04:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:56.666 17:04:42 -- scripts/common.sh@365 -- # decimal 2 00:28:56.666 17:04:42 -- scripts/common.sh@352 -- # local d=2 00:28:56.666 17:04:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:56.666 17:04:42 -- scripts/common.sh@354 -- # echo 2 00:28:56.666 17:04:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:56.666 17:04:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:56.666 17:04:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:56.666 17:04:42 -- scripts/common.sh@367 -- # return 0 00:28:56.666 17:04:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:56.666 17:04:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:56.666 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:56.666 --rc genhtml_branch_coverage=1 00:28:56.666 --rc genhtml_function_coverage=1 00:28:56.666 --rc genhtml_legend=1 00:28:56.666 --rc geninfo_all_blocks=1 00:28:56.666 --rc geninfo_unexecuted_blocks=1 00:28:56.666 00:28:56.666 ' 00:28:56.667 17:04:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:56.667 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:56.667 --rc genhtml_branch_coverage=1 00:28:56.667 --rc genhtml_function_coverage=1 00:28:56.667 --rc genhtml_legend=1 00:28:56.667 --rc geninfo_all_blocks=1 00:28:56.667 --rc geninfo_unexecuted_blocks=1 00:28:56.667 00:28:56.667 ' 00:28:56.667 17:04:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:56.667 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:56.667 --rc genhtml_branch_coverage=1 00:28:56.667 --rc genhtml_function_coverage=1 00:28:56.667 --rc genhtml_legend=1 00:28:56.667 --rc geninfo_all_blocks=1 00:28:56.667 --rc geninfo_unexecuted_blocks=1 00:28:56.667 00:28:56.667 ' 00:28:56.667 17:04:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:56.667 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:56.667 --rc genhtml_branch_coverage=1 00:28:56.667 --rc genhtml_function_coverage=1 00:28:56.667 --rc genhtml_legend=1 00:28:56.667 --rc geninfo_all_blocks=1 00:28:56.667 --rc geninfo_unexecuted_blocks=1 00:28:56.667 00:28:56.667 ' 00:28:56.667 17:04:42 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:56.667 17:04:42 -- nvmf/common.sh@7 -- # uname -s 00:28:56.667 17:04:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:56.667 17:04:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:56.667 17:04:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:56.667 17:04:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:56.667 17:04:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:56.667 17:04:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:56.667 17:04:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:56.667 17:04:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:56.667 17:04:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:56.667 17:04:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:56.667 17:04:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:56.667 17:04:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:56.667 17:04:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:56.667 17:04:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:56.667 17:04:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:56.667 17:04:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:56.667 17:04:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:56.667 17:04:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:56.667 17:04:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:56.667 17:04:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:56.667 17:04:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:56.667 17:04:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:56.667 17:04:42 -- paths/export.sh@5 -- # export PATH 00:28:56.667 17:04:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:56.667 17:04:42 -- nvmf/common.sh@46 -- # : 0 00:28:56.667 17:04:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:56.667 17:04:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:56.667 17:04:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:56.667 17:04:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:56.667 17:04:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:56.667 17:04:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:56.667 17:04:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:56.667 17:04:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:56.667 17:04:42 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:56.667 17:04:42 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:56.667 17:04:42 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:56.667 17:04:42 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:56.667 17:04:42 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:56.667 17:04:42 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:56.667 17:04:42 -- host/discovery.sh@25 -- # nvmftestinit 00:28:56.667 17:04:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:56.667 17:04:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:56.667 17:04:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:56.667 17:04:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:56.667 17:04:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:56.667 17:04:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:56.667 17:04:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:56.667 17:04:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:56.667 17:04:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:56.667 17:04:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:56.667 17:04:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:56.667 17:04:42 -- common/autotest_common.sh@10 -- # set +x 00:28:58.571 17:04:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:58.571 17:04:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:58.571 17:04:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:58.571 17:04:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:58.571 17:04:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:58.571 17:04:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:58.571 17:04:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:58.571 17:04:44 -- nvmf/common.sh@294 -- # net_devs=() 00:28:58.571 17:04:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:58.571 17:04:44 -- nvmf/common.sh@295 -- # e810=() 00:28:58.571 17:04:44 -- nvmf/common.sh@295 -- # local -ga e810 00:28:58.571 17:04:44 -- nvmf/common.sh@296 -- # x722=() 00:28:58.571 17:04:44 -- nvmf/common.sh@296 -- # local -ga x722 00:28:58.571 17:04:44 -- nvmf/common.sh@297 -- # mlx=() 00:28:58.571 17:04:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:58.571 17:04:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:58.571 17:04:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:58.571 17:04:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:58.571 17:04:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:58.571 17:04:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:58.571 17:04:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:58.571 17:04:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:58.571 17:04:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:58.571 17:04:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:58.571 17:04:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:58.571 17:04:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:58.571 17:04:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:58.571 17:04:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:58.571 17:04:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:58.571 17:04:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:58.571 17:04:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:58.571 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:58.571 17:04:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:58.571 17:04:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:58.571 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:58.571 17:04:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:58.571 17:04:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:58.571 17:04:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:58.571 17:04:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:58.571 17:04:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:58.571 17:04:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:58.571 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:58.571 17:04:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:58.571 17:04:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:58.571 17:04:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:58.571 17:04:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:58.571 17:04:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:58.571 17:04:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:58.571 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:58.571 17:04:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:58.571 17:04:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:58.571 17:04:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:58.571 17:04:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:58.571 17:04:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:58.571 17:04:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:58.571 17:04:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:58.571 17:04:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:58.571 17:04:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:58.571 17:04:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:58.571 17:04:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:58.571 17:04:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:58.571 17:04:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:58.571 17:04:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:58.571 17:04:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:58.571 17:04:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:58.571 17:04:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:58.571 17:04:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:58.832 17:04:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:58.832 17:04:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:58.832 17:04:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:58.832 17:04:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:58.832 17:04:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:58.832 17:04:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:58.832 17:04:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:58.832 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:58.832 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.289 ms 00:28:58.832 00:28:58.832 --- 10.0.0.2 ping statistics --- 00:28:58.832 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:58.832 rtt min/avg/max/mdev = 0.289/0.289/0.289/0.000 ms 00:28:58.832 17:04:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:58.832 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:58.832 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.153 ms 00:28:58.832 00:28:58.832 --- 10.0.0.1 ping statistics --- 00:28:58.832 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:58.832 rtt min/avg/max/mdev = 0.153/0.153/0.153/0.000 ms 00:28:58.832 17:04:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:58.832 17:04:44 -- nvmf/common.sh@410 -- # return 0 00:28:58.832 17:04:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:58.832 17:04:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:58.832 17:04:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:58.832 17:04:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:58.832 17:04:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:58.832 17:04:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:58.832 17:04:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:58.832 17:04:44 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:28:58.832 17:04:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:58.832 17:04:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:58.832 17:04:44 -- common/autotest_common.sh@10 -- # set +x 00:28:58.832 17:04:44 -- nvmf/common.sh@469 -- # nvmfpid=1313081 00:28:58.832 17:04:44 -- nvmf/common.sh@470 -- # waitforlisten 1313081 00:28:58.832 17:04:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:58.832 17:04:44 -- common/autotest_common.sh@829 -- # '[' -z 1313081 ']' 00:28:58.832 17:04:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:58.832 17:04:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:58.832 17:04:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:58.832 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:58.832 17:04:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:58.832 17:04:44 -- common/autotest_common.sh@10 -- # set +x 00:28:58.832 [2024-11-16 17:04:44.492377] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:58.832 [2024-11-16 17:04:44.492459] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:58.832 EAL: No free 2048 kB hugepages reported on node 1 00:28:58.832 [2024-11-16 17:04:44.560768] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:59.090 [2024-11-16 17:04:44.656071] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:59.090 [2024-11-16 17:04:44.656231] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:59.090 [2024-11-16 17:04:44.656249] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:59.090 [2024-11-16 17:04:44.656262] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:59.090 [2024-11-16 17:04:44.656290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:00.024 17:04:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:00.024 17:04:45 -- common/autotest_common.sh@862 -- # return 0 00:29:00.024 17:04:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:00.024 17:04:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:00.024 17:04:45 -- common/autotest_common.sh@10 -- # set +x 00:29:00.024 17:04:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:00.024 17:04:45 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:00.024 17:04:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.024 17:04:45 -- common/autotest_common.sh@10 -- # set +x 00:29:00.024 [2024-11-16 17:04:45.509239] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:00.024 17:04:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.024 17:04:45 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:29:00.024 17:04:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.024 17:04:45 -- common/autotest_common.sh@10 -- # set +x 00:29:00.024 [2024-11-16 17:04:45.517410] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:00.024 17:04:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.024 17:04:45 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:29:00.024 17:04:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.024 17:04:45 -- common/autotest_common.sh@10 -- # set +x 00:29:00.024 null0 00:29:00.024 17:04:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.024 17:04:45 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:29:00.024 17:04:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.024 17:04:45 -- common/autotest_common.sh@10 -- # set +x 00:29:00.024 null1 00:29:00.024 17:04:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.024 17:04:45 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:29:00.024 17:04:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.024 17:04:45 -- common/autotest_common.sh@10 -- # set +x 00:29:00.024 17:04:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.024 17:04:45 -- host/discovery.sh@45 -- # hostpid=1313237 00:29:00.024 17:04:45 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:29:00.024 17:04:45 -- host/discovery.sh@46 -- # waitforlisten 1313237 /tmp/host.sock 00:29:00.024 17:04:45 -- common/autotest_common.sh@829 -- # '[' -z 1313237 ']' 00:29:00.024 17:04:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:00.024 17:04:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:00.024 17:04:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:00.024 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:00.024 17:04:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:00.024 17:04:45 -- common/autotest_common.sh@10 -- # set +x 00:29:00.024 [2024-11-16 17:04:45.586941] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:00.024 [2024-11-16 17:04:45.587004] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1313237 ] 00:29:00.024 EAL: No free 2048 kB hugepages reported on node 1 00:29:00.024 [2024-11-16 17:04:45.647746] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:00.024 [2024-11-16 17:04:45.736406] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:00.024 [2024-11-16 17:04:45.736586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:00.959 17:04:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:00.959 17:04:46 -- common/autotest_common.sh@862 -- # return 0 00:29:00.959 17:04:46 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:00.959 17:04:46 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:29:00.959 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.959 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:00.959 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.959 17:04:46 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:29:00.959 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.959 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:00.959 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.959 17:04:46 -- host/discovery.sh@72 -- # notify_id=0 00:29:00.959 17:04:46 -- host/discovery.sh@78 -- # get_subsystem_names 00:29:00.959 17:04:46 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:00.959 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.959 17:04:46 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:00.959 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:00.959 17:04:46 -- host/discovery.sh@59 -- # sort 00:29:00.959 17:04:46 -- host/discovery.sh@59 -- # xargs 00:29:00.959 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.959 17:04:46 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:29:00.959 17:04:46 -- host/discovery.sh@79 -- # get_bdev_list 00:29:00.959 17:04:46 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:00.959 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.959 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:00.959 17:04:46 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:00.959 17:04:46 -- host/discovery.sh@55 -- # sort 00:29:00.959 17:04:46 -- host/discovery.sh@55 -- # xargs 00:29:00.959 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.959 17:04:46 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:29:00.959 17:04:46 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:29:00.959 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.959 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:00.959 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.959 17:04:46 -- host/discovery.sh@82 -- # get_subsystem_names 00:29:00.959 17:04:46 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:00.959 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.959 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:00.959 17:04:46 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:00.959 17:04:46 -- host/discovery.sh@59 -- # sort 00:29:00.959 17:04:46 -- host/discovery.sh@59 -- # xargs 00:29:00.959 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.218 17:04:46 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:29:01.218 17:04:46 -- host/discovery.sh@83 -- # get_bdev_list 00:29:01.218 17:04:46 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:01.218 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.218 17:04:46 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:01.218 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:01.218 17:04:46 -- host/discovery.sh@55 -- # sort 00:29:01.218 17:04:46 -- host/discovery.sh@55 -- # xargs 00:29:01.218 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.218 17:04:46 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:29:01.218 17:04:46 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:29:01.218 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.218 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:01.218 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.218 17:04:46 -- host/discovery.sh@86 -- # get_subsystem_names 00:29:01.218 17:04:46 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:01.218 17:04:46 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:01.218 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.218 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:01.218 17:04:46 -- host/discovery.sh@59 -- # sort 00:29:01.218 17:04:46 -- host/discovery.sh@59 -- # xargs 00:29:01.218 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.218 17:04:46 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:29:01.218 17:04:46 -- host/discovery.sh@87 -- # get_bdev_list 00:29:01.218 17:04:46 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:01.218 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.218 17:04:46 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:01.218 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:01.218 17:04:46 -- host/discovery.sh@55 -- # sort 00:29:01.218 17:04:46 -- host/discovery.sh@55 -- # xargs 00:29:01.218 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.218 17:04:46 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:29:01.218 17:04:46 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:01.218 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.218 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:01.218 [2024-11-16 17:04:46.857196] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:01.218 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.218 17:04:46 -- host/discovery.sh@92 -- # get_subsystem_names 00:29:01.218 17:04:46 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:01.218 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.218 17:04:46 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:01.218 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:01.218 17:04:46 -- host/discovery.sh@59 -- # sort 00:29:01.218 17:04:46 -- host/discovery.sh@59 -- # xargs 00:29:01.218 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.218 17:04:46 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:29:01.218 17:04:46 -- host/discovery.sh@93 -- # get_bdev_list 00:29:01.218 17:04:46 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:01.218 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.218 17:04:46 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:01.218 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:01.218 17:04:46 -- host/discovery.sh@55 -- # sort 00:29:01.218 17:04:46 -- host/discovery.sh@55 -- # xargs 00:29:01.218 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.218 17:04:46 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:29:01.218 17:04:46 -- host/discovery.sh@94 -- # get_notification_count 00:29:01.218 17:04:46 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:01.218 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.218 17:04:46 -- host/discovery.sh@74 -- # jq '. | length' 00:29:01.218 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:01.218 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.476 17:04:46 -- host/discovery.sh@74 -- # notification_count=0 00:29:01.476 17:04:46 -- host/discovery.sh@75 -- # notify_id=0 00:29:01.476 17:04:46 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:29:01.476 17:04:46 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:29:01.476 17:04:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.476 17:04:46 -- common/autotest_common.sh@10 -- # set +x 00:29:01.476 17:04:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.476 17:04:46 -- host/discovery.sh@100 -- # sleep 1 00:29:02.045 [2024-11-16 17:04:47.607948] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:02.045 [2024-11-16 17:04:47.607997] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:02.045 [2024-11-16 17:04:47.608026] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:02.045 [2024-11-16 17:04:47.694286] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:02.045 [2024-11-16 17:04:47.751102] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:02.045 [2024-11-16 17:04:47.751130] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:02.304 17:04:47 -- host/discovery.sh@101 -- # get_subsystem_names 00:29:02.304 17:04:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:02.304 17:04:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:02.304 17:04:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.304 17:04:47 -- common/autotest_common.sh@10 -- # set +x 00:29:02.304 17:04:47 -- host/discovery.sh@59 -- # sort 00:29:02.304 17:04:47 -- host/discovery.sh@59 -- # xargs 00:29:02.304 17:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.304 17:04:48 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:02.304 17:04:48 -- host/discovery.sh@102 -- # get_bdev_list 00:29:02.304 17:04:48 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.304 17:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.304 17:04:48 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:02.304 17:04:48 -- common/autotest_common.sh@10 -- # set +x 00:29:02.304 17:04:48 -- host/discovery.sh@55 -- # sort 00:29:02.304 17:04:48 -- host/discovery.sh@55 -- # xargs 00:29:02.304 17:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.562 17:04:48 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:29:02.562 17:04:48 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:29:02.562 17:04:48 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:02.562 17:04:48 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:02.562 17:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.562 17:04:48 -- common/autotest_common.sh@10 -- # set +x 00:29:02.562 17:04:48 -- host/discovery.sh@63 -- # sort -n 00:29:02.562 17:04:48 -- host/discovery.sh@63 -- # xargs 00:29:02.562 17:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.562 17:04:48 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:29:02.562 17:04:48 -- host/discovery.sh@104 -- # get_notification_count 00:29:02.562 17:04:48 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:02.562 17:04:48 -- host/discovery.sh@74 -- # jq '. | length' 00:29:02.562 17:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.562 17:04:48 -- common/autotest_common.sh@10 -- # set +x 00:29:02.562 17:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.562 17:04:48 -- host/discovery.sh@74 -- # notification_count=1 00:29:02.562 17:04:48 -- host/discovery.sh@75 -- # notify_id=1 00:29:02.562 17:04:48 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:29:02.562 17:04:48 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:29:02.562 17:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.562 17:04:48 -- common/autotest_common.sh@10 -- # set +x 00:29:02.562 17:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.562 17:04:48 -- host/discovery.sh@109 -- # sleep 1 00:29:03.497 17:04:49 -- host/discovery.sh@110 -- # get_bdev_list 00:29:03.497 17:04:49 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:03.497 17:04:49 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:03.497 17:04:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.497 17:04:49 -- host/discovery.sh@55 -- # sort 00:29:03.497 17:04:49 -- common/autotest_common.sh@10 -- # set +x 00:29:03.497 17:04:49 -- host/discovery.sh@55 -- # xargs 00:29:03.497 17:04:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.497 17:04:49 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:03.497 17:04:49 -- host/discovery.sh@111 -- # get_notification_count 00:29:03.497 17:04:49 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:29:03.497 17:04:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.498 17:04:49 -- host/discovery.sh@74 -- # jq '. | length' 00:29:03.498 17:04:49 -- common/autotest_common.sh@10 -- # set +x 00:29:03.498 17:04:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.755 17:04:49 -- host/discovery.sh@74 -- # notification_count=1 00:29:03.755 17:04:49 -- host/discovery.sh@75 -- # notify_id=2 00:29:03.755 17:04:49 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:29:03.755 17:04:49 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:29:03.755 17:04:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.755 17:04:49 -- common/autotest_common.sh@10 -- # set +x 00:29:03.755 [2024-11-16 17:04:49.256409] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:03.755 [2024-11-16 17:04:49.256649] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:03.755 [2024-11-16 17:04:49.256690] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:03.755 17:04:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.755 17:04:49 -- host/discovery.sh@117 -- # sleep 1 00:29:03.755 [2024-11-16 17:04:49.384105] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:29:03.755 [2024-11-16 17:04:49.444567] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:03.755 [2024-11-16 17:04:49.444593] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:03.755 [2024-11-16 17:04:49.444604] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:04.692 17:04:50 -- host/discovery.sh@118 -- # get_subsystem_names 00:29:04.692 17:04:50 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:04.692 17:04:50 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:04.692 17:04:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.692 17:04:50 -- common/autotest_common.sh@10 -- # set +x 00:29:04.692 17:04:50 -- host/discovery.sh@59 -- # sort 00:29:04.692 17:04:50 -- host/discovery.sh@59 -- # xargs 00:29:04.692 17:04:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.692 17:04:50 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:04.692 17:04:50 -- host/discovery.sh@119 -- # get_bdev_list 00:29:04.692 17:04:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:04.692 17:04:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.692 17:04:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:04.692 17:04:50 -- common/autotest_common.sh@10 -- # set +x 00:29:04.692 17:04:50 -- host/discovery.sh@55 -- # sort 00:29:04.692 17:04:50 -- host/discovery.sh@55 -- # xargs 00:29:04.692 17:04:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.692 17:04:50 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:04.692 17:04:50 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:29:04.692 17:04:50 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:04.692 17:04:50 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:04.692 17:04:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.692 17:04:50 -- common/autotest_common.sh@10 -- # set +x 00:29:04.692 17:04:50 -- host/discovery.sh@63 -- # sort -n 00:29:04.692 17:04:50 -- host/discovery.sh@63 -- # xargs 00:29:04.692 17:04:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.692 17:04:50 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:29:04.692 17:04:50 -- host/discovery.sh@121 -- # get_notification_count 00:29:04.692 17:04:50 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:04.692 17:04:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.692 17:04:50 -- host/discovery.sh@74 -- # jq '. | length' 00:29:04.692 17:04:50 -- common/autotest_common.sh@10 -- # set +x 00:29:04.692 17:04:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.692 17:04:50 -- host/discovery.sh@74 -- # notification_count=0 00:29:04.692 17:04:50 -- host/discovery.sh@75 -- # notify_id=2 00:29:04.692 17:04:50 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:29:04.692 17:04:50 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:04.692 17:04:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.692 17:04:50 -- common/autotest_common.sh@10 -- # set +x 00:29:04.692 [2024-11-16 17:04:50.424248] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:04.692 [2024-11-16 17:04:50.424301] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:04.692 17:04:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.692 17:04:50 -- host/discovery.sh@127 -- # sleep 1 00:29:04.692 [2024-11-16 17:04:50.428636] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:04.692 [2024-11-16 17:04:50.428687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:04.692 [2024-11-16 17:04:50.428705] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:04.692 [2024-11-16 17:04:50.428721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:04.692 [2024-11-16 17:04:50.428735] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:04.692 [2024-11-16 17:04:50.428748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:04.692 [2024-11-16 17:04:50.428763] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:04.692 [2024-11-16 17:04:50.428777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:04.692 [2024-11-16 17:04:50.428790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cfb80 is same with the state(5) to be set 00:29:04.693 [2024-11-16 17:04:50.438634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17cfb80 (9): Bad file descriptor 00:29:04.951 [2024-11-16 17:04:50.448688] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:04.951 [2024-11-16 17:04:50.448876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.951 [2024-11-16 17:04:50.449088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.951 [2024-11-16 17:04:50.449116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17cfb80 with addr=10.0.0.2, port=4420 00:29:04.951 [2024-11-16 17:04:50.449133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cfb80 is same with the state(5) to be set 00:29:04.952 [2024-11-16 17:04:50.449176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17cfb80 (9): Bad file descriptor 00:29:04.952 [2024-11-16 17:04:50.449211] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:04.952 [2024-11-16 17:04:50.449228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:04.952 [2024-11-16 17:04:50.449247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:04.952 [2024-11-16 17:04:50.449271] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:04.952 [2024-11-16 17:04:50.458767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:04.952 [2024-11-16 17:04:50.458994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.952 [2024-11-16 17:04:50.459150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.952 [2024-11-16 17:04:50.459179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17cfb80 with addr=10.0.0.2, port=4420 00:29:04.952 [2024-11-16 17:04:50.459198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cfb80 is same with the state(5) to be set 00:29:04.952 [2024-11-16 17:04:50.459224] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17cfb80 (9): Bad file descriptor 00:29:04.952 [2024-11-16 17:04:50.459248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:04.952 [2024-11-16 17:04:50.459264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:04.952 [2024-11-16 17:04:50.459279] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:04.952 [2024-11-16 17:04:50.459302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:04.952 [2024-11-16 17:04:50.468835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:04.952 [2024-11-16 17:04:50.469015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.952 [2024-11-16 17:04:50.469149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.952 [2024-11-16 17:04:50.469179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17cfb80 with addr=10.0.0.2, port=4420 00:29:04.952 [2024-11-16 17:04:50.469198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cfb80 is same with the state(5) to be set 00:29:04.952 [2024-11-16 17:04:50.469224] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17cfb80 (9): Bad file descriptor 00:29:04.952 [2024-11-16 17:04:50.469248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:04.952 [2024-11-16 17:04:50.469264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:04.952 [2024-11-16 17:04:50.469280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:04.952 [2024-11-16 17:04:50.469302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:04.952 [2024-11-16 17:04:50.478907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:04.952 [2024-11-16 17:04:50.479089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.952 [2024-11-16 17:04:50.479224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.952 [2024-11-16 17:04:50.479253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17cfb80 with addr=10.0.0.2, port=4420 00:29:04.952 [2024-11-16 17:04:50.479272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cfb80 is same with the state(5) to be set 00:29:04.952 [2024-11-16 17:04:50.479297] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17cfb80 (9): Bad file descriptor 00:29:04.952 [2024-11-16 17:04:50.479320] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:04.952 [2024-11-16 17:04:50.479342] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:04.952 [2024-11-16 17:04:50.479359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:04.952 [2024-11-16 17:04:50.479381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:04.952 [2024-11-16 17:04:50.488992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:04.952 [2024-11-16 17:04:50.489174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.952 [2024-11-16 17:04:50.489309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.952 [2024-11-16 17:04:50.489337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17cfb80 with addr=10.0.0.2, port=4420 00:29:04.952 [2024-11-16 17:04:50.489355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cfb80 is same with the state(5) to be set 00:29:04.952 [2024-11-16 17:04:50.489381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17cfb80 (9): Bad file descriptor 00:29:04.952 [2024-11-16 17:04:50.489404] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:04.952 [2024-11-16 17:04:50.489421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:04.952 [2024-11-16 17:04:50.489436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:04.952 [2024-11-16 17:04:50.489458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:04.952 [2024-11-16 17:04:50.499068] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:04.952 [2024-11-16 17:04:50.499313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.952 [2024-11-16 17:04:50.499472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.952 [2024-11-16 17:04:50.499501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17cfb80 with addr=10.0.0.2, port=4420 00:29:04.952 [2024-11-16 17:04:50.499520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cfb80 is same with the state(5) to be set 00:29:04.952 [2024-11-16 17:04:50.499545] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17cfb80 (9): Bad file descriptor 00:29:04.952 [2024-11-16 17:04:50.499583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:04.952 [2024-11-16 17:04:50.499604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:04.952 [2024-11-16 17:04:50.499627] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:04.952 [2024-11-16 17:04:50.499676] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:04.952 [2024-11-16 17:04:50.509145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:04.952 [2024-11-16 17:04:50.509368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.952 [2024-11-16 17:04:50.509503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.952 [2024-11-16 17:04:50.509533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17cfb80 with addr=10.0.0.2, port=4420 00:29:04.952 [2024-11-16 17:04:50.509551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cfb80 is same with the state(5) to be set 00:29:04.952 [2024-11-16 17:04:50.509576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17cfb80 (9): Bad file descriptor 00:29:04.952 [2024-11-16 17:04:50.509599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:04.952 [2024-11-16 17:04:50.509630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:04.952 [2024-11-16 17:04:50.509656] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:04.952 [2024-11-16 17:04:50.509708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:04.952 [2024-11-16 17:04:50.510661] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:29:04.952 [2024-11-16 17:04:50.510689] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:05.889 17:04:51 -- host/discovery.sh@128 -- # get_subsystem_names 00:29:05.889 17:04:51 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:05.889 17:04:51 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:05.889 17:04:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.889 17:04:51 -- host/discovery.sh@59 -- # sort 00:29:05.889 17:04:51 -- common/autotest_common.sh@10 -- # set +x 00:29:05.889 17:04:51 -- host/discovery.sh@59 -- # xargs 00:29:05.889 17:04:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.889 17:04:51 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:05.889 17:04:51 -- host/discovery.sh@129 -- # get_bdev_list 00:29:05.889 17:04:51 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:05.889 17:04:51 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:05.889 17:04:51 -- host/discovery.sh@55 -- # sort 00:29:05.889 17:04:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.889 17:04:51 -- common/autotest_common.sh@10 -- # set +x 00:29:05.889 17:04:51 -- host/discovery.sh@55 -- # xargs 00:29:05.889 17:04:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.889 17:04:51 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:05.889 17:04:51 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:29:05.889 17:04:51 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:05.889 17:04:51 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:05.889 17:04:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.889 17:04:51 -- common/autotest_common.sh@10 -- # set +x 00:29:05.889 17:04:51 -- host/discovery.sh@63 -- # sort -n 00:29:05.889 17:04:51 -- host/discovery.sh@63 -- # xargs 00:29:05.889 17:04:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.889 17:04:51 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:29:05.889 17:04:51 -- host/discovery.sh@131 -- # get_notification_count 00:29:05.889 17:04:51 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:05.889 17:04:51 -- host/discovery.sh@74 -- # jq '. | length' 00:29:05.889 17:04:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.889 17:04:51 -- common/autotest_common.sh@10 -- # set +x 00:29:05.889 17:04:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.889 17:04:51 -- host/discovery.sh@74 -- # notification_count=0 00:29:05.889 17:04:51 -- host/discovery.sh@75 -- # notify_id=2 00:29:05.889 17:04:51 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:29:05.889 17:04:51 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:29:05.889 17:04:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.890 17:04:51 -- common/autotest_common.sh@10 -- # set +x 00:29:05.890 17:04:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.890 17:04:51 -- host/discovery.sh@135 -- # sleep 1 00:29:07.265 17:04:52 -- host/discovery.sh@136 -- # get_subsystem_names 00:29:07.265 17:04:52 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:07.265 17:04:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.265 17:04:52 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:07.265 17:04:52 -- common/autotest_common.sh@10 -- # set +x 00:29:07.265 17:04:52 -- host/discovery.sh@59 -- # sort 00:29:07.265 17:04:52 -- host/discovery.sh@59 -- # xargs 00:29:07.265 17:04:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.265 17:04:52 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:29:07.265 17:04:52 -- host/discovery.sh@137 -- # get_bdev_list 00:29:07.265 17:04:52 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:07.265 17:04:52 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:07.265 17:04:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.265 17:04:52 -- common/autotest_common.sh@10 -- # set +x 00:29:07.265 17:04:52 -- host/discovery.sh@55 -- # sort 00:29:07.265 17:04:52 -- host/discovery.sh@55 -- # xargs 00:29:07.265 17:04:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.265 17:04:52 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:29:07.265 17:04:52 -- host/discovery.sh@138 -- # get_notification_count 00:29:07.265 17:04:52 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:07.265 17:04:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.265 17:04:52 -- host/discovery.sh@74 -- # jq '. | length' 00:29:07.265 17:04:52 -- common/autotest_common.sh@10 -- # set +x 00:29:07.265 17:04:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.265 17:04:52 -- host/discovery.sh@74 -- # notification_count=2 00:29:07.265 17:04:52 -- host/discovery.sh@75 -- # notify_id=4 00:29:07.265 17:04:52 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:29:07.265 17:04:52 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:07.265 17:04:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.265 17:04:52 -- common/autotest_common.sh@10 -- # set +x 00:29:08.205 [2024-11-16 17:04:53.795760] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:08.205 [2024-11-16 17:04:53.795785] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:08.205 [2024-11-16 17:04:53.795808] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:08.205 [2024-11-16 17:04:53.882138] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:29:08.464 [2024-11-16 17:04:53.990294] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:08.464 [2024-11-16 17:04:53.990334] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:08.464 17:04:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.464 17:04:53 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:08.464 17:04:53 -- common/autotest_common.sh@650 -- # local es=0 00:29:08.464 17:04:53 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:08.464 17:04:53 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:08.464 17:04:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:08.464 17:04:53 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:08.464 17:04:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:08.464 17:04:53 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:08.464 17:04:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.464 17:04:53 -- common/autotest_common.sh@10 -- # set +x 00:29:08.464 request: 00:29:08.464 { 00:29:08.464 "name": "nvme", 00:29:08.464 "trtype": "tcp", 00:29:08.464 "traddr": "10.0.0.2", 00:29:08.464 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:08.464 "adrfam": "ipv4", 00:29:08.464 "trsvcid": "8009", 00:29:08.464 "wait_for_attach": true, 00:29:08.464 "method": "bdev_nvme_start_discovery", 00:29:08.464 "req_id": 1 00:29:08.464 } 00:29:08.464 Got JSON-RPC error response 00:29:08.464 response: 00:29:08.464 { 00:29:08.464 "code": -17, 00:29:08.464 "message": "File exists" 00:29:08.464 } 00:29:08.464 17:04:54 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:08.464 17:04:54 -- common/autotest_common.sh@653 -- # es=1 00:29:08.464 17:04:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:08.464 17:04:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:08.464 17:04:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:08.464 17:04:54 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:29:08.464 17:04:54 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:08.464 17:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.464 17:04:54 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:08.464 17:04:54 -- common/autotest_common.sh@10 -- # set +x 00:29:08.464 17:04:54 -- host/discovery.sh@67 -- # sort 00:29:08.464 17:04:54 -- host/discovery.sh@67 -- # xargs 00:29:08.464 17:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.464 17:04:54 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:29:08.464 17:04:54 -- host/discovery.sh@147 -- # get_bdev_list 00:29:08.464 17:04:54 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:08.464 17:04:54 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:08.464 17:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.464 17:04:54 -- common/autotest_common.sh@10 -- # set +x 00:29:08.464 17:04:54 -- host/discovery.sh@55 -- # sort 00:29:08.464 17:04:54 -- host/discovery.sh@55 -- # xargs 00:29:08.464 17:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.464 17:04:54 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:08.464 17:04:54 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:08.464 17:04:54 -- common/autotest_common.sh@650 -- # local es=0 00:29:08.464 17:04:54 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:08.464 17:04:54 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:08.464 17:04:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:08.464 17:04:54 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:08.464 17:04:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:08.464 17:04:54 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:08.464 17:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.464 17:04:54 -- common/autotest_common.sh@10 -- # set +x 00:29:08.464 request: 00:29:08.464 { 00:29:08.464 "name": "nvme_second", 00:29:08.464 "trtype": "tcp", 00:29:08.464 "traddr": "10.0.0.2", 00:29:08.464 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:08.464 "adrfam": "ipv4", 00:29:08.464 "trsvcid": "8009", 00:29:08.464 "wait_for_attach": true, 00:29:08.464 "method": "bdev_nvme_start_discovery", 00:29:08.464 "req_id": 1 00:29:08.464 } 00:29:08.464 Got JSON-RPC error response 00:29:08.464 response: 00:29:08.464 { 00:29:08.464 "code": -17, 00:29:08.464 "message": "File exists" 00:29:08.464 } 00:29:08.464 17:04:54 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:08.464 17:04:54 -- common/autotest_common.sh@653 -- # es=1 00:29:08.464 17:04:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:08.464 17:04:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:08.464 17:04:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:08.464 17:04:54 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:29:08.464 17:04:54 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:08.464 17:04:54 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:08.464 17:04:54 -- host/discovery.sh@67 -- # sort 00:29:08.464 17:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.464 17:04:54 -- common/autotest_common.sh@10 -- # set +x 00:29:08.464 17:04:54 -- host/discovery.sh@67 -- # xargs 00:29:08.464 17:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.464 17:04:54 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:29:08.464 17:04:54 -- host/discovery.sh@153 -- # get_bdev_list 00:29:08.464 17:04:54 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:08.464 17:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.464 17:04:54 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:08.464 17:04:54 -- common/autotest_common.sh@10 -- # set +x 00:29:08.464 17:04:54 -- host/discovery.sh@55 -- # sort 00:29:08.464 17:04:54 -- host/discovery.sh@55 -- # xargs 00:29:08.464 17:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.464 17:04:54 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:08.464 17:04:54 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:08.464 17:04:54 -- common/autotest_common.sh@650 -- # local es=0 00:29:08.464 17:04:54 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:08.464 17:04:54 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:08.464 17:04:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:08.464 17:04:54 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:08.464 17:04:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:08.464 17:04:54 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:08.464 17:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.464 17:04:54 -- common/autotest_common.sh@10 -- # set +x 00:29:09.845 [2024-11-16 17:04:55.182611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-11-16 17:04:55.182778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.845 [2024-11-16 17:04:55.182805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18073c0 with addr=10.0.0.2, port=8010 00:29:09.845 [2024-11-16 17:04:55.182829] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:09.845 [2024-11-16 17:04:55.182845] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:09.845 [2024-11-16 17:04:55.182858] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:10.781 [2024-11-16 17:04:56.185100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.781 [2024-11-16 17:04:56.185230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.781 [2024-11-16 17:04:56.185256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18073c0 with addr=10.0.0.2, port=8010 00:29:10.781 [2024-11-16 17:04:56.185276] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:10.781 [2024-11-16 17:04:56.185290] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:10.781 [2024-11-16 17:04:56.185320] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:11.721 [2024-11-16 17:04:57.187352] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:29:11.721 request: 00:29:11.721 { 00:29:11.721 "name": "nvme_second", 00:29:11.721 "trtype": "tcp", 00:29:11.721 "traddr": "10.0.0.2", 00:29:11.721 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:11.721 "adrfam": "ipv4", 00:29:11.721 "trsvcid": "8010", 00:29:11.722 "attach_timeout_ms": 3000, 00:29:11.722 "method": "bdev_nvme_start_discovery", 00:29:11.722 "req_id": 1 00:29:11.722 } 00:29:11.722 Got JSON-RPC error response 00:29:11.722 response: 00:29:11.722 { 00:29:11.722 "code": -110, 00:29:11.722 "message": "Connection timed out" 00:29:11.722 } 00:29:11.722 17:04:57 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:11.722 17:04:57 -- common/autotest_common.sh@653 -- # es=1 00:29:11.722 17:04:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:11.722 17:04:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:11.722 17:04:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:11.722 17:04:57 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:29:11.722 17:04:57 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:11.722 17:04:57 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:11.722 17:04:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.722 17:04:57 -- host/discovery.sh@67 -- # sort 00:29:11.722 17:04:57 -- common/autotest_common.sh@10 -- # set +x 00:29:11.722 17:04:57 -- host/discovery.sh@67 -- # xargs 00:29:11.722 17:04:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.722 17:04:57 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:29:11.722 17:04:57 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:29:11.722 17:04:57 -- host/discovery.sh@162 -- # kill 1313237 00:29:11.722 17:04:57 -- host/discovery.sh@163 -- # nvmftestfini 00:29:11.722 17:04:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:11.722 17:04:57 -- nvmf/common.sh@116 -- # sync 00:29:11.722 17:04:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:11.722 17:04:57 -- nvmf/common.sh@119 -- # set +e 00:29:11.722 17:04:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:11.722 17:04:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:11.722 rmmod nvme_tcp 00:29:11.722 rmmod nvme_fabrics 00:29:11.722 rmmod nvme_keyring 00:29:11.722 17:04:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:11.722 17:04:57 -- nvmf/common.sh@123 -- # set -e 00:29:11.722 17:04:57 -- nvmf/common.sh@124 -- # return 0 00:29:11.722 17:04:57 -- nvmf/common.sh@477 -- # '[' -n 1313081 ']' 00:29:11.722 17:04:57 -- nvmf/common.sh@478 -- # killprocess 1313081 00:29:11.722 17:04:57 -- common/autotest_common.sh@936 -- # '[' -z 1313081 ']' 00:29:11.722 17:04:57 -- common/autotest_common.sh@940 -- # kill -0 1313081 00:29:11.722 17:04:57 -- common/autotest_common.sh@941 -- # uname 00:29:11.722 17:04:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:11.722 17:04:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1313081 00:29:11.722 17:04:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:11.722 17:04:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:11.722 17:04:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1313081' 00:29:11.722 killing process with pid 1313081 00:29:11.722 17:04:57 -- common/autotest_common.sh@955 -- # kill 1313081 00:29:11.722 17:04:57 -- common/autotest_common.sh@960 -- # wait 1313081 00:29:11.981 17:04:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:11.981 17:04:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:11.981 17:04:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:11.981 17:04:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:11.981 17:04:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:11.981 17:04:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:11.981 17:04:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:11.981 17:04:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:13.889 17:04:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:13.889 00:29:13.889 real 0m17.489s 00:29:13.889 user 0m27.088s 00:29:13.889 sys 0m2.925s 00:29:13.889 17:04:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:13.889 17:04:59 -- common/autotest_common.sh@10 -- # set +x 00:29:13.889 ************************************ 00:29:13.889 END TEST nvmf_discovery 00:29:13.889 ************************************ 00:29:14.148 17:04:59 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:14.148 17:04:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:14.148 17:04:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:14.148 17:04:59 -- common/autotest_common.sh@10 -- # set +x 00:29:14.148 ************************************ 00:29:14.148 START TEST nvmf_discovery_remove_ifc 00:29:14.148 ************************************ 00:29:14.148 17:04:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:14.148 * Looking for test storage... 00:29:14.148 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:14.148 17:04:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:14.148 17:04:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:14.148 17:04:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:14.148 17:04:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:14.148 17:04:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:14.148 17:04:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:14.148 17:04:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:14.148 17:04:59 -- scripts/common.sh@335 -- # IFS=.-: 00:29:14.148 17:04:59 -- scripts/common.sh@335 -- # read -ra ver1 00:29:14.148 17:04:59 -- scripts/common.sh@336 -- # IFS=.-: 00:29:14.148 17:04:59 -- scripts/common.sh@336 -- # read -ra ver2 00:29:14.148 17:04:59 -- scripts/common.sh@337 -- # local 'op=<' 00:29:14.148 17:04:59 -- scripts/common.sh@339 -- # ver1_l=2 00:29:14.148 17:04:59 -- scripts/common.sh@340 -- # ver2_l=1 00:29:14.148 17:04:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:14.148 17:04:59 -- scripts/common.sh@343 -- # case "$op" in 00:29:14.148 17:04:59 -- scripts/common.sh@344 -- # : 1 00:29:14.148 17:04:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:14.148 17:04:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:14.148 17:04:59 -- scripts/common.sh@364 -- # decimal 1 00:29:14.148 17:04:59 -- scripts/common.sh@352 -- # local d=1 00:29:14.148 17:04:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:14.148 17:04:59 -- scripts/common.sh@354 -- # echo 1 00:29:14.148 17:04:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:14.148 17:04:59 -- scripts/common.sh@365 -- # decimal 2 00:29:14.148 17:04:59 -- scripts/common.sh@352 -- # local d=2 00:29:14.148 17:04:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:14.148 17:04:59 -- scripts/common.sh@354 -- # echo 2 00:29:14.148 17:04:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:14.148 17:04:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:14.148 17:04:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:14.148 17:04:59 -- scripts/common.sh@367 -- # return 0 00:29:14.148 17:04:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:14.148 17:04:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:14.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:14.148 --rc genhtml_branch_coverage=1 00:29:14.148 --rc genhtml_function_coverage=1 00:29:14.148 --rc genhtml_legend=1 00:29:14.148 --rc geninfo_all_blocks=1 00:29:14.148 --rc geninfo_unexecuted_blocks=1 00:29:14.148 00:29:14.148 ' 00:29:14.148 17:04:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:14.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:14.148 --rc genhtml_branch_coverage=1 00:29:14.148 --rc genhtml_function_coverage=1 00:29:14.148 --rc genhtml_legend=1 00:29:14.148 --rc geninfo_all_blocks=1 00:29:14.148 --rc geninfo_unexecuted_blocks=1 00:29:14.148 00:29:14.148 ' 00:29:14.148 17:04:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:14.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:14.148 --rc genhtml_branch_coverage=1 00:29:14.148 --rc genhtml_function_coverage=1 00:29:14.148 --rc genhtml_legend=1 00:29:14.148 --rc geninfo_all_blocks=1 00:29:14.148 --rc geninfo_unexecuted_blocks=1 00:29:14.148 00:29:14.148 ' 00:29:14.148 17:04:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:14.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:14.148 --rc genhtml_branch_coverage=1 00:29:14.148 --rc genhtml_function_coverage=1 00:29:14.148 --rc genhtml_legend=1 00:29:14.148 --rc geninfo_all_blocks=1 00:29:14.148 --rc geninfo_unexecuted_blocks=1 00:29:14.148 00:29:14.148 ' 00:29:14.148 17:04:59 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:14.148 17:04:59 -- nvmf/common.sh@7 -- # uname -s 00:29:14.148 17:04:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:14.148 17:04:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:14.148 17:04:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:14.148 17:04:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:14.148 17:04:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:14.148 17:04:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:14.148 17:04:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:14.148 17:04:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:14.148 17:04:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:14.148 17:04:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:14.148 17:04:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:14.148 17:04:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:14.148 17:04:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:14.148 17:04:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:14.148 17:04:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:14.148 17:04:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:14.148 17:04:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:14.148 17:04:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:14.148 17:04:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:14.149 17:04:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:14.149 17:04:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:14.149 17:04:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:14.149 17:04:59 -- paths/export.sh@5 -- # export PATH 00:29:14.149 17:04:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:14.149 17:04:59 -- nvmf/common.sh@46 -- # : 0 00:29:14.149 17:04:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:14.149 17:04:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:14.149 17:04:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:14.149 17:04:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:14.149 17:04:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:14.149 17:04:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:14.149 17:04:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:14.149 17:04:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:14.149 17:04:59 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:29:14.149 17:04:59 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:29:14.149 17:04:59 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:29:14.149 17:04:59 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:29:14.149 17:04:59 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:29:14.149 17:04:59 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:29:14.149 17:04:59 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:29:14.149 17:04:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:14.149 17:04:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:14.149 17:04:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:14.149 17:04:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:14.149 17:04:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:14.149 17:04:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:14.149 17:04:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:14.149 17:04:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:14.149 17:04:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:14.149 17:04:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:14.149 17:04:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:14.149 17:04:59 -- common/autotest_common.sh@10 -- # set +x 00:29:16.056 17:05:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:16.056 17:05:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:16.056 17:05:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:16.056 17:05:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:16.056 17:05:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:16.056 17:05:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:16.056 17:05:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:16.056 17:05:01 -- nvmf/common.sh@294 -- # net_devs=() 00:29:16.056 17:05:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:16.056 17:05:01 -- nvmf/common.sh@295 -- # e810=() 00:29:16.056 17:05:01 -- nvmf/common.sh@295 -- # local -ga e810 00:29:16.056 17:05:01 -- nvmf/common.sh@296 -- # x722=() 00:29:16.056 17:05:01 -- nvmf/common.sh@296 -- # local -ga x722 00:29:16.056 17:05:01 -- nvmf/common.sh@297 -- # mlx=() 00:29:16.056 17:05:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:16.056 17:05:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:16.056 17:05:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:16.056 17:05:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:16.056 17:05:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:16.056 17:05:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:16.056 17:05:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:16.056 17:05:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:16.056 17:05:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:16.056 17:05:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:16.056 17:05:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:16.056 17:05:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:16.056 17:05:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:16.056 17:05:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:16.056 17:05:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:16.056 17:05:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:16.056 17:05:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:16.056 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:16.056 17:05:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:16.056 17:05:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:16.056 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:16.056 17:05:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:16.056 17:05:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:16.056 17:05:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:16.056 17:05:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:16.056 17:05:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:16.056 17:05:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:16.056 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:16.056 17:05:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:16.056 17:05:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:16.056 17:05:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:16.056 17:05:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:16.056 17:05:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:16.056 17:05:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:16.056 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:16.056 17:05:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:16.056 17:05:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:16.056 17:05:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:16.056 17:05:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:16.056 17:05:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:16.056 17:05:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:16.056 17:05:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:16.056 17:05:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:16.056 17:05:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:16.056 17:05:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:16.056 17:05:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:16.056 17:05:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:16.056 17:05:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:16.056 17:05:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:16.056 17:05:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:16.056 17:05:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:16.056 17:05:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:16.056 17:05:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:16.315 17:05:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:16.315 17:05:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:16.315 17:05:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:16.315 17:05:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:16.315 17:05:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:16.315 17:05:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:16.315 17:05:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:16.315 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:16.315 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:29:16.315 00:29:16.315 --- 10.0.0.2 ping statistics --- 00:29:16.315 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:16.315 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:29:16.315 17:05:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:16.315 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:16.315 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:29:16.315 00:29:16.315 --- 10.0.0.1 ping statistics --- 00:29:16.315 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:16.315 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:29:16.315 17:05:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:16.315 17:05:01 -- nvmf/common.sh@410 -- # return 0 00:29:16.315 17:05:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:16.315 17:05:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:16.315 17:05:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:16.315 17:05:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:16.315 17:05:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:16.315 17:05:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:16.315 17:05:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:16.315 17:05:01 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:29:16.315 17:05:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:16.315 17:05:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:16.315 17:05:01 -- common/autotest_common.sh@10 -- # set +x 00:29:16.315 17:05:01 -- nvmf/common.sh@469 -- # nvmfpid=1316719 00:29:16.315 17:05:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:16.315 17:05:01 -- nvmf/common.sh@470 -- # waitforlisten 1316719 00:29:16.315 17:05:01 -- common/autotest_common.sh@829 -- # '[' -z 1316719 ']' 00:29:16.315 17:05:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:16.315 17:05:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:16.315 17:05:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:16.315 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:16.315 17:05:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:16.315 17:05:01 -- common/autotest_common.sh@10 -- # set +x 00:29:16.315 [2024-11-16 17:05:01.970439] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:16.315 [2024-11-16 17:05:01.970523] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:16.315 EAL: No free 2048 kB hugepages reported on node 1 00:29:16.315 [2024-11-16 17:05:02.031428] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:16.575 [2024-11-16 17:05:02.116474] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:16.575 [2024-11-16 17:05:02.116639] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:16.575 [2024-11-16 17:05:02.116660] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:16.575 [2024-11-16 17:05:02.116673] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:16.575 [2024-11-16 17:05:02.116707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:17.512 17:05:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:17.512 17:05:02 -- common/autotest_common.sh@862 -- # return 0 00:29:17.512 17:05:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:17.512 17:05:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:17.512 17:05:02 -- common/autotest_common.sh@10 -- # set +x 00:29:17.512 17:05:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:17.512 17:05:03 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:29:17.512 17:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.512 17:05:03 -- common/autotest_common.sh@10 -- # set +x 00:29:17.512 [2024-11-16 17:05:03.035916] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:17.512 [2024-11-16 17:05:03.044084] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:17.512 null0 00:29:17.512 [2024-11-16 17:05:03.076082] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:17.512 17:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.512 17:05:03 -- host/discovery_remove_ifc.sh@59 -- # hostpid=1316872 00:29:17.512 17:05:03 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:29:17.512 17:05:03 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 1316872 /tmp/host.sock 00:29:17.512 17:05:03 -- common/autotest_common.sh@829 -- # '[' -z 1316872 ']' 00:29:17.512 17:05:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:17.512 17:05:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:17.512 17:05:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:17.512 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:17.512 17:05:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:17.512 17:05:03 -- common/autotest_common.sh@10 -- # set +x 00:29:17.512 [2024-11-16 17:05:03.137711] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:17.512 [2024-11-16 17:05:03.137776] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1316872 ] 00:29:17.512 EAL: No free 2048 kB hugepages reported on node 1 00:29:17.512 [2024-11-16 17:05:03.197318] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:17.772 [2024-11-16 17:05:03.290434] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:17.772 [2024-11-16 17:05:03.290591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:17.772 17:05:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:17.772 17:05:03 -- common/autotest_common.sh@862 -- # return 0 00:29:17.772 17:05:03 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:17.772 17:05:03 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:29:17.772 17:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.772 17:05:03 -- common/autotest_common.sh@10 -- # set +x 00:29:17.772 17:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.772 17:05:03 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:29:17.772 17:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.772 17:05:03 -- common/autotest_common.sh@10 -- # set +x 00:29:17.772 17:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.772 17:05:03 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:29:17.772 17:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.772 17:05:03 -- common/autotest_common.sh@10 -- # set +x 00:29:19.152 [2024-11-16 17:05:04.554760] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:19.152 [2024-11-16 17:05:04.554801] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:19.152 [2024-11-16 17:05:04.554824] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:19.152 [2024-11-16 17:05:04.642102] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:19.152 [2024-11-16 17:05:04.826323] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:19.152 [2024-11-16 17:05:04.826382] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:19.152 [2024-11-16 17:05:04.826426] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:19.152 [2024-11-16 17:05:04.826457] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:19.152 [2024-11-16 17:05:04.826510] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:19.152 17:05:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.152 17:05:04 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:29:19.152 17:05:04 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:19.152 17:05:04 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:19.152 17:05:04 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:19.152 17:05:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.152 17:05:04 -- common/autotest_common.sh@10 -- # set +x 00:29:19.152 17:05:04 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:19.152 17:05:04 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:19.152 [2024-11-16 17:05:04.832168] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x10814b0 was disconnected and freed. delete nvme_qpair. 00:29:19.152 17:05:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.152 17:05:04 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:29:19.152 17:05:04 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:29:19.152 17:05:04 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:29:19.412 17:05:04 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:29:19.412 17:05:04 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:19.412 17:05:04 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:19.412 17:05:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.412 17:05:04 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:19.412 17:05:04 -- common/autotest_common.sh@10 -- # set +x 00:29:19.412 17:05:04 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:19.412 17:05:04 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:19.412 17:05:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.412 17:05:04 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:19.412 17:05:04 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:20.381 17:05:05 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:20.381 17:05:05 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:20.381 17:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.381 17:05:05 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:20.381 17:05:05 -- common/autotest_common.sh@10 -- # set +x 00:29:20.381 17:05:05 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:20.381 17:05:05 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:20.381 17:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.381 17:05:06 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:20.381 17:05:06 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:21.406 17:05:07 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:21.406 17:05:07 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:21.406 17:05:07 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:21.406 17:05:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.406 17:05:07 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:21.406 17:05:07 -- common/autotest_common.sh@10 -- # set +x 00:29:21.406 17:05:07 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:21.406 17:05:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.406 17:05:07 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:21.406 17:05:07 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:22.341 17:05:08 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:22.341 17:05:08 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:22.341 17:05:08 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:22.341 17:05:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.341 17:05:08 -- common/autotest_common.sh@10 -- # set +x 00:29:22.341 17:05:08 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:22.341 17:05:08 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:22.341 17:05:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.601 17:05:08 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:22.601 17:05:08 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:23.548 17:05:09 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:23.548 17:05:09 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:23.548 17:05:09 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:23.548 17:05:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.548 17:05:09 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:23.548 17:05:09 -- common/autotest_common.sh@10 -- # set +x 00:29:23.548 17:05:09 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:23.548 17:05:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.548 17:05:09 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:23.548 17:05:09 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:24.489 17:05:10 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:24.489 17:05:10 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:24.489 17:05:10 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:24.489 17:05:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.489 17:05:10 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:24.489 17:05:10 -- common/autotest_common.sh@10 -- # set +x 00:29:24.489 17:05:10 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:24.489 17:05:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.489 17:05:10 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:24.489 17:05:10 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:24.750 [2024-11-16 17:05:10.267376] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:29:24.750 [2024-11-16 17:05:10.267447] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:24.750 [2024-11-16 17:05:10.267473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:24.750 [2024-11-16 17:05:10.267494] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:24.750 [2024-11-16 17:05:10.267510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:24.750 [2024-11-16 17:05:10.267526] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:24.750 [2024-11-16 17:05:10.267541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:24.750 [2024-11-16 17:05:10.267557] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:24.750 [2024-11-16 17:05:10.267573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:24.750 [2024-11-16 17:05:10.267591] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:24.750 [2024-11-16 17:05:10.267607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:24.750 [2024-11-16 17:05:10.267635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1048790 is same with the state(5) to be set 00:29:24.750 [2024-11-16 17:05:10.277393] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1048790 (9): Bad file descriptor 00:29:24.750 [2024-11-16 17:05:10.287447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:25.687 17:05:11 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:25.688 17:05:11 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:25.688 17:05:11 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:25.688 17:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.688 17:05:11 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:25.688 17:05:11 -- common/autotest_common.sh@10 -- # set +x 00:29:25.688 17:05:11 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:25.688 [2024-11-16 17:05:11.343653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:26.624 [2024-11-16 17:05:12.367652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:26.624 [2024-11-16 17:05:12.367700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1048790 with addr=10.0.0.2, port=4420 00:29:26.624 [2024-11-16 17:05:12.367735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1048790 is same with the state(5) to be set 00:29:26.624 [2024-11-16 17:05:12.367766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:26.624 [2024-11-16 17:05:12.367784] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:26.624 [2024-11-16 17:05:12.367799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:26.624 [2024-11-16 17:05:12.367817] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:26.624 [2024-11-16 17:05:12.368182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1048790 (9): Bad file descriptor 00:29:26.624 [2024-11-16 17:05:12.368220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:26.624 [2024-11-16 17:05:12.368266] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:26.624 [2024-11-16 17:05:12.368301] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:26.624 [2024-11-16 17:05:12.368324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.624 [2024-11-16 17:05:12.368341] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:26.624 [2024-11-16 17:05:12.368356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.624 [2024-11-16 17:05:12.368372] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:26.624 [2024-11-16 17:05:12.368387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.624 [2024-11-16 17:05:12.368401] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:26.624 [2024-11-16 17:05:12.368415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.624 [2024-11-16 17:05:12.368430] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:26.624 [2024-11-16 17:05:12.368445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.624 [2024-11-16 17:05:12.368459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:26.624 [2024-11-16 17:05:12.368768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1047c40 (9): Bad file descriptor 00:29:26.624 [2024-11-16 17:05:12.369789] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:26.624 [2024-11-16 17:05:12.369829] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:26.884 17:05:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.884 17:05:12 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:26.884 17:05:12 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:27.819 17:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:27.819 17:05:13 -- common/autotest_common.sh@10 -- # set +x 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:27.819 17:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:27.819 17:05:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:27.819 17:05:13 -- common/autotest_common.sh@10 -- # set +x 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:27.819 17:05:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:27.819 17:05:13 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:28.763 [2024-11-16 17:05:14.420755] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:28.763 [2024-11-16 17:05:14.420782] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:28.763 [2024-11-16 17:05:14.420809] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:28.763 17:05:14 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:28.763 17:05:14 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:28.763 17:05:14 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:28.763 17:05:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.763 17:05:14 -- common/autotest_common.sh@10 -- # set +x 00:29:28.763 17:05:14 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:28.763 17:05:14 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:28.763 [2024-11-16 17:05:14.509110] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:29.026 17:05:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.026 17:05:14 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:29.026 17:05:14 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:29.026 [2024-11-16 17:05:14.609996] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:29.026 [2024-11-16 17:05:14.610050] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:29.026 [2024-11-16 17:05:14.610084] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:29.026 [2024-11-16 17:05:14.610109] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:29.026 [2024-11-16 17:05:14.610124] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:29.026 [2024-11-16 17:05:14.659243] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1065c20 was disconnected and freed. delete nvme_qpair. 00:29:29.960 17:05:15 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:29.960 17:05:15 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:29.960 17:05:15 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:29.960 17:05:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.960 17:05:15 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:29.960 17:05:15 -- common/autotest_common.sh@10 -- # set +x 00:29:29.960 17:05:15 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:29.960 17:05:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.960 17:05:15 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:29.960 17:05:15 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:29.960 17:05:15 -- host/discovery_remove_ifc.sh@90 -- # killprocess 1316872 00:29:29.960 17:05:15 -- common/autotest_common.sh@936 -- # '[' -z 1316872 ']' 00:29:29.960 17:05:15 -- common/autotest_common.sh@940 -- # kill -0 1316872 00:29:29.960 17:05:15 -- common/autotest_common.sh@941 -- # uname 00:29:29.960 17:05:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:29.960 17:05:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1316872 00:29:29.960 17:05:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:29.960 17:05:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:29.960 17:05:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1316872' 00:29:29.960 killing process with pid 1316872 00:29:29.960 17:05:15 -- common/autotest_common.sh@955 -- # kill 1316872 00:29:29.960 17:05:15 -- common/autotest_common.sh@960 -- # wait 1316872 00:29:30.220 17:05:15 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:30.220 17:05:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:30.220 17:05:15 -- nvmf/common.sh@116 -- # sync 00:29:30.220 17:05:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:30.220 17:05:15 -- nvmf/common.sh@119 -- # set +e 00:29:30.220 17:05:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:30.220 17:05:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:30.220 rmmod nvme_tcp 00:29:30.220 rmmod nvme_fabrics 00:29:30.220 rmmod nvme_keyring 00:29:30.220 17:05:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:30.220 17:05:15 -- nvmf/common.sh@123 -- # set -e 00:29:30.220 17:05:15 -- nvmf/common.sh@124 -- # return 0 00:29:30.220 17:05:15 -- nvmf/common.sh@477 -- # '[' -n 1316719 ']' 00:29:30.220 17:05:15 -- nvmf/common.sh@478 -- # killprocess 1316719 00:29:30.220 17:05:15 -- common/autotest_common.sh@936 -- # '[' -z 1316719 ']' 00:29:30.220 17:05:15 -- common/autotest_common.sh@940 -- # kill -0 1316719 00:29:30.220 17:05:15 -- common/autotest_common.sh@941 -- # uname 00:29:30.220 17:05:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:30.220 17:05:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1316719 00:29:30.220 17:05:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:30.220 17:05:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:30.220 17:05:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1316719' 00:29:30.220 killing process with pid 1316719 00:29:30.220 17:05:15 -- common/autotest_common.sh@955 -- # kill 1316719 00:29:30.220 17:05:15 -- common/autotest_common.sh@960 -- # wait 1316719 00:29:30.478 17:05:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:30.478 17:05:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:30.478 17:05:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:30.478 17:05:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:30.478 17:05:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:30.478 17:05:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:30.478 17:05:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:30.478 17:05:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:33.013 17:05:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:33.013 00:29:33.013 real 0m18.562s 00:29:33.013 user 0m25.921s 00:29:33.013 sys 0m2.900s 00:29:33.013 17:05:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:33.013 17:05:18 -- common/autotest_common.sh@10 -- # set +x 00:29:33.013 ************************************ 00:29:33.013 END TEST nvmf_discovery_remove_ifc 00:29:33.013 ************************************ 00:29:33.013 17:05:18 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:33.013 17:05:18 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:33.013 17:05:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:33.013 17:05:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:33.013 17:05:18 -- common/autotest_common.sh@10 -- # set +x 00:29:33.013 ************************************ 00:29:33.013 START TEST nvmf_digest 00:29:33.013 ************************************ 00:29:33.013 17:05:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:33.013 * Looking for test storage... 00:29:33.013 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:33.013 17:05:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:33.013 17:05:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:33.013 17:05:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:33.013 17:05:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:33.013 17:05:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:33.013 17:05:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:33.013 17:05:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:33.013 17:05:18 -- scripts/common.sh@335 -- # IFS=.-: 00:29:33.013 17:05:18 -- scripts/common.sh@335 -- # read -ra ver1 00:29:33.013 17:05:18 -- scripts/common.sh@336 -- # IFS=.-: 00:29:33.013 17:05:18 -- scripts/common.sh@336 -- # read -ra ver2 00:29:33.013 17:05:18 -- scripts/common.sh@337 -- # local 'op=<' 00:29:33.013 17:05:18 -- scripts/common.sh@339 -- # ver1_l=2 00:29:33.013 17:05:18 -- scripts/common.sh@340 -- # ver2_l=1 00:29:33.013 17:05:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:33.013 17:05:18 -- scripts/common.sh@343 -- # case "$op" in 00:29:33.013 17:05:18 -- scripts/common.sh@344 -- # : 1 00:29:33.013 17:05:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:33.013 17:05:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:33.013 17:05:18 -- scripts/common.sh@364 -- # decimal 1 00:29:33.013 17:05:18 -- scripts/common.sh@352 -- # local d=1 00:29:33.013 17:05:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:33.013 17:05:18 -- scripts/common.sh@354 -- # echo 1 00:29:33.013 17:05:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:33.013 17:05:18 -- scripts/common.sh@365 -- # decimal 2 00:29:33.013 17:05:18 -- scripts/common.sh@352 -- # local d=2 00:29:33.013 17:05:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:33.013 17:05:18 -- scripts/common.sh@354 -- # echo 2 00:29:33.013 17:05:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:33.013 17:05:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:33.013 17:05:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:33.013 17:05:18 -- scripts/common.sh@367 -- # return 0 00:29:33.013 17:05:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:33.013 17:05:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:33.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:33.013 --rc genhtml_branch_coverage=1 00:29:33.013 --rc genhtml_function_coverage=1 00:29:33.013 --rc genhtml_legend=1 00:29:33.013 --rc geninfo_all_blocks=1 00:29:33.013 --rc geninfo_unexecuted_blocks=1 00:29:33.013 00:29:33.013 ' 00:29:33.013 17:05:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:33.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:33.013 --rc genhtml_branch_coverage=1 00:29:33.013 --rc genhtml_function_coverage=1 00:29:33.014 --rc genhtml_legend=1 00:29:33.014 --rc geninfo_all_blocks=1 00:29:33.014 --rc geninfo_unexecuted_blocks=1 00:29:33.014 00:29:33.014 ' 00:29:33.014 17:05:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:33.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:33.014 --rc genhtml_branch_coverage=1 00:29:33.014 --rc genhtml_function_coverage=1 00:29:33.014 --rc genhtml_legend=1 00:29:33.014 --rc geninfo_all_blocks=1 00:29:33.014 --rc geninfo_unexecuted_blocks=1 00:29:33.014 00:29:33.014 ' 00:29:33.014 17:05:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:33.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:33.014 --rc genhtml_branch_coverage=1 00:29:33.014 --rc genhtml_function_coverage=1 00:29:33.014 --rc genhtml_legend=1 00:29:33.014 --rc geninfo_all_blocks=1 00:29:33.014 --rc geninfo_unexecuted_blocks=1 00:29:33.014 00:29:33.014 ' 00:29:33.014 17:05:18 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:33.014 17:05:18 -- nvmf/common.sh@7 -- # uname -s 00:29:33.014 17:05:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:33.014 17:05:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:33.014 17:05:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:33.014 17:05:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:33.014 17:05:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:33.014 17:05:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:33.014 17:05:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:33.014 17:05:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:33.014 17:05:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:33.014 17:05:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:33.014 17:05:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:33.014 17:05:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:33.014 17:05:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:33.014 17:05:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:33.014 17:05:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:33.014 17:05:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:33.014 17:05:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:33.014 17:05:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:33.014 17:05:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:33.014 17:05:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:33.014 17:05:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:33.014 17:05:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:33.014 17:05:18 -- paths/export.sh@5 -- # export PATH 00:29:33.014 17:05:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:33.014 17:05:18 -- nvmf/common.sh@46 -- # : 0 00:29:33.014 17:05:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:33.014 17:05:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:33.014 17:05:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:33.014 17:05:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:33.014 17:05:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:33.014 17:05:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:33.014 17:05:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:33.014 17:05:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:33.014 17:05:18 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:33.014 17:05:18 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:33.014 17:05:18 -- host/digest.sh@16 -- # runtime=2 00:29:33.014 17:05:18 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:33.014 17:05:18 -- host/digest.sh@132 -- # nvmftestinit 00:29:33.014 17:05:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:33.014 17:05:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:33.014 17:05:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:33.014 17:05:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:33.014 17:05:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:33.014 17:05:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:33.014 17:05:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:33.014 17:05:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:33.014 17:05:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:33.014 17:05:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:33.014 17:05:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:33.014 17:05:18 -- common/autotest_common.sh@10 -- # set +x 00:29:34.939 17:05:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:34.939 17:05:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:34.939 17:05:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:34.939 17:05:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:34.939 17:05:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:34.939 17:05:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:34.939 17:05:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:34.939 17:05:20 -- nvmf/common.sh@294 -- # net_devs=() 00:29:34.939 17:05:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:34.939 17:05:20 -- nvmf/common.sh@295 -- # e810=() 00:29:34.939 17:05:20 -- nvmf/common.sh@295 -- # local -ga e810 00:29:34.939 17:05:20 -- nvmf/common.sh@296 -- # x722=() 00:29:34.939 17:05:20 -- nvmf/common.sh@296 -- # local -ga x722 00:29:34.939 17:05:20 -- nvmf/common.sh@297 -- # mlx=() 00:29:34.939 17:05:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:34.939 17:05:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:34.939 17:05:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:34.939 17:05:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:34.939 17:05:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:34.939 17:05:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:34.939 17:05:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:34.939 17:05:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:34.939 17:05:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:34.939 17:05:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:34.939 17:05:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:34.939 17:05:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:34.939 17:05:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:34.939 17:05:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:34.939 17:05:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:34.939 17:05:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:34.939 17:05:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:34.939 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:34.939 17:05:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:34.939 17:05:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:34.939 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:34.939 17:05:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:34.939 17:05:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:34.939 17:05:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:34.939 17:05:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:34.939 17:05:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:34.939 17:05:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:34.939 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:34.939 17:05:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:34.939 17:05:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:34.939 17:05:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:34.939 17:05:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:34.939 17:05:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:34.939 17:05:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:34.939 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:34.939 17:05:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:34.939 17:05:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:34.939 17:05:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:34.939 17:05:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:34.939 17:05:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:34.939 17:05:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:34.939 17:05:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:34.939 17:05:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:34.939 17:05:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:34.939 17:05:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:34.939 17:05:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:34.939 17:05:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:34.939 17:05:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:34.939 17:05:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:34.939 17:05:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:34.939 17:05:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:34.939 17:05:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:34.939 17:05:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:34.939 17:05:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:34.939 17:05:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:34.939 17:05:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:34.939 17:05:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:34.939 17:05:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:34.939 17:05:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:34.939 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:34.939 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.286 ms 00:29:34.939 00:29:34.939 --- 10.0.0.2 ping statistics --- 00:29:34.939 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:34.939 rtt min/avg/max/mdev = 0.286/0.286/0.286/0.000 ms 00:29:34.939 17:05:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:34.939 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:34.939 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:29:34.939 00:29:34.939 --- 10.0.0.1 ping statistics --- 00:29:34.939 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:34.939 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:29:34.939 17:05:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:34.939 17:05:20 -- nvmf/common.sh@410 -- # return 0 00:29:34.939 17:05:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:34.939 17:05:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:34.939 17:05:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:34.939 17:05:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:34.939 17:05:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:34.939 17:05:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:34.939 17:05:20 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:34.939 17:05:20 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:34.939 17:05:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:34.939 17:05:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:34.939 17:05:20 -- common/autotest_common.sh@10 -- # set +x 00:29:34.939 ************************************ 00:29:34.939 START TEST nvmf_digest_clean 00:29:34.939 ************************************ 00:29:34.939 17:05:20 -- common/autotest_common.sh@1114 -- # run_digest 00:29:34.939 17:05:20 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:34.939 17:05:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:34.939 17:05:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:34.939 17:05:20 -- common/autotest_common.sh@10 -- # set +x 00:29:34.939 17:05:20 -- nvmf/common.sh@469 -- # nvmfpid=1320521 00:29:34.940 17:05:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:34.940 17:05:20 -- nvmf/common.sh@470 -- # waitforlisten 1320521 00:29:34.940 17:05:20 -- common/autotest_common.sh@829 -- # '[' -z 1320521 ']' 00:29:34.940 17:05:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:34.940 17:05:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:34.940 17:05:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:34.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:34.940 17:05:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:34.940 17:05:20 -- common/autotest_common.sh@10 -- # set +x 00:29:34.940 [2024-11-16 17:05:20.584634] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:34.940 [2024-11-16 17:05:20.584736] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:34.940 EAL: No free 2048 kB hugepages reported on node 1 00:29:34.940 [2024-11-16 17:05:20.647701] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:35.197 [2024-11-16 17:05:20.731328] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:35.197 [2024-11-16 17:05:20.731491] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:35.197 [2024-11-16 17:05:20.731507] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:35.197 [2024-11-16 17:05:20.731519] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:35.197 [2024-11-16 17:05:20.731544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:35.197 17:05:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:35.197 17:05:20 -- common/autotest_common.sh@862 -- # return 0 00:29:35.197 17:05:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:35.197 17:05:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:35.197 17:05:20 -- common/autotest_common.sh@10 -- # set +x 00:29:35.197 17:05:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:35.197 17:05:20 -- host/digest.sh@120 -- # common_target_config 00:29:35.197 17:05:20 -- host/digest.sh@43 -- # rpc_cmd 00:29:35.197 17:05:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.197 17:05:20 -- common/autotest_common.sh@10 -- # set +x 00:29:35.197 null0 00:29:35.197 [2024-11-16 17:05:20.930660] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:35.457 [2024-11-16 17:05:20.954874] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:35.457 17:05:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.457 17:05:20 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:35.457 17:05:20 -- host/digest.sh@77 -- # local rw bs qd 00:29:35.457 17:05:20 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:35.457 17:05:20 -- host/digest.sh@80 -- # rw=randread 00:29:35.457 17:05:20 -- host/digest.sh@80 -- # bs=4096 00:29:35.457 17:05:20 -- host/digest.sh@80 -- # qd=128 00:29:35.457 17:05:20 -- host/digest.sh@82 -- # bperfpid=1320543 00:29:35.457 17:05:20 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:35.457 17:05:20 -- host/digest.sh@83 -- # waitforlisten 1320543 /var/tmp/bperf.sock 00:29:35.457 17:05:20 -- common/autotest_common.sh@829 -- # '[' -z 1320543 ']' 00:29:35.457 17:05:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:35.457 17:05:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:35.457 17:05:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:35.457 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:35.457 17:05:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:35.457 17:05:20 -- common/autotest_common.sh@10 -- # set +x 00:29:35.457 [2024-11-16 17:05:21.002306] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:35.457 [2024-11-16 17:05:21.002379] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1320543 ] 00:29:35.457 EAL: No free 2048 kB hugepages reported on node 1 00:29:35.457 [2024-11-16 17:05:21.068286] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:35.457 [2024-11-16 17:05:21.158314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:35.715 17:05:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:35.715 17:05:21 -- common/autotest_common.sh@862 -- # return 0 00:29:35.715 17:05:21 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:35.715 17:05:21 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:35.716 17:05:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:35.973 17:05:21 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:35.973 17:05:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:36.537 nvme0n1 00:29:36.537 17:05:22 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:36.537 17:05:22 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:36.537 Running I/O for 2 seconds... 00:29:39.069 00:29:39.069 Latency(us) 00:29:39.069 [2024-11-16T16:05:24.819Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:39.069 [2024-11-16T16:05:24.819Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:39.069 nvme0n1 : 2.05 14931.26 58.33 0.00 0.00 8397.66 3786.52 48156.82 00:29:39.069 [2024-11-16T16:05:24.819Z] =================================================================================================================== 00:29:39.069 [2024-11-16T16:05:24.819Z] Total : 14931.26 58.33 0.00 0.00 8397.66 3786.52 48156.82 00:29:39.069 0 00:29:39.069 17:05:24 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:39.069 17:05:24 -- host/digest.sh@92 -- # get_accel_stats 00:29:39.069 17:05:24 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:39.069 17:05:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:39.069 17:05:24 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:39.069 | select(.opcode=="crc32c") 00:29:39.069 | "\(.module_name) \(.executed)"' 00:29:39.069 17:05:24 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:39.069 17:05:24 -- host/digest.sh@93 -- # exp_module=software 00:29:39.069 17:05:24 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:39.069 17:05:24 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:39.069 17:05:24 -- host/digest.sh@97 -- # killprocess 1320543 00:29:39.069 17:05:24 -- common/autotest_common.sh@936 -- # '[' -z 1320543 ']' 00:29:39.069 17:05:24 -- common/autotest_common.sh@940 -- # kill -0 1320543 00:29:39.069 17:05:24 -- common/autotest_common.sh@941 -- # uname 00:29:39.069 17:05:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:39.069 17:05:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1320543 00:29:39.069 17:05:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:39.069 17:05:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:39.069 17:05:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1320543' 00:29:39.069 killing process with pid 1320543 00:29:39.069 17:05:24 -- common/autotest_common.sh@955 -- # kill 1320543 00:29:39.069 Received shutdown signal, test time was about 2.000000 seconds 00:29:39.069 00:29:39.069 Latency(us) 00:29:39.069 [2024-11-16T16:05:24.819Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:39.069 [2024-11-16T16:05:24.819Z] =================================================================================================================== 00:29:39.069 [2024-11-16T16:05:24.819Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:39.069 17:05:24 -- common/autotest_common.sh@960 -- # wait 1320543 00:29:39.069 17:05:24 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:39.069 17:05:24 -- host/digest.sh@77 -- # local rw bs qd 00:29:39.069 17:05:24 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:39.069 17:05:24 -- host/digest.sh@80 -- # rw=randread 00:29:39.069 17:05:24 -- host/digest.sh@80 -- # bs=131072 00:29:39.069 17:05:24 -- host/digest.sh@80 -- # qd=16 00:29:39.069 17:05:24 -- host/digest.sh@82 -- # bperfpid=1320966 00:29:39.069 17:05:24 -- host/digest.sh@83 -- # waitforlisten 1320966 /var/tmp/bperf.sock 00:29:39.069 17:05:24 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:39.069 17:05:24 -- common/autotest_common.sh@829 -- # '[' -z 1320966 ']' 00:29:39.069 17:05:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:39.069 17:05:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:39.070 17:05:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:39.070 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:39.070 17:05:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:39.070 17:05:24 -- common/autotest_common.sh@10 -- # set +x 00:29:39.070 [2024-11-16 17:05:24.746972] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:39.070 [2024-11-16 17:05:24.747046] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1320966 ] 00:29:39.070 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:39.070 Zero copy mechanism will not be used. 00:29:39.070 EAL: No free 2048 kB hugepages reported on node 1 00:29:39.070 [2024-11-16 17:05:24.807356] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:39.328 [2024-11-16 17:05:24.895669] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:39.328 17:05:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:39.328 17:05:24 -- common/autotest_common.sh@862 -- # return 0 00:29:39.328 17:05:24 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:39.328 17:05:24 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:39.328 17:05:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:39.587 17:05:25 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:39.587 17:05:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:40.156 nvme0n1 00:29:40.156 17:05:25 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:40.156 17:05:25 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:40.156 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:40.156 Zero copy mechanism will not be used. 00:29:40.156 Running I/O for 2 seconds... 00:29:42.696 00:29:42.696 Latency(us) 00:29:42.696 [2024-11-16T16:05:28.446Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:42.696 [2024-11-16T16:05:28.446Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:42.696 nvme0n1 : 2.00 5873.62 734.20 0.00 0.00 2720.41 597.71 10194.49 00:29:42.696 [2024-11-16T16:05:28.446Z] =================================================================================================================== 00:29:42.696 [2024-11-16T16:05:28.446Z] Total : 5873.62 734.20 0.00 0.00 2720.41 597.71 10194.49 00:29:42.696 0 00:29:42.696 17:05:27 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:42.696 17:05:27 -- host/digest.sh@92 -- # get_accel_stats 00:29:42.696 17:05:27 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:42.696 17:05:27 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:42.696 | select(.opcode=="crc32c") 00:29:42.696 | "\(.module_name) \(.executed)"' 00:29:42.696 17:05:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:42.696 17:05:28 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:42.696 17:05:28 -- host/digest.sh@93 -- # exp_module=software 00:29:42.696 17:05:28 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:42.696 17:05:28 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:42.696 17:05:28 -- host/digest.sh@97 -- # killprocess 1320966 00:29:42.696 17:05:28 -- common/autotest_common.sh@936 -- # '[' -z 1320966 ']' 00:29:42.696 17:05:28 -- common/autotest_common.sh@940 -- # kill -0 1320966 00:29:42.696 17:05:28 -- common/autotest_common.sh@941 -- # uname 00:29:42.696 17:05:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:42.696 17:05:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1320966 00:29:42.696 17:05:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:42.696 17:05:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:42.696 17:05:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1320966' 00:29:42.696 killing process with pid 1320966 00:29:42.696 17:05:28 -- common/autotest_common.sh@955 -- # kill 1320966 00:29:42.696 Received shutdown signal, test time was about 2.000000 seconds 00:29:42.696 00:29:42.696 Latency(us) 00:29:42.696 [2024-11-16T16:05:28.446Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:42.696 [2024-11-16T16:05:28.446Z] =================================================================================================================== 00:29:42.696 [2024-11-16T16:05:28.446Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:42.696 17:05:28 -- common/autotest_common.sh@960 -- # wait 1320966 00:29:42.696 17:05:28 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:42.696 17:05:28 -- host/digest.sh@77 -- # local rw bs qd 00:29:42.696 17:05:28 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:42.696 17:05:28 -- host/digest.sh@80 -- # rw=randwrite 00:29:42.696 17:05:28 -- host/digest.sh@80 -- # bs=4096 00:29:42.696 17:05:28 -- host/digest.sh@80 -- # qd=128 00:29:42.696 17:05:28 -- host/digest.sh@82 -- # bperfpid=1321508 00:29:42.696 17:05:28 -- host/digest.sh@83 -- # waitforlisten 1321508 /var/tmp/bperf.sock 00:29:42.696 17:05:28 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:42.696 17:05:28 -- common/autotest_common.sh@829 -- # '[' -z 1321508 ']' 00:29:42.696 17:05:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:42.696 17:05:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:42.696 17:05:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:42.696 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:42.696 17:05:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:42.696 17:05:28 -- common/autotest_common.sh@10 -- # set +x 00:29:42.955 [2024-11-16 17:05:28.473013] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:42.955 [2024-11-16 17:05:28.473100] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1321508 ] 00:29:42.955 EAL: No free 2048 kB hugepages reported on node 1 00:29:42.955 [2024-11-16 17:05:28.532947] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:42.955 [2024-11-16 17:05:28.623316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:42.955 17:05:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:42.955 17:05:28 -- common/autotest_common.sh@862 -- # return 0 00:29:42.955 17:05:28 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:42.955 17:05:28 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:42.955 17:05:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:43.523 17:05:29 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:43.523 17:05:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:43.781 nvme0n1 00:29:43.781 17:05:29 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:43.781 17:05:29 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:44.039 Running I/O for 2 seconds... 00:29:45.946 00:29:45.946 Latency(us) 00:29:45.946 [2024-11-16T16:05:31.696Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:45.946 [2024-11-16T16:05:31.696Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:45.946 nvme0n1 : 2.01 20748.83 81.05 0.00 0.00 6162.00 2560.76 18350.08 00:29:45.946 [2024-11-16T16:05:31.696Z] =================================================================================================================== 00:29:45.946 [2024-11-16T16:05:31.696Z] Total : 20748.83 81.05 0.00 0.00 6162.00 2560.76 18350.08 00:29:45.946 0 00:29:45.946 17:05:31 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:45.946 17:05:31 -- host/digest.sh@92 -- # get_accel_stats 00:29:45.946 17:05:31 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:45.946 17:05:31 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:45.946 | select(.opcode=="crc32c") 00:29:45.946 | "\(.module_name) \(.executed)"' 00:29:45.946 17:05:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:46.204 17:05:31 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:46.204 17:05:31 -- host/digest.sh@93 -- # exp_module=software 00:29:46.204 17:05:31 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:46.204 17:05:31 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:46.204 17:05:31 -- host/digest.sh@97 -- # killprocess 1321508 00:29:46.204 17:05:31 -- common/autotest_common.sh@936 -- # '[' -z 1321508 ']' 00:29:46.204 17:05:31 -- common/autotest_common.sh@940 -- # kill -0 1321508 00:29:46.204 17:05:31 -- common/autotest_common.sh@941 -- # uname 00:29:46.204 17:05:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:46.204 17:05:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1321508 00:29:46.464 17:05:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:46.464 17:05:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:46.464 17:05:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1321508' 00:29:46.464 killing process with pid 1321508 00:29:46.464 17:05:31 -- common/autotest_common.sh@955 -- # kill 1321508 00:29:46.464 Received shutdown signal, test time was about 2.000000 seconds 00:29:46.464 00:29:46.464 Latency(us) 00:29:46.464 [2024-11-16T16:05:32.214Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:46.464 [2024-11-16T16:05:32.214Z] =================================================================================================================== 00:29:46.464 [2024-11-16T16:05:32.214Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:46.464 17:05:31 -- common/autotest_common.sh@960 -- # wait 1321508 00:29:46.464 17:05:32 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:46.464 17:05:32 -- host/digest.sh@77 -- # local rw bs qd 00:29:46.464 17:05:32 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:46.464 17:05:32 -- host/digest.sh@80 -- # rw=randwrite 00:29:46.464 17:05:32 -- host/digest.sh@80 -- # bs=131072 00:29:46.464 17:05:32 -- host/digest.sh@80 -- # qd=16 00:29:46.464 17:05:32 -- host/digest.sh@82 -- # bperfpid=1321929 00:29:46.464 17:05:32 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:46.464 17:05:32 -- host/digest.sh@83 -- # waitforlisten 1321929 /var/tmp/bperf.sock 00:29:46.464 17:05:32 -- common/autotest_common.sh@829 -- # '[' -z 1321929 ']' 00:29:46.464 17:05:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:46.464 17:05:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:46.464 17:05:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:46.464 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:46.464 17:05:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:46.464 17:05:32 -- common/autotest_common.sh@10 -- # set +x 00:29:46.464 [2024-11-16 17:05:32.198853] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:46.464 [2024-11-16 17:05:32.198944] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1321929 ] 00:29:46.464 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:46.464 Zero copy mechanism will not be used. 00:29:46.722 EAL: No free 2048 kB hugepages reported on node 1 00:29:46.723 [2024-11-16 17:05:32.261836] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:46.723 [2024-11-16 17:05:32.349812] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:46.723 17:05:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:46.723 17:05:32 -- common/autotest_common.sh@862 -- # return 0 00:29:46.723 17:05:32 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:46.723 17:05:32 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:46.723 17:05:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:47.293 17:05:32 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:47.293 17:05:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:47.552 nvme0n1 00:29:47.552 17:05:33 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:47.552 17:05:33 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:47.812 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:47.812 Zero copy mechanism will not be used. 00:29:47.812 Running I/O for 2 seconds... 00:29:49.723 00:29:49.723 Latency(us) 00:29:49.723 [2024-11-16T16:05:35.473Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:49.723 [2024-11-16T16:05:35.473Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:49.723 nvme0n1 : 2.00 6448.95 806.12 0.00 0.00 2474.52 1723.35 6407.96 00:29:49.723 [2024-11-16T16:05:35.473Z] =================================================================================================================== 00:29:49.723 [2024-11-16T16:05:35.473Z] Total : 6448.95 806.12 0.00 0.00 2474.52 1723.35 6407.96 00:29:49.723 0 00:29:49.723 17:05:35 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:49.723 17:05:35 -- host/digest.sh@92 -- # get_accel_stats 00:29:49.723 17:05:35 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:49.723 17:05:35 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:49.723 | select(.opcode=="crc32c") 00:29:49.724 | "\(.module_name) \(.executed)"' 00:29:49.724 17:05:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:50.012 17:05:35 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:50.012 17:05:35 -- host/digest.sh@93 -- # exp_module=software 00:29:50.012 17:05:35 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:50.012 17:05:35 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:50.012 17:05:35 -- host/digest.sh@97 -- # killprocess 1321929 00:29:50.012 17:05:35 -- common/autotest_common.sh@936 -- # '[' -z 1321929 ']' 00:29:50.012 17:05:35 -- common/autotest_common.sh@940 -- # kill -0 1321929 00:29:50.012 17:05:35 -- common/autotest_common.sh@941 -- # uname 00:29:50.012 17:05:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:50.012 17:05:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1321929 00:29:50.012 17:05:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:50.012 17:05:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:50.012 17:05:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1321929' 00:29:50.012 killing process with pid 1321929 00:29:50.012 17:05:35 -- common/autotest_common.sh@955 -- # kill 1321929 00:29:50.012 Received shutdown signal, test time was about 2.000000 seconds 00:29:50.012 00:29:50.012 Latency(us) 00:29:50.012 [2024-11-16T16:05:35.762Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:50.012 [2024-11-16T16:05:35.762Z] =================================================================================================================== 00:29:50.012 [2024-11-16T16:05:35.762Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:50.012 17:05:35 -- common/autotest_common.sh@960 -- # wait 1321929 00:29:50.296 17:05:35 -- host/digest.sh@126 -- # killprocess 1320521 00:29:50.296 17:05:35 -- common/autotest_common.sh@936 -- # '[' -z 1320521 ']' 00:29:50.296 17:05:35 -- common/autotest_common.sh@940 -- # kill -0 1320521 00:29:50.296 17:05:35 -- common/autotest_common.sh@941 -- # uname 00:29:50.296 17:05:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:50.296 17:05:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1320521 00:29:50.296 17:05:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:50.296 17:05:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:50.296 17:05:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1320521' 00:29:50.296 killing process with pid 1320521 00:29:50.296 17:05:35 -- common/autotest_common.sh@955 -- # kill 1320521 00:29:50.296 17:05:35 -- common/autotest_common.sh@960 -- # wait 1320521 00:29:50.554 00:29:50.554 real 0m15.550s 00:29:50.554 user 0m30.612s 00:29:50.554 sys 0m4.429s 00:29:50.554 17:05:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:50.554 17:05:36 -- common/autotest_common.sh@10 -- # set +x 00:29:50.554 ************************************ 00:29:50.554 END TEST nvmf_digest_clean 00:29:50.554 ************************************ 00:29:50.554 17:05:36 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:50.554 17:05:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:50.554 17:05:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:50.554 17:05:36 -- common/autotest_common.sh@10 -- # set +x 00:29:50.554 ************************************ 00:29:50.554 START TEST nvmf_digest_error 00:29:50.554 ************************************ 00:29:50.554 17:05:36 -- common/autotest_common.sh@1114 -- # run_digest_error 00:29:50.554 17:05:36 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:50.554 17:05:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:50.554 17:05:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:50.554 17:05:36 -- common/autotest_common.sh@10 -- # set +x 00:29:50.554 17:05:36 -- nvmf/common.sh@469 -- # nvmfpid=1322378 00:29:50.554 17:05:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:50.554 17:05:36 -- nvmf/common.sh@470 -- # waitforlisten 1322378 00:29:50.554 17:05:36 -- common/autotest_common.sh@829 -- # '[' -z 1322378 ']' 00:29:50.554 17:05:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:50.554 17:05:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:50.554 17:05:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:50.554 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:50.554 17:05:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:50.554 17:05:36 -- common/autotest_common.sh@10 -- # set +x 00:29:50.554 [2024-11-16 17:05:36.163894] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:50.554 [2024-11-16 17:05:36.164002] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:50.554 EAL: No free 2048 kB hugepages reported on node 1 00:29:50.554 [2024-11-16 17:05:36.229290] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:50.813 [2024-11-16 17:05:36.316533] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:50.813 [2024-11-16 17:05:36.316709] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:50.813 [2024-11-16 17:05:36.316728] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:50.813 [2024-11-16 17:05:36.316741] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:50.813 [2024-11-16 17:05:36.316767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:50.813 17:05:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:50.813 17:05:36 -- common/autotest_common.sh@862 -- # return 0 00:29:50.813 17:05:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:50.813 17:05:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:50.813 17:05:36 -- common/autotest_common.sh@10 -- # set +x 00:29:50.813 17:05:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:50.813 17:05:36 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:50.813 17:05:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:50.813 17:05:36 -- common/autotest_common.sh@10 -- # set +x 00:29:50.813 [2024-11-16 17:05:36.417423] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:50.813 17:05:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:50.813 17:05:36 -- host/digest.sh@104 -- # common_target_config 00:29:50.813 17:05:36 -- host/digest.sh@43 -- # rpc_cmd 00:29:50.813 17:05:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:50.813 17:05:36 -- common/autotest_common.sh@10 -- # set +x 00:29:50.813 null0 00:29:50.813 [2024-11-16 17:05:36.536846] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:50.813 [2024-11-16 17:05:36.561099] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:51.072 17:05:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.072 17:05:36 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:51.072 17:05:36 -- host/digest.sh@54 -- # local rw bs qd 00:29:51.072 17:05:36 -- host/digest.sh@56 -- # rw=randread 00:29:51.072 17:05:36 -- host/digest.sh@56 -- # bs=4096 00:29:51.072 17:05:36 -- host/digest.sh@56 -- # qd=128 00:29:51.072 17:05:36 -- host/digest.sh@58 -- # bperfpid=1322524 00:29:51.072 17:05:36 -- host/digest.sh@60 -- # waitforlisten 1322524 /var/tmp/bperf.sock 00:29:51.072 17:05:36 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:51.072 17:05:36 -- common/autotest_common.sh@829 -- # '[' -z 1322524 ']' 00:29:51.072 17:05:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:51.072 17:05:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:51.072 17:05:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:51.072 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:51.072 17:05:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:51.072 17:05:36 -- common/autotest_common.sh@10 -- # set +x 00:29:51.072 [2024-11-16 17:05:36.604235] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:51.072 [2024-11-16 17:05:36.604295] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1322524 ] 00:29:51.072 EAL: No free 2048 kB hugepages reported on node 1 00:29:51.072 [2024-11-16 17:05:36.664817] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:51.072 [2024-11-16 17:05:36.754009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:52.006 17:05:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:52.006 17:05:37 -- common/autotest_common.sh@862 -- # return 0 00:29:52.006 17:05:37 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:52.006 17:05:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:52.264 17:05:37 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:52.264 17:05:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:52.264 17:05:37 -- common/autotest_common.sh@10 -- # set +x 00:29:52.264 17:05:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:52.264 17:05:37 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:52.264 17:05:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:52.522 nvme0n1 00:29:52.522 17:05:38 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:52.522 17:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:52.522 17:05:38 -- common/autotest_common.sh@10 -- # set +x 00:29:52.522 17:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:52.522 17:05:38 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:52.522 17:05:38 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:52.781 Running I/O for 2 seconds... 00:29:52.781 [2024-11-16 17:05:38.327025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:52.781 [2024-11-16 17:05:38.327078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12242 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.781 [2024-11-16 17:05:38.327114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.781 [2024-11-16 17:05:38.338439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:52.781 [2024-11-16 17:05:38.338477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:9812 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.781 [2024-11-16 17:05:38.338498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.781 [2024-11-16 17:05:38.354676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:52.781 [2024-11-16 17:05:38.354707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:19830 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.781 [2024-11-16 17:05:38.354723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.781 [2024-11-16 17:05:38.371753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:52.781 [2024-11-16 17:05:38.371784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:612 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.781 [2024-11-16 17:05:38.371801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.781 [2024-11-16 17:05:38.389157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:52.781 [2024-11-16 17:05:38.389194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:22095 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.781 [2024-11-16 17:05:38.389214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.781 [2024-11-16 17:05:38.406334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:52.781 [2024-11-16 17:05:38.406371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20215 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.781 [2024-11-16 17:05:38.406391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.781 [2024-11-16 17:05:38.420571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:52.781 [2024-11-16 17:05:38.420608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:14714 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.781 [2024-11-16 17:05:38.420637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.781 [2024-11-16 17:05:38.432240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:52.781 [2024-11-16 17:05:38.432276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:22572 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.781 [2024-11-16 17:05:38.432295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.781 [2024-11-16 17:05:38.449516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:52.781 [2024-11-16 17:05:38.449551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1923 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.781 [2024-11-16 17:05:38.449571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.781 [2024-11-16 17:05:38.467096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:52.781 [2024-11-16 17:05:38.467131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:5322 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.781 [2024-11-16 17:05:38.467150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.781 [2024-11-16 17:05:38.484219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:52.781 [2024-11-16 17:05:38.484256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:17561 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.781 [2024-11-16 17:05:38.484275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.781 [2024-11-16 17:05:38.501441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:52.781 [2024-11-16 17:05:38.501478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:6639 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.781 [2024-11-16 17:05:38.501497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.781 [2024-11-16 17:05:38.518324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:52.781 [2024-11-16 17:05:38.518360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13753 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.781 [2024-11-16 17:05:38.518379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.533689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.533721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:4545 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.533738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.551115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.551151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:15578 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.551170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.568632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.568682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:4380 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.568700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.584216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.584260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5160 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.584276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.596750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.596782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:6210 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.596806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.611592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.611643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:13355 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.611665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.629402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.629438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:5775 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.629456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.646249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.646285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:23803 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.646305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.663460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.663496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:12580 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.663515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.680842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.680871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:13934 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.680887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.697722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.697750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:8343 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.697766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.714332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.714367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:25419 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.714386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.729647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.729696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:8617 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.729713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.741171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.741215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:22390 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.741236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.755052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.755083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:13552 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.755099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.772342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.772378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22818 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.772397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.042 [2024-11-16 17:05:38.789267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.042 [2024-11-16 17:05:38.789302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20873 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.042 [2024-11-16 17:05:38.789322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.304 [2024-11-16 17:05:38.806269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.304 [2024-11-16 17:05:38.806305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:13570 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.304 [2024-11-16 17:05:38.806324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.304 [2024-11-16 17:05:38.823115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.304 [2024-11-16 17:05:38.823150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:9928 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.304 [2024-11-16 17:05:38.823169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.304 [2024-11-16 17:05:38.839984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.304 [2024-11-16 17:05:38.840019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:12664 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.304 [2024-11-16 17:05:38.840038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.304 [2024-11-16 17:05:38.856926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.304 [2024-11-16 17:05:38.856968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:14570 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.304 [2024-11-16 17:05:38.856989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.304 [2024-11-16 17:05:38.873896] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.304 [2024-11-16 17:05:38.873943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:7365 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.304 [2024-11-16 17:05:38.873963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.304 [2024-11-16 17:05:38.890874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.305 [2024-11-16 17:05:38.890903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:3261 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.305 [2024-11-16 17:05:38.890933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.305 [2024-11-16 17:05:38.907558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.305 [2024-11-16 17:05:38.907594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20025 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.305 [2024-11-16 17:05:38.907612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.305 [2024-11-16 17:05:38.924044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.305 [2024-11-16 17:05:38.924081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:20063 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.305 [2024-11-16 17:05:38.924100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.305 [2024-11-16 17:05:38.941102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.305 [2024-11-16 17:05:38.941136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:22113 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.305 [2024-11-16 17:05:38.941155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.305 [2024-11-16 17:05:38.957525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.305 [2024-11-16 17:05:38.957561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:15069 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.305 [2024-11-16 17:05:38.957580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.305 [2024-11-16 17:05:38.974514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.305 [2024-11-16 17:05:38.974549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:25148 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.305 [2024-11-16 17:05:38.974568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.305 [2024-11-16 17:05:38.991530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.305 [2024-11-16 17:05:38.991566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:8431 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.305 [2024-11-16 17:05:38.991585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.305 [2024-11-16 17:05:39.008494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.305 [2024-11-16 17:05:39.008527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:4455 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.305 [2024-11-16 17:05:39.008545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.305 [2024-11-16 17:05:39.023868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.305 [2024-11-16 17:05:39.023913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15524 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.305 [2024-11-16 17:05:39.023936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.305 [2024-11-16 17:05:39.039145] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.305 [2024-11-16 17:05:39.039174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:2892 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.305 [2024-11-16 17:05:39.039189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.054669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.054701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25104 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.054717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.070156] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.070186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4952 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.070202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.085716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.085746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15105 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.085762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.100635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.100682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:8227 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.100701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.114880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.114913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:11176 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.114930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.125433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.125462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:21926 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.125479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.140797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.140829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:6736 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.140846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.163293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.163328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20072 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.163345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.178689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.178718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13835 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.178735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.193982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.194012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:24498 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.194028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.209280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.209308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:6239 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.209324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.224943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.224972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:10423 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.224987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.240269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.240298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:2558 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.240314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.255701] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.255734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:6349 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.255751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.271264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.271293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:12909 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.271309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.565 [2024-11-16 17:05:39.286687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.565 [2024-11-16 17:05:39.286717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:3225 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.565 [2024-11-16 17:05:39.286733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.566 [2024-11-16 17:05:39.302161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.566 [2024-11-16 17:05:39.302191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:23224 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.566 [2024-11-16 17:05:39.302208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.317737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.317770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:23100 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.317786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.333292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.333321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:20260 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.333337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.348834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.348864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:11398 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.348881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.364360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.364390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:2014 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.364405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.379828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.379859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:11564 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.379875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.395054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.395082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:17574 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.395098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.410429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.410458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:6634 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.410475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.425695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.425726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:2950 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.425750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.441170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.441200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:21696 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.441216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.456593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.456643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:8830 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.456662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.471973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.472003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:14109 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.472019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.487299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.487327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:4148 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.487343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.502796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.502827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:14347 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.502844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.518361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.518392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:5033 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.518410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.534214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.534243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:18791 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.534260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.549514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.549543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:14047 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.549559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.826 [2024-11-16 17:05:39.564724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:53.826 [2024-11-16 17:05:39.564755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:23564 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.826 [2024-11-16 17:05:39.564772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.580348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.580377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:22677 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.580393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.595648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.595677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:5893 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.595694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.611208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.611237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:236 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.611253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.626715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.626746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:2487 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.626762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.642534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.642565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:6431 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.642581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.656923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.656954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:14621 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.656972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.672625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.672669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:7729 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.672687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.688441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.688470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:25580 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.688494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.704105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.704134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:21143 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.704151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.719432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.719461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:25035 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.719477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.734806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.734836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:23282 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.734852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.750045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.750074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:381 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.750090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.765586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.765638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:15800 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.765655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.781105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.781150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:5655 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.781167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.796386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.796414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:20966 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.087 [2024-11-16 17:05:39.796430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.087 [2024-11-16 17:05:39.811849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.087 [2024-11-16 17:05:39.811879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:4908 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.088 [2024-11-16 17:05:39.811895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.088 [2024-11-16 17:05:39.827145] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.088 [2024-11-16 17:05:39.827180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:4273 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.088 [2024-11-16 17:05:39.827197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.349 [2024-11-16 17:05:39.842636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.349 [2024-11-16 17:05:39.842667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:10236 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.349 [2024-11-16 17:05:39.842683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.349 [2024-11-16 17:05:39.858027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.349 [2024-11-16 17:05:39.858056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:7730 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.349 [2024-11-16 17:05:39.858072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.349 [2024-11-16 17:05:39.873441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.349 [2024-11-16 17:05:39.873470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:17833 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.349 [2024-11-16 17:05:39.873487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.349 [2024-11-16 17:05:39.888609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.349 [2024-11-16 17:05:39.888645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:6429 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.349 [2024-11-16 17:05:39.888662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.349 [2024-11-16 17:05:39.903948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.349 [2024-11-16 17:05:39.903977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:4194 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.349 [2024-11-16 17:05:39.903992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.349 [2024-11-16 17:05:39.919149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.349 [2024-11-16 17:05:39.919178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:11627 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.349 [2024-11-16 17:05:39.919194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.349 [2024-11-16 17:05:39.934359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.349 [2024-11-16 17:05:39.934387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:7062 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.349 [2024-11-16 17:05:39.934403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.349 [2024-11-16 17:05:39.950098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.349 [2024-11-16 17:05:39.950133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:25100 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.349 [2024-11-16 17:05:39.950152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.349 [2024-11-16 17:05:39.966524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.349 [2024-11-16 17:05:39.966560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:22819 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.349 [2024-11-16 17:05:39.966579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.349 [2024-11-16 17:05:39.983226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.349 [2024-11-16 17:05:39.983261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:11672 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.349 [2024-11-16 17:05:39.983280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.349 [2024-11-16 17:05:39.999197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.349 [2024-11-16 17:05:39.999232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:9094 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.349 [2024-11-16 17:05:39.999252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.349 [2024-11-16 17:05:40.011376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.349 [2024-11-16 17:05:40.011413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:24059 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.349 [2024-11-16 17:05:40.011433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.349 [2024-11-16 17:05:40.028495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.349 [2024-11-16 17:05:40.028533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:22281 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.349 [2024-11-16 17:05:40.028552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.349 [2024-11-16 17:05:40.045409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.349 [2024-11-16 17:05:40.045445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:12077 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.349 [2024-11-16 17:05:40.045465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.350 [2024-11-16 17:05:40.061828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.350 [2024-11-16 17:05:40.061870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:7673 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.350 [2024-11-16 17:05:40.061887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.350 [2024-11-16 17:05:40.078132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.350 [2024-11-16 17:05:40.078167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:10456 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.350 [2024-11-16 17:05:40.078185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.350 [2024-11-16 17:05:40.093854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.350 [2024-11-16 17:05:40.093884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:14285 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.350 [2024-11-16 17:05:40.093932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.608 [2024-11-16 17:05:40.110037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.608 [2024-11-16 17:05:40.110067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:12047 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.608 [2024-11-16 17:05:40.110083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.608 [2024-11-16 17:05:40.125905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.608 [2024-11-16 17:05:40.125951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:9056 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.608 [2024-11-16 17:05:40.125971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.608 [2024-11-16 17:05:40.142834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.608 [2024-11-16 17:05:40.142866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:18942 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.608 [2024-11-16 17:05:40.142883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.608 [2024-11-16 17:05:40.158999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.609 [2024-11-16 17:05:40.159047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:21528 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.609 [2024-11-16 17:05:40.159063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.609 [2024-11-16 17:05:40.175373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.609 [2024-11-16 17:05:40.175408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24725 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.609 [2024-11-16 17:05:40.175427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.609 [2024-11-16 17:05:40.191774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.609 [2024-11-16 17:05:40.191804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5662 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.609 [2024-11-16 17:05:40.191820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.609 [2024-11-16 17:05:40.209123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.609 [2024-11-16 17:05:40.209153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:19005 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.609 [2024-11-16 17:05:40.209186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.609 [2024-11-16 17:05:40.224414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.609 [2024-11-16 17:05:40.224458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:389 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.609 [2024-11-16 17:05:40.224477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.609 [2024-11-16 17:05:40.241270] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.609 [2024-11-16 17:05:40.241306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:901 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.609 [2024-11-16 17:05:40.241323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.609 [2024-11-16 17:05:40.258115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.609 [2024-11-16 17:05:40.258150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21636 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.609 [2024-11-16 17:05:40.258169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.609 [2024-11-16 17:05:40.275064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.609 [2024-11-16 17:05:40.275099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:10706 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.609 [2024-11-16 17:05:40.275118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.609 [2024-11-16 17:05:40.292113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.609 [2024-11-16 17:05:40.292148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:9373 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.609 [2024-11-16 17:05:40.292168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.609 [2024-11-16 17:05:40.309128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xaf13b0) 00:29:54.609 [2024-11-16 17:05:40.309163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:8723 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.609 [2024-11-16 17:05:40.309182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.609 00:29:54.609 Latency(us) 00:29:54.609 [2024-11-16T16:05:40.359Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:54.609 [2024-11-16T16:05:40.359Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:54.609 nvme0n1 : 2.01 16036.55 62.64 0.00 0.00 7973.96 3470.98 29709.65 00:29:54.609 [2024-11-16T16:05:40.359Z] =================================================================================================================== 00:29:54.609 [2024-11-16T16:05:40.359Z] Total : 16036.55 62.64 0.00 0.00 7973.96 3470.98 29709.65 00:29:54.609 0 00:29:54.609 17:05:40 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:54.609 17:05:40 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:54.609 17:05:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:54.609 17:05:40 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:54.609 | .driver_specific 00:29:54.609 | .nvme_error 00:29:54.609 | .status_code 00:29:54.609 | .command_transient_transport_error' 00:29:54.867 17:05:40 -- host/digest.sh@71 -- # (( 126 > 0 )) 00:29:54.867 17:05:40 -- host/digest.sh@73 -- # killprocess 1322524 00:29:54.867 17:05:40 -- common/autotest_common.sh@936 -- # '[' -z 1322524 ']' 00:29:54.867 17:05:40 -- common/autotest_common.sh@940 -- # kill -0 1322524 00:29:54.867 17:05:40 -- common/autotest_common.sh@941 -- # uname 00:29:54.867 17:05:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:54.867 17:05:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1322524 00:29:55.125 17:05:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:55.126 17:05:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:55.126 17:05:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1322524' 00:29:55.126 killing process with pid 1322524 00:29:55.126 17:05:40 -- common/autotest_common.sh@955 -- # kill 1322524 00:29:55.126 Received shutdown signal, test time was about 2.000000 seconds 00:29:55.126 00:29:55.126 Latency(us) 00:29:55.126 [2024-11-16T16:05:40.876Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:55.126 [2024-11-16T16:05:40.876Z] =================================================================================================================== 00:29:55.126 [2024-11-16T16:05:40.876Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:55.126 17:05:40 -- common/autotest_common.sh@960 -- # wait 1322524 00:29:55.126 17:05:40 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:55.126 17:05:40 -- host/digest.sh@54 -- # local rw bs qd 00:29:55.126 17:05:40 -- host/digest.sh@56 -- # rw=randread 00:29:55.126 17:05:40 -- host/digest.sh@56 -- # bs=131072 00:29:55.126 17:05:40 -- host/digest.sh@56 -- # qd=16 00:29:55.126 17:05:40 -- host/digest.sh@58 -- # bperfpid=1323021 00:29:55.126 17:05:40 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:55.126 17:05:40 -- host/digest.sh@60 -- # waitforlisten 1323021 /var/tmp/bperf.sock 00:29:55.126 17:05:40 -- common/autotest_common.sh@829 -- # '[' -z 1323021 ']' 00:29:55.126 17:05:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:55.126 17:05:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:55.126 17:05:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:55.126 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:55.126 17:05:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:55.126 17:05:40 -- common/autotest_common.sh@10 -- # set +x 00:29:55.384 [2024-11-16 17:05:40.893409] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:55.384 [2024-11-16 17:05:40.893496] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1323021 ] 00:29:55.384 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:55.384 Zero copy mechanism will not be used. 00:29:55.384 EAL: No free 2048 kB hugepages reported on node 1 00:29:55.384 [2024-11-16 17:05:40.955479] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:55.384 [2024-11-16 17:05:41.044473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:56.318 17:05:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:56.319 17:05:41 -- common/autotest_common.sh@862 -- # return 0 00:29:56.319 17:05:41 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:56.319 17:05:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:56.612 17:05:42 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:56.612 17:05:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:56.612 17:05:42 -- common/autotest_common.sh@10 -- # set +x 00:29:56.612 17:05:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:56.612 17:05:42 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:56.612 17:05:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:56.871 nvme0n1 00:29:56.871 17:05:42 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:56.871 17:05:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:56.871 17:05:42 -- common/autotest_common.sh@10 -- # set +x 00:29:56.871 17:05:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:56.871 17:05:42 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:56.871 17:05:42 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:56.871 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:56.871 Zero copy mechanism will not be used. 00:29:56.871 Running I/O for 2 seconds... 00:29:56.871 [2024-11-16 17:05:42.572585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:56.871 [2024-11-16 17:05:42.572652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.871 [2024-11-16 17:05:42.572691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.871 [2024-11-16 17:05:42.578369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:56.871 [2024-11-16 17:05:42.578407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.871 [2024-11-16 17:05:42.578428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.871 [2024-11-16 17:05:42.583652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:56.871 [2024-11-16 17:05:42.583700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.871 [2024-11-16 17:05:42.583718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.871 [2024-11-16 17:05:42.589611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:56.871 [2024-11-16 17:05:42.589649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.871 [2024-11-16 17:05:42.589668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.871 [2024-11-16 17:05:42.594152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:56.872 [2024-11-16 17:05:42.594184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.872 [2024-11-16 17:05:42.594201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.872 [2024-11-16 17:05:42.599497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:56.872 [2024-11-16 17:05:42.599534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.872 [2024-11-16 17:05:42.599554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.872 [2024-11-16 17:05:42.604596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:56.872 [2024-11-16 17:05:42.604640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.872 [2024-11-16 17:05:42.604661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.872 [2024-11-16 17:05:42.610459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:56.872 [2024-11-16 17:05:42.610491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.872 [2024-11-16 17:05:42.610509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.872 [2024-11-16 17:05:42.615139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:56.872 [2024-11-16 17:05:42.615175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.872 [2024-11-16 17:05:42.615203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.872 [2024-11-16 17:05:42.620632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:56.872 [2024-11-16 17:05:42.620665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.872 [2024-11-16 17:05:42.620682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.130 [2024-11-16 17:05:42.626422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.130 [2024-11-16 17:05:42.626453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.130 [2024-11-16 17:05:42.626471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.130 [2024-11-16 17:05:42.631868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.130 [2024-11-16 17:05:42.631898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.130 [2024-11-16 17:05:42.631915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.130 [2024-11-16 17:05:42.638063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.130 [2024-11-16 17:05:42.638099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.130 [2024-11-16 17:05:42.638119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.130 [2024-11-16 17:05:42.645559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.130 [2024-11-16 17:05:42.645594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.130 [2024-11-16 17:05:42.645624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.130 [2024-11-16 17:05:42.651665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.130 [2024-11-16 17:05:42.651712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.130 [2024-11-16 17:05:42.651730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.130 [2024-11-16 17:05:42.658134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.130 [2024-11-16 17:05:42.658191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.658214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.662663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.662694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.662712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.668394] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.668426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.668444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.675900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.675931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.675967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.682080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.682111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.682129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.687998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.688044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.688062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.693365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.693395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.693412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.699099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.699134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.699152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.705312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.705344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.705363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.712024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.712056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.712073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.718071] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.718104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.718128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.724258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.724290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.724308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.730226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.730258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.730276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.736549] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.736581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.736599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.742520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.742551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.742569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.748670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.748717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.748736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.755278] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.755309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.755326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.761529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.761560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.761577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.767862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.767906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.767925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.774320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.774366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.774387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.780671] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.780702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.780719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.787083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.787127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.787148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.793466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.793506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.793527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.799757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.799789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.799807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.806236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.806268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.806304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.812977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.813009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.813032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.819203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.131 [2024-11-16 17:05:42.819239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.131 [2024-11-16 17:05:42.819263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.131 [2024-11-16 17:05:42.827720] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.132 [2024-11-16 17:05:42.827751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.132 [2024-11-16 17:05:42.827769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.132 [2024-11-16 17:05:42.834533] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.132 [2024-11-16 17:05:42.834570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.132 [2024-11-16 17:05:42.834590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.132 [2024-11-16 17:05:42.841799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.132 [2024-11-16 17:05:42.841851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.132 [2024-11-16 17:05:42.841874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.132 [2024-11-16 17:05:42.848926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.132 [2024-11-16 17:05:42.848958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.132 [2024-11-16 17:05:42.848977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.132 [2024-11-16 17:05:42.856009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.132 [2024-11-16 17:05:42.856048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.132 [2024-11-16 17:05:42.856068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.132 [2024-11-16 17:05:42.863374] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.132 [2024-11-16 17:05:42.863423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.132 [2024-11-16 17:05:42.863443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.132 [2024-11-16 17:05:42.871150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.132 [2024-11-16 17:05:42.871187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.132 [2024-11-16 17:05:42.871206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.132 [2024-11-16 17:05:42.877641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.132 [2024-11-16 17:05:42.877670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.132 [2024-11-16 17:05:42.877703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.883379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.883412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.883435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.888807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.888838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.888867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.894575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.894626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.894650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.901205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.901241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.901266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.908623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.908673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.908694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.916265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.916301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.916321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.923640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.923690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.923708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.929875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.929921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.929941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.936415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.936451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.936471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.943373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.943423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.943443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.949875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.949927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.949950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.956527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.956564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.956584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.963287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.963323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.963344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.969728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.969759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.969778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.976311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.976344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.976364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.982115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.982150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.982170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.987774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.987810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.987830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:42.993479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:42.993515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:42.993536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:43.000741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:43.000772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:43.000789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:43.008027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:43.008063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:43.008089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:43.015928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:43.015964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:43.015984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:43.023427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:43.023458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:43.023482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:43.029689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.391 [2024-11-16 17:05:43.029720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.391 [2024-11-16 17:05:43.029737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.391 [2024-11-16 17:05:43.035057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.035089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.035117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.041056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.041092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.041112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.046441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.046493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.046519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.052368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.052404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.052425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.058985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.059022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.059056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.065694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.065727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.065746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.071213] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.071248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.071273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.077065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.077101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.077122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.082778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.082810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.082828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.088646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.088682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.088714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.094698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.094732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.094750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.100350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.100385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.100404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.106006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.106042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.106062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.111169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.111202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.111229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.116474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.116525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.116545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.121980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.122010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.122044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.127359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.127408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.127433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.133067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.133115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.133133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.392 [2024-11-16 17:05:43.138664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.392 [2024-11-16 17:05:43.138696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.392 [2024-11-16 17:05:43.138713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.144084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.144116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.144160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.149484] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.149517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.149545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.155095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.155126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.155170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.161556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.161587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.161631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.169099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.169146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.169166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.176728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.176773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.176790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.184090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.184127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.184148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.191546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.191582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.191606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.199030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.199066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.199086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.206444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.206493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.206514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.213980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.214010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.214028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.221279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.221329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.221347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.228554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.228587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.228605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.235989] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.236019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.236040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.243449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.243480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.243516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.250910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.250940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.250973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.258273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.258309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.258329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.265780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.265810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.265830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.273186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.273231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.273255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.279554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.279591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.279612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.287372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.287419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.287440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.294656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.294704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.294723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.302505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.302541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.302561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.310442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.310479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.310499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.318329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.318364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.318387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.326307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.326352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.326370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.334436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.334466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.334511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.714 [2024-11-16 17:05:43.342083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.714 [2024-11-16 17:05:43.342130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.714 [2024-11-16 17:05:43.342147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.350001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.350046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.350073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.357724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.357756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.357773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.364929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.364960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.364979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.372438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.372474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.372495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.379275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.379311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.379340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.385192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.385227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.385253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.391319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.391354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.391375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.397263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.397298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.397324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.402679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.402711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.402745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.408081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.408122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.408143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.414877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.414907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.414924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.421829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.421890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.421940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.427572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.427664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.427701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.433984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.434050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.434071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.439683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.439714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.439732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.446363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.446399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.446421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.453291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.453328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.453360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.715 [2024-11-16 17:05:43.460556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.715 [2024-11-16 17:05:43.460629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.715 [2024-11-16 17:05:43.460652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.975 [2024-11-16 17:05:43.466613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.975 [2024-11-16 17:05:43.466663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.975 [2024-11-16 17:05:43.466682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.975 [2024-11-16 17:05:43.472958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.975 [2024-11-16 17:05:43.473003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.975 [2024-11-16 17:05:43.473023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.975 [2024-11-16 17:05:43.479460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.975 [2024-11-16 17:05:43.479496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.975 [2024-11-16 17:05:43.479516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.975 [2024-11-16 17:05:43.486122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.975 [2024-11-16 17:05:43.486158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.975 [2024-11-16 17:05:43.486178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.975 [2024-11-16 17:05:43.492753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.975 [2024-11-16 17:05:43.492788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.975 [2024-11-16 17:05:43.492808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.975 [2024-11-16 17:05:43.498879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.975 [2024-11-16 17:05:43.498922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.975 [2024-11-16 17:05:43.498940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.975 [2024-11-16 17:05:43.505000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.975 [2024-11-16 17:05:43.505032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.975 [2024-11-16 17:05:43.505053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.975 [2024-11-16 17:05:43.511990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.975 [2024-11-16 17:05:43.512022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.975 [2024-11-16 17:05:43.512046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.975 [2024-11-16 17:05:43.518979] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.975 [2024-11-16 17:05:43.519025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.975 [2024-11-16 17:05:43.519052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.975 [2024-11-16 17:05:43.527071] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.975 [2024-11-16 17:05:43.527120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.975 [2024-11-16 17:05:43.527139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.975 [2024-11-16 17:05:43.533696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.975 [2024-11-16 17:05:43.533731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.975 [2024-11-16 17:05:43.533761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.975 [2024-11-16 17:05:43.540364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.975 [2024-11-16 17:05:43.540415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.975 [2024-11-16 17:05:43.540445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.975 [2024-11-16 17:05:43.546762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.975 [2024-11-16 17:05:43.546794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.975 [2024-11-16 17:05:43.546811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.553988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.554023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.554052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.560210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.560255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.560275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.566073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.566106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.566140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.571792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.571826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.571845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.577426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.577464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.577500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.583037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.583068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.583086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.588907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.588955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.588973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.594751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.594783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.594802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.601550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.601581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.601628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.608149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.608184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.608205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.614017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.614062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.614083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.619454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.619490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.619510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.625014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.625050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.625070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.630639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.630681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.630699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.636201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.636247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.636265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.642462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.642493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.642510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.648666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.648697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.648715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.654415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.654466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.654486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.659889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.659938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.659956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.665508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.665562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.665584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.671166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.671201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.671221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.676795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.676825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.676848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.682665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.682696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.682712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.688478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.688521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.688538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.693258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.693305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.693324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.698181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.698233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.698254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.976 [2024-11-16 17:05:43.703081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.976 [2024-11-16 17:05:43.703111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.976 [2024-11-16 17:05:43.703128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.977 [2024-11-16 17:05:43.708636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.977 [2024-11-16 17:05:43.708683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.977 [2024-11-16 17:05:43.708704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.977 [2024-11-16 17:05:43.715520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.977 [2024-11-16 17:05:43.715553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.977 [2024-11-16 17:05:43.715571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.977 [2024-11-16 17:05:43.722167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:57.977 [2024-11-16 17:05:43.722212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.977 [2024-11-16 17:05:43.722229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.727738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.727771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.727789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.733398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.733446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.733466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.738173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.738209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.738268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.742825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.742889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.742912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.748599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.748652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.748671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.753993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.754049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.754070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.760060] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.760110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.760130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.766183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.766214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.766232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.772063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.772112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.772135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.779334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.779366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.779384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.786800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.786831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.786849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.794393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.794429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.794449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.801955] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.802001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.802021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.809436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.809484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.809504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.816799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.816830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.816847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.237 [2024-11-16 17:05:43.824227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.237 [2024-11-16 17:05:43.824258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.237 [2024-11-16 17:05:43.824275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.831637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.831667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.831683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.839029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.839071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.839092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.846397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.846432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.846458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.853831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.853862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.853879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.861192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.861242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.861262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.868725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.868755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.868771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.876097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.876134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.876154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.883583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.883636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.883655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.890359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.890397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.890418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.897319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.897350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.897367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.904634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.904665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.904682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.910780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.910841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.910861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.916504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.916536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.916553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.922393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.922429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.922449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.928068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.928113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.928130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.933519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.933551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.933569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.940646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.940692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.940709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.947524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.947556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.947573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.953905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.953937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.953961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.960574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.960605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.960628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.967265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.967314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.967335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.972956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.972987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.973005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.978437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.978469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.978486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.238 [2024-11-16 17:05:43.983996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.238 [2024-11-16 17:05:43.984029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.238 [2024-11-16 17:05:43.984046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:43.989313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:43.989344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:43.989361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:43.994509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:43.994542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:43.994560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:43.999880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:43.999913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:43.999931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:44.005799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:44.005845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:44.005864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:44.012673] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:44.012718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:44.012735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:44.019660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:44.019691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:44.019708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:44.025672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:44.025705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:44.025737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:44.029751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:44.029782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:44.029798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:44.036399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:44.036436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:44.036457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:44.042885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:44.042935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:44.042956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:44.050075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:44.050112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:44.050132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:44.056808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:44.056840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:44.056858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:44.064030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:44.064066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:44.064087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:44.071122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:44.071157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:44.071177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:44.077711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:44.077742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.498 [2024-11-16 17:05:44.077758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.498 [2024-11-16 17:05:44.084653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.498 [2024-11-16 17:05:44.084700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.084717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.091427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.091463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.091483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.097748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.097778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.097796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.104648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.104697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.104713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.111350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.111387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.111407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.118159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.118207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.118237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.125564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.125600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.125628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.131237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.131274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.131294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.136838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.136868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.136885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.143330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.143366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.143385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.149186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.149222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.149243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.155703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.155735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.155767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.163088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.163125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.163145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.169007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.169053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.169073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.175183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.175225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.175246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.181304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.181340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.181360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.187411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.187447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.187467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.192856] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.192891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.192911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.198838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.198870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.198887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.203934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.203965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.203983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.208783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.208814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.208831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.214333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.214389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.214410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.220334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.220370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.220390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.227685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.227738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.227760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.233333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.233369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.233411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.239425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.239458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.239495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.499 [2024-11-16 17:05:44.245343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.499 [2024-11-16 17:05:44.245376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.499 [2024-11-16 17:05:44.245394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.251056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.251089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.251107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.256784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.256815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.256834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.262245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.262276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.262297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.267897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.267928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.267945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.275257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.275288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.275311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.280470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.280507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.280528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.286034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.286071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.286091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.292751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.292781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.292833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.299577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.299613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.299644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.305480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.305512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.305530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.311978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.312025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.312046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.319297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.319328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.319345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.325362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.325393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.325410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.332303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.332339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.332359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.337947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.337996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.338016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.343281] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.343313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.343347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.348699] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.348731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.348762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.354468] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.354517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.354537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.361749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.361780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.361798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.369238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.369289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.369309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.377281] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.377318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.377338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.385314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.385346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.385386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.392997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.393033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.393054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.401101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.401137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.401157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.407387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.407438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.407456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.760 [2024-11-16 17:05:44.413674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.760 [2024-11-16 17:05:44.413707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.760 [2024-11-16 17:05:44.413724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.761 [2024-11-16 17:05:44.420509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.761 [2024-11-16 17:05:44.420542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.761 [2024-11-16 17:05:44.420561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.761 [2024-11-16 17:05:44.427871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.761 [2024-11-16 17:05:44.427903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.761 [2024-11-16 17:05:44.427921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.761 [2024-11-16 17:05:44.435348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.761 [2024-11-16 17:05:44.435380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.761 [2024-11-16 17:05:44.435398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.761 [2024-11-16 17:05:44.442756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.761 [2024-11-16 17:05:44.442804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.761 [2024-11-16 17:05:44.442822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.761 [2024-11-16 17:05:44.450171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.761 [2024-11-16 17:05:44.450209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.761 [2024-11-16 17:05:44.450246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.761 [2024-11-16 17:05:44.457794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.761 [2024-11-16 17:05:44.457825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.761 [2024-11-16 17:05:44.457842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.761 [2024-11-16 17:05:44.465842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.761 [2024-11-16 17:05:44.465888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.761 [2024-11-16 17:05:44.465905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.761 [2024-11-16 17:05:44.472604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.761 [2024-11-16 17:05:44.472643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.761 [2024-11-16 17:05:44.472661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.761 [2024-11-16 17:05:44.478771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.761 [2024-11-16 17:05:44.478803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.761 [2024-11-16 17:05:44.478821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.761 [2024-11-16 17:05:44.485601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.761 [2024-11-16 17:05:44.485659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.761 [2024-11-16 17:05:44.485678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.761 [2024-11-16 17:05:44.491828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.761 [2024-11-16 17:05:44.491860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.761 [2024-11-16 17:05:44.491877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.761 [2024-11-16 17:05:44.497851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.761 [2024-11-16 17:05:44.497902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.761 [2024-11-16 17:05:44.497920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.761 [2024-11-16 17:05:44.503451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:58.761 [2024-11-16 17:05:44.503488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.761 [2024-11-16 17:05:44.503508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.020 [2024-11-16 17:05:44.509780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:59.020 [2024-11-16 17:05:44.509815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.020 [2024-11-16 17:05:44.509833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.020 [2024-11-16 17:05:44.516571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:59.020 [2024-11-16 17:05:44.516607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.020 [2024-11-16 17:05:44.516637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.020 [2024-11-16 17:05:44.522221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:59.020 [2024-11-16 17:05:44.522270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.020 [2024-11-16 17:05:44.522296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.020 [2024-11-16 17:05:44.527774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:59.020 [2024-11-16 17:05:44.527821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.020 [2024-11-16 17:05:44.527838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.020 [2024-11-16 17:05:44.533350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:59.020 [2024-11-16 17:05:44.533387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.020 [2024-11-16 17:05:44.533407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.020 [2024-11-16 17:05:44.539090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:59.020 [2024-11-16 17:05:44.539122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.020 [2024-11-16 17:05:44.539139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.020 [2024-11-16 17:05:44.544385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:59.020 [2024-11-16 17:05:44.544417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.020 [2024-11-16 17:05:44.544434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.020 [2024-11-16 17:05:44.550203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:59.020 [2024-11-16 17:05:44.550234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.020 [2024-11-16 17:05:44.550250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.020 [2024-11-16 17:05:44.557360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:59.020 [2024-11-16 17:05:44.557392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.021 [2024-11-16 17:05:44.557415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.021 [2024-11-16 17:05:44.564442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x81c2f0) 00:29:59.021 [2024-11-16 17:05:44.564473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.021 [2024-11-16 17:05:44.564490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.021 00:29:59.021 Latency(us) 00:29:59.021 [2024-11-16T16:05:44.771Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:59.021 [2024-11-16T16:05:44.771Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:59.021 nvme0n1 : 2.00 4842.42 605.30 0.00 0.00 3300.07 719.08 9466.31 00:29:59.021 [2024-11-16T16:05:44.771Z] =================================================================================================================== 00:29:59.021 [2024-11-16T16:05:44.771Z] Total : 4842.42 605.30 0.00 0.00 3300.07 719.08 9466.31 00:29:59.021 0 00:29:59.021 17:05:44 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:59.021 17:05:44 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:59.021 17:05:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:59.021 17:05:44 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:59.021 | .driver_specific 00:29:59.021 | .nvme_error 00:29:59.021 | .status_code 00:29:59.021 | .command_transient_transport_error' 00:29:59.279 17:05:44 -- host/digest.sh@71 -- # (( 312 > 0 )) 00:29:59.279 17:05:44 -- host/digest.sh@73 -- # killprocess 1323021 00:29:59.279 17:05:44 -- common/autotest_common.sh@936 -- # '[' -z 1323021 ']' 00:29:59.279 17:05:44 -- common/autotest_common.sh@940 -- # kill -0 1323021 00:29:59.279 17:05:44 -- common/autotest_common.sh@941 -- # uname 00:29:59.279 17:05:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:59.279 17:05:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1323021 00:29:59.279 17:05:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:59.279 17:05:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:59.279 17:05:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1323021' 00:29:59.279 killing process with pid 1323021 00:29:59.279 17:05:44 -- common/autotest_common.sh@955 -- # kill 1323021 00:29:59.279 Received shutdown signal, test time was about 2.000000 seconds 00:29:59.279 00:29:59.279 Latency(us) 00:29:59.279 [2024-11-16T16:05:45.029Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:59.279 [2024-11-16T16:05:45.029Z] =================================================================================================================== 00:29:59.279 [2024-11-16T16:05:45.029Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:59.279 17:05:44 -- common/autotest_common.sh@960 -- # wait 1323021 00:29:59.537 17:05:45 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:29:59.537 17:05:45 -- host/digest.sh@54 -- # local rw bs qd 00:29:59.537 17:05:45 -- host/digest.sh@56 -- # rw=randwrite 00:29:59.537 17:05:45 -- host/digest.sh@56 -- # bs=4096 00:29:59.537 17:05:45 -- host/digest.sh@56 -- # qd=128 00:29:59.537 17:05:45 -- host/digest.sh@58 -- # bperfpid=1323506 00:29:59.537 17:05:45 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:29:59.537 17:05:45 -- host/digest.sh@60 -- # waitforlisten 1323506 /var/tmp/bperf.sock 00:29:59.537 17:05:45 -- common/autotest_common.sh@829 -- # '[' -z 1323506 ']' 00:29:59.537 17:05:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:59.537 17:05:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:59.537 17:05:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:59.537 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:59.537 17:05:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:59.537 17:05:45 -- common/autotest_common.sh@10 -- # set +x 00:29:59.537 [2024-11-16 17:05:45.127491] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:59.537 [2024-11-16 17:05:45.127579] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1323506 ] 00:29:59.537 EAL: No free 2048 kB hugepages reported on node 1 00:29:59.537 [2024-11-16 17:05:45.184433] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:59.537 [2024-11-16 17:05:45.268509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:00.476 17:05:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:00.476 17:05:46 -- common/autotest_common.sh@862 -- # return 0 00:30:00.476 17:05:46 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:00.476 17:05:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:00.734 17:05:46 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:00.734 17:05:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:00.734 17:05:46 -- common/autotest_common.sh@10 -- # set +x 00:30:00.734 17:05:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.734 17:05:46 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:00.734 17:05:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:00.992 nvme0n1 00:30:00.992 17:05:46 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:00.992 17:05:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:00.992 17:05:46 -- common/autotest_common.sh@10 -- # set +x 00:30:00.992 17:05:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.992 17:05:46 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:00.992 17:05:46 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:01.252 Running I/O for 2 seconds... 00:30:01.252 [2024-11-16 17:05:46.837770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f6458 00:30:01.252 [2024-11-16 17:05:46.837969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:22305 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.252 [2024-11-16 17:05:46.838009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:002b p:0 m:0 dnr:0 00:30:01.252 [2024-11-16 17:05:46.850369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190edd58 00:30:01.252 [2024-11-16 17:05:46.851776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:24561 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.252 [2024-11-16 17:05:46.851809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:30:01.252 [2024-11-16 17:05:46.861633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ee5c8 00:30:01.252 [2024-11-16 17:05:46.862798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:23832 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.252 [2024-11-16 17:05:46.862830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:30:01.252 [2024-11-16 17:05:46.873974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e27f0 00:30:01.252 [2024-11-16 17:05:46.875662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:20337 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.252 [2024-11-16 17:05:46.875708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:30:01.252 [2024-11-16 17:05:46.885151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e5a90 00:30:01.253 [2024-11-16 17:05:46.886803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:2104 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.253 [2024-11-16 17:05:46.886838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:30:01.253 [2024-11-16 17:05:46.896373] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e1710 00:30:01.253 [2024-11-16 17:05:46.898046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:24291 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.253 [2024-11-16 17:05:46.898081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:30:01.253 [2024-11-16 17:05:46.907645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e6b70 00:30:01.253 [2024-11-16 17:05:46.909286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:9882 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.253 [2024-11-16 17:05:46.909321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:30:01.253 [2024-11-16 17:05:46.918838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e0630 00:30:01.253 [2024-11-16 17:05:46.920450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:15134 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.253 [2024-11-16 17:05:46.920484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:30:01.253 [2024-11-16 17:05:46.929959] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e7c50 00:30:01.253 [2024-11-16 17:05:46.931336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:13342 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.253 [2024-11-16 17:05:46.931367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.253 [2024-11-16 17:05:46.941441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e8088 00:30:01.253 [2024-11-16 17:05:46.942556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:19641 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.253 [2024-11-16 17:05:46.942585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:30:01.253 [2024-11-16 17:05:46.951854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e9168 00:30:01.253 [2024-11-16 17:05:46.952593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:4126 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.253 [2024-11-16 17:05:46.952643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:30:01.253 [2024-11-16 17:05:46.964215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190de038 00:30:01.253 [2024-11-16 17:05:46.965723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:4919 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.253 [2024-11-16 17:05:46.965753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:01.253 [2024-11-16 17:05:46.975962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e0a68 00:30:01.253 [2024-11-16 17:05:46.976638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14873 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.253 [2024-11-16 17:05:46.976689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:30:01.253 [2024-11-16 17:05:46.987362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e5658 00:30:01.253 [2024-11-16 17:05:46.988038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:20289 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.253 [2024-11-16 17:05:46.988069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:01.253 [2024-11-16 17:05:46.998796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f0ff8 00:30:01.253 [2024-11-16 17:05:46.999429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:10597 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.253 [2024-11-16 17:05:46.999460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:30:01.514 [2024-11-16 17:05:47.010139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e5ec8 00:30:01.514 [2024-11-16 17:05:47.010796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:21448 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.514 [2024-11-16 17:05:47.010827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:30:01.514 [2024-11-16 17:05:47.021605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e1f80 00:30:01.514 [2024-11-16 17:05:47.022242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:12255 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.514 [2024-11-16 17:05:47.022273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:30:01.514 [2024-11-16 17:05:47.032871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f0788 00:30:01.514 [2024-11-16 17:05:47.033365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:9790 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.514 [2024-11-16 17:05:47.033395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:30:01.514 [2024-11-16 17:05:47.043939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e2c28 00:30:01.514 [2024-11-16 17:05:47.044467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:10140 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.514 [2024-11-16 17:05:47.044513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:30:01.514 [2024-11-16 17:05:47.055234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f1430 00:30:01.514 [2024-11-16 17:05:47.055775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:18888 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.514 [2024-11-16 17:05:47.055805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:30:01.514 [2024-11-16 17:05:47.066234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e4140 00:30:01.514 [2024-11-16 17:05:47.066986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:9109 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.514 [2024-11-16 17:05:47.067018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:30:01.514 [2024-11-16 17:05:47.078379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e1b48 00:30:01.514 [2024-11-16 17:05:47.079044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:23908 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.514 [2024-11-16 17:05:47.079074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:30:01.514 [2024-11-16 17:05:47.090299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e4de8 00:30:01.514 [2024-11-16 17:05:47.091286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:4958 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.514 [2024-11-16 17:05:47.091317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.514 [2024-11-16 17:05:47.101317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ee190 00:30:01.514 [2024-11-16 17:05:47.102651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:6434 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.514 [2024-11-16 17:05:47.102682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.514 [2024-11-16 17:05:47.112596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e9e10 00:30:01.514 [2024-11-16 17:05:47.114387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:13776 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.514 [2024-11-16 17:05:47.114419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:30:01.514 [2024-11-16 17:05:47.124000] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ebb98 00:30:01.514 [2024-11-16 17:05:47.125182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:12881 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.514 [2024-11-16 17:05:47.125210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:30:01.514 [2024-11-16 17:05:47.135682] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e6b70 00:30:01.514 [2024-11-16 17:05:47.137116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:9915 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.514 [2024-11-16 17:05:47.137160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:30:01.514 [2024-11-16 17:05:47.147826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f1430 00:30:01.514 [2024-11-16 17:05:47.149721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:18095 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.514 [2024-11-16 17:05:47.149752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.515 [2024-11-16 17:05:47.158643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ff3c8 00:30:01.515 [2024-11-16 17:05:47.159577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:17302 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.515 [2024-11-16 17:05:47.159606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:30:01.515 [2024-11-16 17:05:47.169640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f6cc8 00:30:01.515 [2024-11-16 17:05:47.170958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:11929 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.515 [2024-11-16 17:05:47.170989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:30:01.515 [2024-11-16 17:05:47.180426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f7538 00:30:01.515 [2024-11-16 17:05:47.181799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:19248 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.515 [2024-11-16 17:05:47.181829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:30:01.515 [2024-11-16 17:05:47.191526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f7da8 00:30:01.515 [2024-11-16 17:05:47.192718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:5688 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.515 [2024-11-16 17:05:47.192749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:30:01.515 [2024-11-16 17:05:47.205208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f3e60 00:30:01.515 [2024-11-16 17:05:47.206241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:4189 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.515 [2024-11-16 17:05:47.206270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:01.515 [2024-11-16 17:05:47.213488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f57b0 00:30:01.515 [2024-11-16 17:05:47.213657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:443 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.515 [2024-11-16 17:05:47.213699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:000a p:0 m:0 dnr:0 00:30:01.515 [2024-11-16 17:05:47.227640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ec840 00:30:01.515 [2024-11-16 17:05:47.228415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:16298 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.515 [2024-11-16 17:05:47.228444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:30:01.515 [2024-11-16 17:05:47.238220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190fc128 00:30:01.515 [2024-11-16 17:05:47.239547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:23673 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.515 [2024-11-16 17:05:47.239577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:30:01.515 [2024-11-16 17:05:47.249800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e1b48 00:30:01.515 [2024-11-16 17:05:47.250331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:8202 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.515 [2024-11-16 17:05:47.250359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0031 p:0 m:0 dnr:0 00:30:01.515 [2024-11-16 17:05:47.262335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e5a90 00:30:01.515 [2024-11-16 17:05:47.263046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:5930 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.515 [2024-11-16 17:05:47.263077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:30:01.775 [2024-11-16 17:05:47.272833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e27f0 00:30:01.775 [2024-11-16 17:05:47.274159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8838 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.775 [2024-11-16 17:05:47.274197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:30:01.775 [2024-11-16 17:05:47.284547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e27f0 00:30:01.775 [2024-11-16 17:05:47.285707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.775 [2024-11-16 17:05:47.285737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:30:01.775 [2024-11-16 17:05:47.295602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ed920 00:30:01.775 [2024-11-16 17:05:47.296962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:4337 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.775 [2024-11-16 17:05:47.296992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.775 [2024-11-16 17:05:47.309151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f0788 00:30:01.775 [2024-11-16 17:05:47.310066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:14407 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.775 [2024-11-16 17:05:47.310094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:30:01.775 [2024-11-16 17:05:47.319318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f5378 00:30:01.775 [2024-11-16 17:05:47.321044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:18323 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.775 [2024-11-16 17:05:47.321077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:30:01.775 [2024-11-16 17:05:47.330376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190eee38 00:30:01.775 [2024-11-16 17:05:47.331310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:12464 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.775 [2024-11-16 17:05:47.331339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:30:01.775 [2024-11-16 17:05:47.341684] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ec408 00:30:01.775 [2024-11-16 17:05:47.342719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:15835 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.342748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.354310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f2510 00:30:01.776 [2024-11-16 17:05:47.355036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:16997 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.355066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.365183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f6cc8 00:30:01.776 [2024-11-16 17:05:47.366264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:5646 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.366295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.376459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ed0b0 00:30:01.776 [2024-11-16 17:05:47.377515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:10955 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.377545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.386712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ed0b0 00:30:01.776 [2024-11-16 17:05:47.387869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:12282 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.387899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.400428] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e5658 00:30:01.776 [2024-11-16 17:05:47.401426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:4292 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.401455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.410536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e12d8 00:30:01.776 [2024-11-16 17:05:47.411474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:17060 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.411519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.423491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f8618 00:30:01.776 [2024-11-16 17:05:47.424734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:994 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.424769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.432759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190fbcf0 00:30:01.776 [2024-11-16 17:05:47.433778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:1270 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.433822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.444137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e6fa8 00:30:01.776 [2024-11-16 17:05:47.445461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:662 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.445508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.455876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ebfd0 00:30:01.776 [2024-11-16 17:05:47.457323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:370 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.457357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.467947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f2d80 00:30:01.776 [2024-11-16 17:05:47.468773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:1887 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.468802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.479845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ed920 00:30:01.776 [2024-11-16 17:05:47.480868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:4323 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.480913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.491709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190fc998 00:30:01.776 [2024-11-16 17:05:47.493131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:18684 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.493175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.503924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ef6a8 00:30:01.776 [2024-11-16 17:05:47.504707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:22535 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.504737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:30:01.776 [2024-11-16 17:05:47.515365] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e12d8 00:30:01.776 [2024-11-16 17:05:47.516859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:21915 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.776 [2024-11-16 17:05:47.516890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.527388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f4298 00:30:02.037 [2024-11-16 17:05:47.528167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:17479 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.528198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.538428] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f81e0 00:30:02.037 [2024-11-16 17:05:47.539462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:17672 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.539492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.549717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190de470 00:30:02.037 [2024-11-16 17:05:47.550860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:21343 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.550909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0029 p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.562789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e23b8 00:30:02.037 [2024-11-16 17:05:47.564038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:2528 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.564069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.575976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ea680 00:30:02.037 [2024-11-16 17:05:47.577803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:14871 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.577839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.587832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e6b70 00:30:02.037 [2024-11-16 17:05:47.589382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:20923 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.589412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.599764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190fef90 00:30:02.037 [2024-11-16 17:05:47.600458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:10730 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.600502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.611930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190fb480 00:30:02.037 [2024-11-16 17:05:47.612646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:14438 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.612676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.624087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190fe720 00:30:02.037 [2024-11-16 17:05:47.624727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:18873 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.624756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.636214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e38d0 00:30:02.037 [2024-11-16 17:05:47.636788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:7688 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.636821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.648474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ef6a8 00:30:02.037 [2024-11-16 17:05:47.649126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:386 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.649160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.660755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190fe2e8 00:30:02.037 [2024-11-16 17:05:47.661366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:22616 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.661395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.672723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e95a0 00:30:02.037 [2024-11-16 17:05:47.673321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:16644 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.673349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.684519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f6cc8 00:30:02.037 [2024-11-16 17:05:47.685187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:18127 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.685216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.694827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e12d8 00:30:02.037 [2024-11-16 17:05:47.695111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:20855 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.695144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0013 p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.709892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190e3498 00:30:02.037 [2024-11-16 17:05:47.710899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:8656 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.710942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.721454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190f31b8 00:30:02.037 [2024-11-16 17:05:47.722979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:2619 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.723010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:30:02.037 [2024-11-16 17:05:47.733755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190eea00 00:30:02.037 [2024-11-16 17:05:47.734461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:9441 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.037 [2024-11-16 17:05:47.734493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:003a p:0 m:0 dnr:0 00:30:02.038 [2024-11-16 17:05:47.746794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.038 [2024-11-16 17:05:47.747135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:3205 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.038 [2024-11-16 17:05:47.747165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.038 [2024-11-16 17:05:47.760130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.038 [2024-11-16 17:05:47.760495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:12245 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.038 [2024-11-16 17:05:47.760525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.038 [2024-11-16 17:05:47.773735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.038 [2024-11-16 17:05:47.774061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:10772 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.038 [2024-11-16 17:05:47.774092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.298 [2024-11-16 17:05:47.787532] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.298 [2024-11-16 17:05:47.787833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:13056 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.298 [2024-11-16 17:05:47.787862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.298 [2024-11-16 17:05:47.801058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.298 [2024-11-16 17:05:47.801423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:15067 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.298 [2024-11-16 17:05:47.801475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.298 [2024-11-16 17:05:47.814701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.298 [2024-11-16 17:05:47.815023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:5732 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.298 [2024-11-16 17:05:47.815057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.298 [2024-11-16 17:05:47.828288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.298 [2024-11-16 17:05:47.828668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:1461 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.298 [2024-11-16 17:05:47.828700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.298 [2024-11-16 17:05:47.841607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.298 [2024-11-16 17:05:47.841923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:8159 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.298 [2024-11-16 17:05:47.841951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.298 [2024-11-16 17:05:47.855270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.298 [2024-11-16 17:05:47.855599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:22549 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.298 [2024-11-16 17:05:47.855634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.298 [2024-11-16 17:05:47.868760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.298 [2024-11-16 17:05:47.869092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:23651 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.298 [2024-11-16 17:05:47.869127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.298 [2024-11-16 17:05:47.882072] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.298 [2024-11-16 17:05:47.882424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:3252 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.298 [2024-11-16 17:05:47.882453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.298 [2024-11-16 17:05:47.895696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.298 [2024-11-16 17:05:47.896090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21534 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.298 [2024-11-16 17:05:47.896120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.298 [2024-11-16 17:05:47.908994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.298 [2024-11-16 17:05:47.909337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:23874 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.298 [2024-11-16 17:05:47.909373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.298 [2024-11-16 17:05:47.922284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.298 [2024-11-16 17:05:47.922627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:14766 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.298 [2024-11-16 17:05:47.922656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.298 [2024-11-16 17:05:47.935559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.298 [2024-11-16 17:05:47.935892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:13079 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.298 [2024-11-16 17:05:47.935923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.299 [2024-11-16 17:05:47.948877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.299 [2024-11-16 17:05:47.949207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:10319 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.299 [2024-11-16 17:05:47.949237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.299 [2024-11-16 17:05:47.962083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.299 [2024-11-16 17:05:47.962412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:23262 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.299 [2024-11-16 17:05:47.962442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.299 [2024-11-16 17:05:47.975339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.299 [2024-11-16 17:05:47.975684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:22797 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.299 [2024-11-16 17:05:47.975714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.299 [2024-11-16 17:05:47.988561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.299 [2024-11-16 17:05:47.988874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:4944 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.299 [2024-11-16 17:05:47.988904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.299 [2024-11-16 17:05:48.001817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.299 [2024-11-16 17:05:48.002150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:24307 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.299 [2024-11-16 17:05:48.002180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.299 [2024-11-16 17:05:48.015199] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.299 [2024-11-16 17:05:48.015528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:1752 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.299 [2024-11-16 17:05:48.015556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.299 [2024-11-16 17:05:48.028511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.299 [2024-11-16 17:05:48.028875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:1595 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.299 [2024-11-16 17:05:48.028904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.299 [2024-11-16 17:05:48.041715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.299 [2024-11-16 17:05:48.042135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:15433 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.299 [2024-11-16 17:05:48.042165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.055418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.055767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:13948 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.055796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.068987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.069316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:23181 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.069345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.082399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.082736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19424 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.082766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.095920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.096292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:12116 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.096320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.109238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.109569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:9036 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.109598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.122757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.123115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:2249 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.123145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.136204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.136541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:14742 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.136587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.149708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.150051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:16954 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.150081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.163271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.163585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:25011 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.163622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.176716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.177054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:19403 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.177085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.190243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.190560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:6631 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.190591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.203402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.203775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:301 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.203808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.216930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.217249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:14323 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.217280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.230287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.230608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:833 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.230665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.243517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.243820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:8267 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.243850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.256901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.257268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:8405 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.257303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.270252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.270585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18495 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.270642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.283594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.284018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:12872 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.284047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.560 [2024-11-16 17:05:48.296958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.560 [2024-11-16 17:05:48.297328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:7982 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.560 [2024-11-16 17:05:48.297358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.310281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.310604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:15429 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.310643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.323582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.323929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:3767 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.323959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.337084] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.337495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:24941 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.337524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.350384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.350761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:24039 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.350790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.364011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.364345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:9988 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.364373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.377634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.377974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:11116 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.378003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.391121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.391456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:9388 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.391486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.404574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.404898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:5826 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.404928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.417881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.418215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:21257 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.418244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.431302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.431595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:12386 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.431632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.444639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.444968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:374 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.445002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.458164] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.458525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14582 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.458555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.471919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.472248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:3767 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.472278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.485653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.485967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:2952 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.485996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.498902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.499241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:17574 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.499270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.512363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.512675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:17071 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.512705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.525686] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.526043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:6885 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.526071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.820 [2024-11-16 17:05:48.539094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.820 [2024-11-16 17:05:48.539446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:20672 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.820 [2024-11-16 17:05:48.539475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.821 [2024-11-16 17:05:48.552537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.821 [2024-11-16 17:05:48.552912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.821 [2024-11-16 17:05:48.552941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.821 [2024-11-16 17:05:48.565763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:02.821 [2024-11-16 17:05:48.566119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:25347 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.821 [2024-11-16 17:05:48.566147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.579368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.579718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:19671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.579747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.592864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.593225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:17373 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.593253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.606131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.606540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:22241 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.606577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.619505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.619823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:23551 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.619852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.633034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.633477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:6213 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.633525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.646640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.646967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3742 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.646996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.660196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.660508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:1750 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.660537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.673309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.673661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:10395 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.673690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.686853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.687219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:21842 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.687260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.700996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.701300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:2743 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.701333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.714846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.715146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:23305 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.715174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.728491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.728862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:12992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.728893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.742152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.742493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:1684 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.742522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.755957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.756284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:4039 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.756313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.769377] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.769704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:6022 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.769733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.783130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.783462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:12617 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.783490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.796948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.797266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:24338 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.797295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.810606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.810937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:22882 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.810966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.080 [2024-11-16 17:05:48.823931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226920) with pdu=0x2000190ddc00 00:30:03.080 [2024-11-16 17:05:48.824314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:14281 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.080 [2024-11-16 17:05:48.824352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.339 00:30:03.339 Latency(us) 00:30:03.339 [2024-11-16T16:05:49.089Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:03.339 [2024-11-16T16:05:49.089Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:30:03.339 nvme0n1 : 2.01 20285.57 79.24 0.00 0.00 6296.11 2815.62 14369.37 00:30:03.339 [2024-11-16T16:05:49.089Z] =================================================================================================================== 00:30:03.339 [2024-11-16T16:05:49.089Z] Total : 20285.57 79.24 0.00 0.00 6296.11 2815.62 14369.37 00:30:03.339 0 00:30:03.339 17:05:48 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:03.339 17:05:48 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:03.339 17:05:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:03.339 17:05:48 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:03.339 | .driver_specific 00:30:03.339 | .nvme_error 00:30:03.339 | .status_code 00:30:03.339 | .command_transient_transport_error' 00:30:03.596 17:05:49 -- host/digest.sh@71 -- # (( 159 > 0 )) 00:30:03.596 17:05:49 -- host/digest.sh@73 -- # killprocess 1323506 00:30:03.596 17:05:49 -- common/autotest_common.sh@936 -- # '[' -z 1323506 ']' 00:30:03.596 17:05:49 -- common/autotest_common.sh@940 -- # kill -0 1323506 00:30:03.596 17:05:49 -- common/autotest_common.sh@941 -- # uname 00:30:03.597 17:05:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:03.597 17:05:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1323506 00:30:03.597 17:05:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:03.597 17:05:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:03.597 17:05:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1323506' 00:30:03.597 killing process with pid 1323506 00:30:03.597 17:05:49 -- common/autotest_common.sh@955 -- # kill 1323506 00:30:03.597 Received shutdown signal, test time was about 2.000000 seconds 00:30:03.597 00:30:03.597 Latency(us) 00:30:03.597 [2024-11-16T16:05:49.347Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:03.597 [2024-11-16T16:05:49.347Z] =================================================================================================================== 00:30:03.597 [2024-11-16T16:05:49.347Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:03.597 17:05:49 -- common/autotest_common.sh@960 -- # wait 1323506 00:30:03.597 17:05:49 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:30:03.597 17:05:49 -- host/digest.sh@54 -- # local rw bs qd 00:30:03.597 17:05:49 -- host/digest.sh@56 -- # rw=randwrite 00:30:03.597 17:05:49 -- host/digest.sh@56 -- # bs=131072 00:30:03.597 17:05:49 -- host/digest.sh@56 -- # qd=16 00:30:03.597 17:05:49 -- host/digest.sh@58 -- # bperfpid=1324057 00:30:03.597 17:05:49 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:30:03.597 17:05:49 -- host/digest.sh@60 -- # waitforlisten 1324057 /var/tmp/bperf.sock 00:30:03.597 17:05:49 -- common/autotest_common.sh@829 -- # '[' -z 1324057 ']' 00:30:03.597 17:05:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:03.597 17:05:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:03.597 17:05:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:03.597 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:03.597 17:05:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:03.597 17:05:49 -- common/autotest_common.sh@10 -- # set +x 00:30:03.855 [2024-11-16 17:05:49.380449] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:03.855 [2024-11-16 17:05:49.380518] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1324057 ] 00:30:03.855 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:03.855 Zero copy mechanism will not be used. 00:30:03.855 EAL: No free 2048 kB hugepages reported on node 1 00:30:03.855 [2024-11-16 17:05:49.438869] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:03.855 [2024-11-16 17:05:49.527198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:04.790 17:05:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:04.790 17:05:50 -- common/autotest_common.sh@862 -- # return 0 00:30:04.790 17:05:50 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:04.790 17:05:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:05.048 17:05:50 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:05.048 17:05:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:05.048 17:05:50 -- common/autotest_common.sh@10 -- # set +x 00:30:05.048 17:05:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:05.048 17:05:50 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:05.048 17:05:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:05.617 nvme0n1 00:30:05.617 17:05:51 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:05.617 17:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:05.617 17:05:51 -- common/autotest_common.sh@10 -- # set +x 00:30:05.617 17:05:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:05.617 17:05:51 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:05.617 17:05:51 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:05.617 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:05.617 Zero copy mechanism will not be used. 00:30:05.617 Running I/O for 2 seconds... 00:30:05.617 [2024-11-16 17:05:51.250603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.617 [2024-11-16 17:05:51.250873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.617 [2024-11-16 17:05:51.250916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.617 [2024-11-16 17:05:51.255265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.617 [2024-11-16 17:05:51.255437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.617 [2024-11-16 17:05:51.255472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.617 [2024-11-16 17:05:51.259923] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.617 [2024-11-16 17:05:51.260118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.617 [2024-11-16 17:05:51.260157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.617 [2024-11-16 17:05:51.264966] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.617 [2024-11-16 17:05:51.265109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.617 [2024-11-16 17:05:51.265141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.617 [2024-11-16 17:05:51.270245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.270430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.270462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.275316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.275483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.275531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.280423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.280630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.280665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.285641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.285933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.285968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.290856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.291169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.291208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.295988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.296276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.296310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.301080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.301278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.301309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.306183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.306347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.306378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.311287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.311452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.311483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.316360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.316562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.316593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.321404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.321603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.321644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.326206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.326477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.326513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.331445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.331743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.331774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.337324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.337485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.337517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.342995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.343115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.343158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.347671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.347826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.347854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.352292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.352455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.352491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.357668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.357761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.357790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.618 [2024-11-16 17:05:51.362976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.618 [2024-11-16 17:05:51.363146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.618 [2024-11-16 17:05:51.363177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.880 [2024-11-16 17:05:51.367847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.880 [2024-11-16 17:05:51.368072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.880 [2024-11-16 17:05:51.368107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.880 [2024-11-16 17:05:51.372740] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.880 [2024-11-16 17:05:51.372955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.880 [2024-11-16 17:05:51.372987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.880 [2024-11-16 17:05:51.377675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.880 [2024-11-16 17:05:51.377855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.880 [2024-11-16 17:05:51.377883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.880 [2024-11-16 17:05:51.382328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.880 [2024-11-16 17:05:51.382487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.880 [2024-11-16 17:05:51.382518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.880 [2024-11-16 17:05:51.387250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.880 [2024-11-16 17:05:51.387410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.880 [2024-11-16 17:05:51.387438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.880 [2024-11-16 17:05:51.392101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.880 [2024-11-16 17:05:51.392245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.880 [2024-11-16 17:05:51.392281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.880 [2024-11-16 17:05:51.396781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.880 [2024-11-16 17:05:51.396911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.880 [2024-11-16 17:05:51.396956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.880 [2024-11-16 17:05:51.401422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.880 [2024-11-16 17:05:51.401569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.880 [2024-11-16 17:05:51.401599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.880 [2024-11-16 17:05:51.406156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.406363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.406401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.411311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.411529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.411562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.416929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.417144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.417176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.422214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.422373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.422404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.428713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.428870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.428900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.434115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.434408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.434442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.439409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.439558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.439591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.444485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.444651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.444707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.449792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.450042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.450075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.455074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.455342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.455376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.460543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.460788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.460819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.466078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.466356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.466396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.471478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.471764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.471802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.476543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.476799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.476831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.482273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.482493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.482526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.488029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.488214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.488245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.493496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.493686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.493720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.498747] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.498883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.498911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.504244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.504447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.504480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.509741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.510006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.510041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.515220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.515572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.515607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.520689] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.520904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.520952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.526133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.526326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.526357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.531788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.531956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.531989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.537273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.537391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.537423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.542544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.542727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.542757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.547808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.881 [2024-11-16 17:05:51.547969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.881 [2024-11-16 17:05:51.548002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.881 [2024-11-16 17:05:51.553585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.553736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.553766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.882 [2024-11-16 17:05:51.559792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.560050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.560085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.882 [2024-11-16 17:05:51.566360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.566492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.566531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.882 [2024-11-16 17:05:51.571078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.571193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.571243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.882 [2024-11-16 17:05:51.575703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.575855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.575884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.882 [2024-11-16 17:05:51.580688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.580815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.580843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.882 [2024-11-16 17:05:51.586065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.586179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.586218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.882 [2024-11-16 17:05:51.590712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.590858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.590885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.882 [2024-11-16 17:05:51.596155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.596442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.596477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.882 [2024-11-16 17:05:51.601228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.601391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.601424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.882 [2024-11-16 17:05:51.606164] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.606330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.606368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.882 [2024-11-16 17:05:51.611400] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.611525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.611555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.882 [2024-11-16 17:05:51.616848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.617025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.617060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.882 [2024-11-16 17:05:51.622435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.622571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.622610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.882 [2024-11-16 17:05:51.628190] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:05.882 [2024-11-16 17:05:51.628444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.882 [2024-11-16 17:05:51.628478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.634055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.634233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.634264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.639824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.640081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.640122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.646284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.646492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.646523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.652102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.652224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.652255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.657565] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.657745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.657778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.662996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.663165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.663196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.668441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.668707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.668748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.673517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.673716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.673748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.678863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.679147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.679189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.685352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.685485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.685522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.690085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.690213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.690245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.694793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.694964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.695000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.699391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.699482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.699514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.704109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.704263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.704294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.708805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.709021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.709062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.713316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.713503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.713540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.718004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.144 [2024-11-16 17:05:51.718234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.144 [2024-11-16 17:05:51.718269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.144 [2024-11-16 17:05:51.722605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.722787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.722816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.727218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.727349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.727387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.731880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.732114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.732158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.736528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.736680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.736709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.741343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.741464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.741495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.747160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.747341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.747376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.751686] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.751877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.751905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.756308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.756539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.756571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.760986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.761155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.761189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.766053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.766243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.766274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.771404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.771571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.771613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.777600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.777859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.777890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.782493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.782665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.782709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.787226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.787442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.787487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.791849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.792048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.792079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.796567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.796790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.796832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.801294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.801421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.801452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.805866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.805987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.806022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.810451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.810592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.810638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.815090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.815264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.815300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.819851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.819989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.820020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.824672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.824892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.824922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.829220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.829462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.829495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.833897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.834163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.834196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.839091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.839304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.839335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.844460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.844675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.844704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.850668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.850761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.145 [2024-11-16 17:05:51.850794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.145 [2024-11-16 17:05:51.855265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.145 [2024-11-16 17:05:51.855381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.146 [2024-11-16 17:05:51.855418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.146 [2024-11-16 17:05:51.859891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.146 [2024-11-16 17:05:51.860060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.146 [2024-11-16 17:05:51.860092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.146 [2024-11-16 17:05:51.864567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.146 [2024-11-16 17:05:51.864704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.146 [2024-11-16 17:05:51.864733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.146 [2024-11-16 17:05:51.869411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.146 [2024-11-16 17:05:51.869613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.146 [2024-11-16 17:05:51.869653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.146 [2024-11-16 17:05:51.874137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.146 [2024-11-16 17:05:51.874353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.146 [2024-11-16 17:05:51.874388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.146 [2024-11-16 17:05:51.879058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.146 [2024-11-16 17:05:51.879276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.146 [2024-11-16 17:05:51.879325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.146 [2024-11-16 17:05:51.884196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.146 [2024-11-16 17:05:51.884340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.146 [2024-11-16 17:05:51.884376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.146 [2024-11-16 17:05:51.889017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.146 [2024-11-16 17:05:51.889158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.146 [2024-11-16 17:05:51.889194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.406 [2024-11-16 17:05:51.894420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.406 [2024-11-16 17:05:51.894712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.406 [2024-11-16 17:05:51.894744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.406 [2024-11-16 17:05:51.899502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.406 [2024-11-16 17:05:51.899806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.406 [2024-11-16 17:05:51.899844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.406 [2024-11-16 17:05:51.904741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.406 [2024-11-16 17:05:51.905038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.406 [2024-11-16 17:05:51.905073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.406 [2024-11-16 17:05:51.910038] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.406 [2024-11-16 17:05:51.910354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.406 [2024-11-16 17:05:51.910392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.406 [2024-11-16 17:05:51.915123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.406 [2024-11-16 17:05:51.915390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.406 [2024-11-16 17:05:51.915425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.406 [2024-11-16 17:05:51.920116] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.406 [2024-11-16 17:05:51.920308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.406 [2024-11-16 17:05:51.920339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.406 [2024-11-16 17:05:51.924835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.406 [2024-11-16 17:05:51.925051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.925083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:51.929776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:51.930011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.930050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:51.934828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:51.934945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.934997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:51.939894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:51.940200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.940234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:51.945034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:51.945276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.945310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:51.950022] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:51.950185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.950223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:51.955092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:51.955320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.955354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:51.960073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:51.960233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.960265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:51.965263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:51.965450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.965481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:51.970302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:51.970544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.970579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:51.975376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:51.975551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.975582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:51.980490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:51.980659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.980704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:51.985757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:51.985922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.985965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:51.990790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:51.990975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.991005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:51.995845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:51.996083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:51.996116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:52.000837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:52.001102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:52.001136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:52.005877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:52.006035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:52.006066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:52.010950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:52.011148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:52.011179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:52.015944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:52.016094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:52.016126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:52.021186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:52.021382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:52.021413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:52.026217] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:52.026464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:52.026498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:52.031331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:52.031581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:52.031624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:52.036367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:52.036580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:52.036634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:52.041319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:52.041518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:52.041549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:52.046485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:52.046692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:52.046720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:52.051650] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:52.051825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:52.051854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:52.056689] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:52.056857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.407 [2024-11-16 17:05:52.056885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.407 [2024-11-16 17:05:52.061831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.407 [2024-11-16 17:05:52.062063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.062096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.066915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.067108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.067140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.072051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.072336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.072370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.077030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.077245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.077277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.082040] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.082236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.082267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.087227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.087427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.087458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.092287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.092474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.092506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.097329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.097501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.097531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.102400] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.102687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.102719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.107417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.107597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.107639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.112452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.112635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.112668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.117743] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.117986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.118027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.122704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.122880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.122935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.127794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.128073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.128107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.132825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.132998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.133037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.137850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.138018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.138051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.142891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.143182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.143217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.148006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.148272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.148306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.408 [2024-11-16 17:05:52.153046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.408 [2024-11-16 17:05:52.153258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.408 [2024-11-16 17:05:52.153291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.158170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.158420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.158454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.163154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.163318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.163350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.168165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.168352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.168384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.173265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.173435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.173468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.178334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.178509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.178542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.183610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.183964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.184005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.189317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.189484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.189516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.195895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.195999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.196044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.201253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.201436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.201475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.205873] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.205999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.206032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.210581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.210728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.210763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.215278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.215432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.215464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.219861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.220065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.220099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.225011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.225323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.225356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.230199] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.230429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.230462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.235147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.235361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.235394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.240329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.240566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.240599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.246121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.668 [2024-11-16 17:05:52.246254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.668 [2024-11-16 17:05:52.246285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.668 [2024-11-16 17:05:52.251644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.251768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.251800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.256208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.256407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.256439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.260835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.261007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.261040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.265458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.265667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.265696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.270153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.270318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.270348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.274709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.274878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.274908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.279311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.279462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.279514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.284132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.284261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.284294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.288685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.288813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.288841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.293685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.293984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.294017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.298804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.299022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.299056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.304281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.304452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.304484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.309964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.310115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.310148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.315216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.315385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.315417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.320501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.320774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.320811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.326299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.326455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.326493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.331890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.332062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.332096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.337065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.337230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.337268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.342401] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.342640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.342673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.347486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.347658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.347705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.352706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.352869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.352899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.357953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.358217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.358250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.363257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.363388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.363421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.368338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.368465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.368498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.373592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.373826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.373857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.378768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.378940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.378973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.669 [2024-11-16 17:05:52.384018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.669 [2024-11-16 17:05:52.384232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.669 [2024-11-16 17:05:52.384265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.670 [2024-11-16 17:05:52.389171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.670 [2024-11-16 17:05:52.389307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.670 [2024-11-16 17:05:52.389339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.670 [2024-11-16 17:05:52.394365] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.670 [2024-11-16 17:05:52.394513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.670 [2024-11-16 17:05:52.394545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.670 [2024-11-16 17:05:52.399599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.670 [2024-11-16 17:05:52.399821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.670 [2024-11-16 17:05:52.399850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.670 [2024-11-16 17:05:52.404769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.670 [2024-11-16 17:05:52.404930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.670 [2024-11-16 17:05:52.404973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.670 [2024-11-16 17:05:52.410103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.670 [2024-11-16 17:05:52.410229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.670 [2024-11-16 17:05:52.410258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.670 [2024-11-16 17:05:52.415426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.670 [2024-11-16 17:05:52.415657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.670 [2024-11-16 17:05:52.415703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.420753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.420898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.420945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.426108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.426321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.426353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.431507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.431749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.431780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.436583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.436801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.436831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.441974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.442135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.442175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.447301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.447485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.447518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.452550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.452712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.452749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.458137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.458387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.458420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.463429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.463715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.463745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.468517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.468707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.468737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.474005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.474173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.474224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.479046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.479224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.479253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.484222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.484414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.484447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.489369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.489512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.489541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.494693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.494877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.494924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.499773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.499977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.500017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.505079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.930 [2024-11-16 17:05:52.505344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.930 [2024-11-16 17:05:52.505377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.930 [2024-11-16 17:05:52.510412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.510609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.510649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.515691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.515803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.515830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.520920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.521218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.521251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.526282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.526538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.526568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.531550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.531823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.531854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.536236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.536499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.536532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.541603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.541701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.541727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.548044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.548208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.548241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.553238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.553414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.553446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.558387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.558600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.558658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.563589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.563836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.563867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.569016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.569273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.569307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.574460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.574776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.574807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.580026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.580305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.580339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.585125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.585395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.585428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.590399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.590543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.590576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.595613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.595835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.595865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.600882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.601107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.601141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.605988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.606102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.606132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.611182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.611337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.611376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.616581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.616860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.616907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.621811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.622025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.622060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.627211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.627339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.627371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.632551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.931 [2024-11-16 17:05:52.632800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.931 [2024-11-16 17:05:52.632843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.931 [2024-11-16 17:05:52.638055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.932 [2024-11-16 17:05:52.638269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.932 [2024-11-16 17:05:52.638309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.932 [2024-11-16 17:05:52.643410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.932 [2024-11-16 17:05:52.643604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.932 [2024-11-16 17:05:52.643646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.932 [2024-11-16 17:05:52.648641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.932 [2024-11-16 17:05:52.648811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.932 [2024-11-16 17:05:52.648846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.932 [2024-11-16 17:05:52.654013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.932 [2024-11-16 17:05:52.654136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.932 [2024-11-16 17:05:52.654168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.932 [2024-11-16 17:05:52.659357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.932 [2024-11-16 17:05:52.659470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.932 [2024-11-16 17:05:52.659502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.932 [2024-11-16 17:05:52.664738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.932 [2024-11-16 17:05:52.664943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.932 [2024-11-16 17:05:52.664976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.932 [2024-11-16 17:05:52.670091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.932 [2024-11-16 17:05:52.670287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.932 [2024-11-16 17:05:52.670318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.932 [2024-11-16 17:05:52.675565] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:06.932 [2024-11-16 17:05:52.675796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.932 [2024-11-16 17:05:52.675826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.191 [2024-11-16 17:05:52.680790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.191 [2024-11-16 17:05:52.680999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.191 [2024-11-16 17:05:52.681032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.191 [2024-11-16 17:05:52.686089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.191 [2024-11-16 17:05:52.686272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.191 [2024-11-16 17:05:52.686303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.191 [2024-11-16 17:05:52.691271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.191 [2024-11-16 17:05:52.691543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.191 [2024-11-16 17:05:52.691577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.191 [2024-11-16 17:05:52.696594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.191 [2024-11-16 17:05:52.696852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.191 [2024-11-16 17:05:52.696882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.191 [2024-11-16 17:05:52.702023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.191 [2024-11-16 17:05:52.702174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.191 [2024-11-16 17:05:52.702206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.191 [2024-11-16 17:05:52.707547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.191 [2024-11-16 17:05:52.707849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.191 [2024-11-16 17:05:52.707878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.191 [2024-11-16 17:05:52.712841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.191 [2024-11-16 17:05:52.713045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.191 [2024-11-16 17:05:52.713078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.191 [2024-11-16 17:05:52.718001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.191 [2024-11-16 17:05:52.718128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.191 [2024-11-16 17:05:52.718160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.191 [2024-11-16 17:05:52.723467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.191 [2024-11-16 17:05:52.723669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.191 [2024-11-16 17:05:52.723715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.191 [2024-11-16 17:05:52.728808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.728998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.729032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.734231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.734405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.734437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.739550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.739741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.739774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.744876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.745191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.745220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.750137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.750293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.750331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.755358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.755493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.755525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.760647] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.760883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.760930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.765803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.765950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.765999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.771364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.771673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.771703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.776456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.776700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.776731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.781755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.781828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.781856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.787831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.788040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.788072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.793050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.793184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.793217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.798452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.798609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.798650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.803928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.804086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.804118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.809179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.809294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.809326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.814513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.814766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.814796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.819597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.819823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.819853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.825119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.825388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.825421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.830415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.830661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.830707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.835731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.835836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.835867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.840897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.841044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.841090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.846247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.846385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.846418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.851545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.851790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.851820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.856776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.856915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.856950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.862033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.862252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.192 [2024-11-16 17:05:52.862286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.192 [2024-11-16 17:05:52.867294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.192 [2024-11-16 17:05:52.867436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.193 [2024-11-16 17:05:52.867471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.193 [2024-11-16 17:05:52.872602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.193 [2024-11-16 17:05:52.872838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.193 [2024-11-16 17:05:52.872874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.193 [2024-11-16 17:05:52.877828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.193 [2024-11-16 17:05:52.878005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.193 [2024-11-16 17:05:52.878045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.193 [2024-11-16 17:05:52.882918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.193 [2024-11-16 17:05:52.883096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.193 [2024-11-16 17:05:52.883128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.193 [2024-11-16 17:05:52.888279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.193 [2024-11-16 17:05:52.888397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.193 [2024-11-16 17:05:52.888430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.193 [2024-11-16 17:05:52.893594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.193 [2024-11-16 17:05:52.893818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.193 [2024-11-16 17:05:52.893848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.193 [2024-11-16 17:05:52.899141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.193 [2024-11-16 17:05:52.899424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.193 [2024-11-16 17:05:52.899463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.193 [2024-11-16 17:05:52.904551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.193 [2024-11-16 17:05:52.904788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.193 [2024-11-16 17:05:52.904820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.193 [2024-11-16 17:05:52.909810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.193 [2024-11-16 17:05:52.910089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.193 [2024-11-16 17:05:52.910123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.193 [2024-11-16 17:05:52.914862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.193 [2024-11-16 17:05:52.915075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.193 [2024-11-16 17:05:52.915104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.193 [2024-11-16 17:05:52.920146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.193 [2024-11-16 17:05:52.920296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.193 [2024-11-16 17:05:52.920328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.193 [2024-11-16 17:05:52.925470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.193 [2024-11-16 17:05:52.925704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.193 [2024-11-16 17:05:52.925735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.193 [2024-11-16 17:05:52.930812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.193 [2024-11-16 17:05:52.931021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.193 [2024-11-16 17:05:52.931053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.193 [2024-11-16 17:05:52.936310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.193 [2024-11-16 17:05:52.936508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.193 [2024-11-16 17:05:52.936538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:52.941552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:52.941832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:52.941862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:52.946714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:52.946846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:52.946875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:52.951920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:52.952061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:52.952093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:52.957184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:52.957432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:52.957464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:52.962511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:52.962741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:52.962771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:52.967925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:52.968063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:52.968095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:52.973127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:52.973348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:52.973381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:52.978329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:52.978471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:52.978508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:52.983543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:52.983694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:52.983724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:52.989059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:52.989309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:52.989355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:52.994337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:52.994507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:52.994540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:52.999680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:52.999806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:52.999835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:53.005119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:53.005361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:53.005395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:53.010324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:53.010476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:53.010508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:53.015584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:53.015834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.455 [2024-11-16 17:05:53.015863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.455 [2024-11-16 17:05:53.020776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.455 [2024-11-16 17:05:53.020912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.020950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.025987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.026101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.026133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.031250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.031409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.031442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.036777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.036943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.036976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.042052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.042251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.042283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.047236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.047428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.047460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.052558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.052749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.052778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.057773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.057992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.058024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.063211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.063459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.063492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.068455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.068683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.068712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.073761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.074003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.074036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.078943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.079192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.079224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.084311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.084483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.084516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.088907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.089138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.089172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.094316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.094559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.094592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.099803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.099931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.099960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.105151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.105304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.105337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.110586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.110757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.110786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.115931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.116070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.116113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.121249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.121400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.121432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.126631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.126832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.126861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.131820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.131992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.132025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.137306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.137552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.137585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.142597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.142756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.142787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.147807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.147958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.147990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.153106] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.153325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.153354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.158309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.158485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.456 [2024-11-16 17:05:53.158516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.456 [2024-11-16 17:05:53.163662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.456 [2024-11-16 17:05:53.163803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.457 [2024-11-16 17:05:53.163833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.457 [2024-11-16 17:05:53.169039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.457 [2024-11-16 17:05:53.169204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.457 [2024-11-16 17:05:53.169236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.457 [2024-11-16 17:05:53.174564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.457 [2024-11-16 17:05:53.174841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.457 [2024-11-16 17:05:53.174876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.457 [2024-11-16 17:05:53.180121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.457 [2024-11-16 17:05:53.180449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.457 [2024-11-16 17:05:53.180483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.457 [2024-11-16 17:05:53.185471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.457 [2024-11-16 17:05:53.185764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.457 [2024-11-16 17:05:53.185796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.457 [2024-11-16 17:05:53.190720] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.457 [2024-11-16 17:05:53.190903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.457 [2024-11-16 17:05:53.190949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.457 [2024-11-16 17:05:53.196095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.457 [2024-11-16 17:05:53.196228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.457 [2024-11-16 17:05:53.196260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.457 [2024-11-16 17:05:53.201582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.457 [2024-11-16 17:05:53.201770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.457 [2024-11-16 17:05:53.201800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.716 [2024-11-16 17:05:53.206978] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.716 [2024-11-16 17:05:53.207110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.716 [2024-11-16 17:05:53.207147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.716 [2024-11-16 17:05:53.212436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.716 [2024-11-16 17:05:53.212569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.716 [2024-11-16 17:05:53.212600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.716 [2024-11-16 17:05:53.217879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.716 [2024-11-16 17:05:53.218078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.716 [2024-11-16 17:05:53.218109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.716 [2024-11-16 17:05:53.223452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.716 [2024-11-16 17:05:53.223739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.716 [2024-11-16 17:05:53.223776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.717 [2024-11-16 17:05:53.228748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.717 [2024-11-16 17:05:53.228896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.717 [2024-11-16 17:05:53.228947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.717 [2024-11-16 17:05:53.233872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.717 [2024-11-16 17:05:53.234112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.717 [2024-11-16 17:05:53.234147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.717 [2024-11-16 17:05:53.238540] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2226ac0) with pdu=0x2000190fef90 00:30:07.717 [2024-11-16 17:05:53.238706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.717 [2024-11-16 17:05:53.238741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.717 00:30:07.717 Latency(us) 00:30:07.717 [2024-11-16T16:05:53.467Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:07.717 [2024-11-16T16:05:53.467Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:07.717 nvme0n1 : 2.00 5942.23 742.78 0.00 0.00 2685.01 1966.08 12913.02 00:30:07.717 [2024-11-16T16:05:53.467Z] =================================================================================================================== 00:30:07.717 [2024-11-16T16:05:53.467Z] Total : 5942.23 742.78 0.00 0.00 2685.01 1966.08 12913.02 00:30:07.717 0 00:30:07.717 17:05:53 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:07.717 17:05:53 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:07.717 17:05:53 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:07.717 | .driver_specific 00:30:07.717 | .nvme_error 00:30:07.717 | .status_code 00:30:07.717 | .command_transient_transport_error' 00:30:07.717 17:05:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:07.977 17:05:53 -- host/digest.sh@71 -- # (( 383 > 0 )) 00:30:07.977 17:05:53 -- host/digest.sh@73 -- # killprocess 1324057 00:30:07.977 17:05:53 -- common/autotest_common.sh@936 -- # '[' -z 1324057 ']' 00:30:07.977 17:05:53 -- common/autotest_common.sh@940 -- # kill -0 1324057 00:30:07.977 17:05:53 -- common/autotest_common.sh@941 -- # uname 00:30:07.977 17:05:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:07.977 17:05:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1324057 00:30:07.977 17:05:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:07.977 17:05:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:07.977 17:05:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1324057' 00:30:07.977 killing process with pid 1324057 00:30:07.977 17:05:53 -- common/autotest_common.sh@955 -- # kill 1324057 00:30:07.977 Received shutdown signal, test time was about 2.000000 seconds 00:30:07.977 00:30:07.977 Latency(us) 00:30:07.977 [2024-11-16T16:05:53.727Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:07.977 [2024-11-16T16:05:53.727Z] =================================================================================================================== 00:30:07.977 [2024-11-16T16:05:53.727Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:07.977 17:05:53 -- common/autotest_common.sh@960 -- # wait 1324057 00:30:08.238 17:05:53 -- host/digest.sh@115 -- # killprocess 1322378 00:30:08.238 17:05:53 -- common/autotest_common.sh@936 -- # '[' -z 1322378 ']' 00:30:08.238 17:05:53 -- common/autotest_common.sh@940 -- # kill -0 1322378 00:30:08.238 17:05:53 -- common/autotest_common.sh@941 -- # uname 00:30:08.238 17:05:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:08.238 17:05:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1322378 00:30:08.238 17:05:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:08.238 17:05:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:08.238 17:05:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1322378' 00:30:08.238 killing process with pid 1322378 00:30:08.238 17:05:53 -- common/autotest_common.sh@955 -- # kill 1322378 00:30:08.238 17:05:53 -- common/autotest_common.sh@960 -- # wait 1322378 00:30:08.498 00:30:08.498 real 0m17.986s 00:30:08.498 user 0m35.926s 00:30:08.498 sys 0m4.797s 00:30:08.498 17:05:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:08.498 17:05:54 -- common/autotest_common.sh@10 -- # set +x 00:30:08.498 ************************************ 00:30:08.498 END TEST nvmf_digest_error 00:30:08.498 ************************************ 00:30:08.498 17:05:54 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:30:08.498 17:05:54 -- host/digest.sh@139 -- # nvmftestfini 00:30:08.498 17:05:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:08.498 17:05:54 -- nvmf/common.sh@116 -- # sync 00:30:08.498 17:05:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:08.498 17:05:54 -- nvmf/common.sh@119 -- # set +e 00:30:08.498 17:05:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:08.498 17:05:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:08.498 rmmod nvme_tcp 00:30:08.498 rmmod nvme_fabrics 00:30:08.498 rmmod nvme_keyring 00:30:08.498 17:05:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:08.498 17:05:54 -- nvmf/common.sh@123 -- # set -e 00:30:08.498 17:05:54 -- nvmf/common.sh@124 -- # return 0 00:30:08.498 17:05:54 -- nvmf/common.sh@477 -- # '[' -n 1322378 ']' 00:30:08.498 17:05:54 -- nvmf/common.sh@478 -- # killprocess 1322378 00:30:08.498 17:05:54 -- common/autotest_common.sh@936 -- # '[' -z 1322378 ']' 00:30:08.498 17:05:54 -- common/autotest_common.sh@940 -- # kill -0 1322378 00:30:08.498 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1322378) - No such process 00:30:08.498 17:05:54 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1322378 is not found' 00:30:08.498 Process with pid 1322378 is not found 00:30:08.498 17:05:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:08.498 17:05:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:08.498 17:05:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:08.498 17:05:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:08.498 17:05:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:08.498 17:05:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:08.498 17:05:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:08.498 17:05:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:11.033 17:05:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:11.033 00:30:11.033 real 0m37.994s 00:30:11.033 user 1m7.446s 00:30:11.033 sys 0m10.762s 00:30:11.033 17:05:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:11.033 17:05:56 -- common/autotest_common.sh@10 -- # set +x 00:30:11.033 ************************************ 00:30:11.033 END TEST nvmf_digest 00:30:11.033 ************************************ 00:30:11.033 17:05:56 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:30:11.033 17:05:56 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:30:11.033 17:05:56 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:30:11.033 17:05:56 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:11.033 17:05:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:11.033 17:05:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:11.033 17:05:56 -- common/autotest_common.sh@10 -- # set +x 00:30:11.033 ************************************ 00:30:11.033 START TEST nvmf_bdevperf 00:30:11.033 ************************************ 00:30:11.033 17:05:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:11.033 * Looking for test storage... 00:30:11.033 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:11.033 17:05:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:11.033 17:05:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:11.033 17:05:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:11.033 17:05:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:11.033 17:05:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:11.033 17:05:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:11.033 17:05:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:11.033 17:05:56 -- scripts/common.sh@335 -- # IFS=.-: 00:30:11.033 17:05:56 -- scripts/common.sh@335 -- # read -ra ver1 00:30:11.033 17:05:56 -- scripts/common.sh@336 -- # IFS=.-: 00:30:11.033 17:05:56 -- scripts/common.sh@336 -- # read -ra ver2 00:30:11.033 17:05:56 -- scripts/common.sh@337 -- # local 'op=<' 00:30:11.033 17:05:56 -- scripts/common.sh@339 -- # ver1_l=2 00:30:11.033 17:05:56 -- scripts/common.sh@340 -- # ver2_l=1 00:30:11.033 17:05:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:11.033 17:05:56 -- scripts/common.sh@343 -- # case "$op" in 00:30:11.033 17:05:56 -- scripts/common.sh@344 -- # : 1 00:30:11.033 17:05:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:11.033 17:05:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:11.033 17:05:56 -- scripts/common.sh@364 -- # decimal 1 00:30:11.033 17:05:56 -- scripts/common.sh@352 -- # local d=1 00:30:11.033 17:05:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:11.033 17:05:56 -- scripts/common.sh@354 -- # echo 1 00:30:11.033 17:05:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:11.033 17:05:56 -- scripts/common.sh@365 -- # decimal 2 00:30:11.033 17:05:56 -- scripts/common.sh@352 -- # local d=2 00:30:11.033 17:05:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:11.033 17:05:56 -- scripts/common.sh@354 -- # echo 2 00:30:11.033 17:05:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:11.033 17:05:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:11.033 17:05:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:11.033 17:05:56 -- scripts/common.sh@367 -- # return 0 00:30:11.033 17:05:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:11.033 17:05:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:11.033 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:11.033 --rc genhtml_branch_coverage=1 00:30:11.033 --rc genhtml_function_coverage=1 00:30:11.033 --rc genhtml_legend=1 00:30:11.033 --rc geninfo_all_blocks=1 00:30:11.033 --rc geninfo_unexecuted_blocks=1 00:30:11.033 00:30:11.033 ' 00:30:11.033 17:05:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:11.033 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:11.033 --rc genhtml_branch_coverage=1 00:30:11.033 --rc genhtml_function_coverage=1 00:30:11.033 --rc genhtml_legend=1 00:30:11.033 --rc geninfo_all_blocks=1 00:30:11.033 --rc geninfo_unexecuted_blocks=1 00:30:11.033 00:30:11.033 ' 00:30:11.033 17:05:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:11.033 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:11.033 --rc genhtml_branch_coverage=1 00:30:11.033 --rc genhtml_function_coverage=1 00:30:11.033 --rc genhtml_legend=1 00:30:11.033 --rc geninfo_all_blocks=1 00:30:11.033 --rc geninfo_unexecuted_blocks=1 00:30:11.033 00:30:11.033 ' 00:30:11.033 17:05:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:11.033 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:11.033 --rc genhtml_branch_coverage=1 00:30:11.033 --rc genhtml_function_coverage=1 00:30:11.033 --rc genhtml_legend=1 00:30:11.033 --rc geninfo_all_blocks=1 00:30:11.033 --rc geninfo_unexecuted_blocks=1 00:30:11.033 00:30:11.033 ' 00:30:11.033 17:05:56 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:11.033 17:05:56 -- nvmf/common.sh@7 -- # uname -s 00:30:11.033 17:05:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:11.033 17:05:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:11.033 17:05:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:11.033 17:05:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:11.033 17:05:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:11.033 17:05:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:11.033 17:05:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:11.033 17:05:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:11.033 17:05:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:11.033 17:05:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:11.033 17:05:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:11.033 17:05:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:11.033 17:05:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:11.033 17:05:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:11.033 17:05:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:11.033 17:05:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:11.033 17:05:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:11.033 17:05:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:11.033 17:05:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:11.034 17:05:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:11.034 17:05:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:11.034 17:05:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:11.034 17:05:56 -- paths/export.sh@5 -- # export PATH 00:30:11.034 17:05:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:11.034 17:05:56 -- nvmf/common.sh@46 -- # : 0 00:30:11.034 17:05:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:11.034 17:05:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:11.034 17:05:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:11.034 17:05:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:11.034 17:05:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:11.034 17:05:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:11.034 17:05:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:11.034 17:05:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:11.034 17:05:56 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:11.034 17:05:56 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:11.034 17:05:56 -- host/bdevperf.sh@24 -- # nvmftestinit 00:30:11.034 17:05:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:11.034 17:05:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:11.034 17:05:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:11.034 17:05:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:11.034 17:05:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:11.034 17:05:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:11.034 17:05:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:11.034 17:05:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:11.034 17:05:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:11.034 17:05:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:11.034 17:05:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:11.034 17:05:56 -- common/autotest_common.sh@10 -- # set +x 00:30:12.939 17:05:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:12.939 17:05:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:12.939 17:05:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:12.939 17:05:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:12.939 17:05:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:12.939 17:05:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:12.939 17:05:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:12.939 17:05:58 -- nvmf/common.sh@294 -- # net_devs=() 00:30:12.939 17:05:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:12.939 17:05:58 -- nvmf/common.sh@295 -- # e810=() 00:30:12.939 17:05:58 -- nvmf/common.sh@295 -- # local -ga e810 00:30:12.939 17:05:58 -- nvmf/common.sh@296 -- # x722=() 00:30:12.939 17:05:58 -- nvmf/common.sh@296 -- # local -ga x722 00:30:12.939 17:05:58 -- nvmf/common.sh@297 -- # mlx=() 00:30:12.939 17:05:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:12.939 17:05:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:12.939 17:05:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:12.939 17:05:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:12.939 17:05:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:12.939 17:05:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:12.939 17:05:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:12.939 17:05:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:12.939 17:05:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:12.939 17:05:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:12.939 17:05:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:12.939 17:05:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:12.939 17:05:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:12.939 17:05:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:12.939 17:05:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:12.939 17:05:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:12.939 17:05:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:12.939 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:12.939 17:05:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:12.939 17:05:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:12.939 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:12.939 17:05:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:12.939 17:05:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:12.939 17:05:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:12.939 17:05:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:12.939 17:05:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:12.939 17:05:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:12.939 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:12.939 17:05:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:12.939 17:05:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:12.939 17:05:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:12.939 17:05:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:12.939 17:05:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:12.939 17:05:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:12.939 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:12.939 17:05:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:12.939 17:05:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:12.939 17:05:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:12.939 17:05:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:12.939 17:05:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:12.939 17:05:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:12.939 17:05:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:12.939 17:05:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:12.939 17:05:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:12.939 17:05:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:12.939 17:05:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:12.939 17:05:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:12.939 17:05:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:12.939 17:05:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:12.939 17:05:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:12.939 17:05:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:12.939 17:05:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:12.939 17:05:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:12.939 17:05:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:12.939 17:05:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:12.939 17:05:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:12.939 17:05:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:12.939 17:05:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:12.939 17:05:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:12.939 17:05:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:12.939 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:12.939 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:30:12.939 00:30:12.939 --- 10.0.0.2 ping statistics --- 00:30:12.940 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:12.940 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:30:12.940 17:05:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:12.940 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:12.940 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:30:12.940 00:30:12.940 --- 10.0.0.1 ping statistics --- 00:30:12.940 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:12.940 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:30:12.940 17:05:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:12.940 17:05:58 -- nvmf/common.sh@410 -- # return 0 00:30:12.940 17:05:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:12.940 17:05:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:12.940 17:05:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:12.940 17:05:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:12.940 17:05:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:12.940 17:05:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:12.940 17:05:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:12.940 17:05:58 -- host/bdevperf.sh@25 -- # tgt_init 00:30:12.940 17:05:58 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:12.940 17:05:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:12.940 17:05:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:12.940 17:05:58 -- common/autotest_common.sh@10 -- # set +x 00:30:12.940 17:05:58 -- nvmf/common.sh@469 -- # nvmfpid=1326578 00:30:12.940 17:05:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:12.940 17:05:58 -- nvmf/common.sh@470 -- # waitforlisten 1326578 00:30:12.940 17:05:58 -- common/autotest_common.sh@829 -- # '[' -z 1326578 ']' 00:30:12.940 17:05:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:12.940 17:05:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:12.940 17:05:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:12.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:12.940 17:05:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:12.940 17:05:58 -- common/autotest_common.sh@10 -- # set +x 00:30:12.940 [2024-11-16 17:05:58.607473] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:12.940 [2024-11-16 17:05:58.607542] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:12.940 EAL: No free 2048 kB hugepages reported on node 1 00:30:12.940 [2024-11-16 17:05:58.672655] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:13.226 [2024-11-16 17:05:58.761517] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:13.226 [2024-11-16 17:05:58.761712] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:13.226 [2024-11-16 17:05:58.761733] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:13.226 [2024-11-16 17:05:58.761748] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:13.226 [2024-11-16 17:05:58.761857] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:13.226 [2024-11-16 17:05:58.761955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:13.226 [2024-11-16 17:05:58.761958] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:14.204 17:05:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:14.204 17:05:59 -- common/autotest_common.sh@862 -- # return 0 00:30:14.204 17:05:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:14.204 17:05:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:14.204 17:05:59 -- common/autotest_common.sh@10 -- # set +x 00:30:14.204 17:05:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:14.204 17:05:59 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:14.204 17:05:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.204 17:05:59 -- common/autotest_common.sh@10 -- # set +x 00:30:14.204 [2024-11-16 17:05:59.638982] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:14.204 17:05:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.204 17:05:59 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:14.204 17:05:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.204 17:05:59 -- common/autotest_common.sh@10 -- # set +x 00:30:14.204 Malloc0 00:30:14.204 17:05:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.204 17:05:59 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:14.205 17:05:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.205 17:05:59 -- common/autotest_common.sh@10 -- # set +x 00:30:14.205 17:05:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.205 17:05:59 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:14.205 17:05:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.205 17:05:59 -- common/autotest_common.sh@10 -- # set +x 00:30:14.205 17:05:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.205 17:05:59 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:14.205 17:05:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.205 17:05:59 -- common/autotest_common.sh@10 -- # set +x 00:30:14.205 [2024-11-16 17:05:59.703750] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:14.205 17:05:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.205 17:05:59 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:30:14.205 17:05:59 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:30:14.205 17:05:59 -- nvmf/common.sh@520 -- # config=() 00:30:14.205 17:05:59 -- nvmf/common.sh@520 -- # local subsystem config 00:30:14.205 17:05:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:14.205 17:05:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:14.205 { 00:30:14.205 "params": { 00:30:14.205 "name": "Nvme$subsystem", 00:30:14.205 "trtype": "$TEST_TRANSPORT", 00:30:14.205 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:14.205 "adrfam": "ipv4", 00:30:14.205 "trsvcid": "$NVMF_PORT", 00:30:14.205 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:14.205 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:14.205 "hdgst": ${hdgst:-false}, 00:30:14.205 "ddgst": ${ddgst:-false} 00:30:14.205 }, 00:30:14.205 "method": "bdev_nvme_attach_controller" 00:30:14.205 } 00:30:14.205 EOF 00:30:14.205 )") 00:30:14.205 17:05:59 -- nvmf/common.sh@542 -- # cat 00:30:14.205 17:05:59 -- nvmf/common.sh@544 -- # jq . 00:30:14.205 17:05:59 -- nvmf/common.sh@545 -- # IFS=, 00:30:14.205 17:05:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:14.205 "params": { 00:30:14.205 "name": "Nvme1", 00:30:14.205 "trtype": "tcp", 00:30:14.205 "traddr": "10.0.0.2", 00:30:14.205 "adrfam": "ipv4", 00:30:14.205 "trsvcid": "4420", 00:30:14.205 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:14.205 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:14.205 "hdgst": false, 00:30:14.205 "ddgst": false 00:30:14.205 }, 00:30:14.205 "method": "bdev_nvme_attach_controller" 00:30:14.205 }' 00:30:14.205 [2024-11-16 17:05:59.749574] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:14.205 [2024-11-16 17:05:59.749670] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1326736 ] 00:30:14.205 EAL: No free 2048 kB hugepages reported on node 1 00:30:14.205 [2024-11-16 17:05:59.808094] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:14.205 [2024-11-16 17:05:59.895416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:14.463 Running I/O for 1 seconds... 00:30:15.398 00:30:15.398 Latency(us) 00:30:15.398 [2024-11-16T16:06:01.148Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:15.398 [2024-11-16T16:06:01.148Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:15.398 Verification LBA range: start 0x0 length 0x4000 00:30:15.398 Nvme1n1 : 1.01 12784.89 49.94 0.00 0.00 9965.67 1462.42 17185.00 00:30:15.398 [2024-11-16T16:06:01.148Z] =================================================================================================================== 00:30:15.398 [2024-11-16T16:06:01.148Z] Total : 12784.89 49.94 0.00 0.00 9965.67 1462.42 17185.00 00:30:15.656 17:06:01 -- host/bdevperf.sh@30 -- # bdevperfpid=1327033 00:30:15.656 17:06:01 -- host/bdevperf.sh@32 -- # sleep 3 00:30:15.656 17:06:01 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:30:15.656 17:06:01 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:30:15.656 17:06:01 -- nvmf/common.sh@520 -- # config=() 00:30:15.656 17:06:01 -- nvmf/common.sh@520 -- # local subsystem config 00:30:15.656 17:06:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:15.656 17:06:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:15.656 { 00:30:15.656 "params": { 00:30:15.656 "name": "Nvme$subsystem", 00:30:15.656 "trtype": "$TEST_TRANSPORT", 00:30:15.656 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:15.656 "adrfam": "ipv4", 00:30:15.656 "trsvcid": "$NVMF_PORT", 00:30:15.656 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:15.656 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:15.656 "hdgst": ${hdgst:-false}, 00:30:15.656 "ddgst": ${ddgst:-false} 00:30:15.656 }, 00:30:15.656 "method": "bdev_nvme_attach_controller" 00:30:15.656 } 00:30:15.656 EOF 00:30:15.656 )") 00:30:15.656 17:06:01 -- nvmf/common.sh@542 -- # cat 00:30:15.656 17:06:01 -- nvmf/common.sh@544 -- # jq . 00:30:15.656 17:06:01 -- nvmf/common.sh@545 -- # IFS=, 00:30:15.656 17:06:01 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:15.656 "params": { 00:30:15.656 "name": "Nvme1", 00:30:15.656 "trtype": "tcp", 00:30:15.656 "traddr": "10.0.0.2", 00:30:15.656 "adrfam": "ipv4", 00:30:15.656 "trsvcid": "4420", 00:30:15.656 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:15.656 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:15.656 "hdgst": false, 00:30:15.656 "ddgst": false 00:30:15.656 }, 00:30:15.656 "method": "bdev_nvme_attach_controller" 00:30:15.656 }' 00:30:15.656 [2024-11-16 17:06:01.334951] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:15.656 [2024-11-16 17:06:01.335052] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1327033 ] 00:30:15.656 EAL: No free 2048 kB hugepages reported on node 1 00:30:15.656 [2024-11-16 17:06:01.395897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:15.914 [2024-11-16 17:06:01.479752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:16.172 Running I/O for 15 seconds... 00:30:18.709 17:06:04 -- host/bdevperf.sh@33 -- # kill -9 1326578 00:30:18.709 17:06:04 -- host/bdevperf.sh@35 -- # sleep 3 00:30:18.709 [2024-11-16 17:06:04.305658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:5816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.305720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.305762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.305780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.305799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:5864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.305816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.305832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.305848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.305865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:5904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.305880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.305896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:5912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.305920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.305936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:5920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.305966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.305983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:5944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:6536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:6544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:6552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:6560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:5968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:6000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:6008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:6024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:6032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:6072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:6088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:6608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:6616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.709 [2024-11-16 17:06:04.306503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.709 [2024-11-16 17:06:04.306524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:6640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.306540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.306558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:6648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.306573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.306590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:6672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.306610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.306636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:6696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.306668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.306685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:6704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.306699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.306714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:6736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.306728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.306744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:6104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.306758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.306773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:6112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.306787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.306802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:6120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.306817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.306833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.306846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.306862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:6136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.306876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.306891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:6152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.306930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.306948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:6160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.306968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.306986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:6168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:6752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.710 [2024-11-16 17:06:04.307034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:6760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:6768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:6776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.710 [2024-11-16 17:06:04.307131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:6784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:6792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.710 [2024-11-16 17:06:04.307197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:6800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:6808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:6176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:6192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:6208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:6216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:6240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:6256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:6288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:6816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.710 [2024-11-16 17:06:04.307555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:6320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:6344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:6352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:6376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:6384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:6392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:6400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.710 [2024-11-16 17:06:04.307839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.710 [2024-11-16 17:06:04.307854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:6824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.710 [2024-11-16 17:06:04.307867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.307882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:6832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.711 [2024-11-16 17:06:04.307922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.307940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:6840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.711 [2024-11-16 17:06:04.307955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.307972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:6848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.711 [2024-11-16 17:06:04.307987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:6856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:6864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.711 [2024-11-16 17:06:04.308052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:6872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.711 [2024-11-16 17:06:04.308085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:6880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:6896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.711 [2024-11-16 17:06:04.308181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:6904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:6912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:6920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.711 [2024-11-16 17:06:04.308286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:6928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.711 [2024-11-16 17:06:04.308317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:6944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:6952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.711 [2024-11-16 17:06:04.308413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:6960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:6968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:6976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.711 [2024-11-16 17:06:04.308511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:6984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.711 [2024-11-16 17:06:04.308543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:6992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.711 [2024-11-16 17:06:04.308574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:7000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:7008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:7016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:6440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:6448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:6464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:6472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:6504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:6520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.308977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:7024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.308994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.309011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:7032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.711 [2024-11-16 17:06:04.309026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.309044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:7040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.711 [2024-11-16 17:06:04.309059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.309076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:7048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.309094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.309112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:7056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.309128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.309145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:7064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.309161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.711 [2024-11-16 17:06:04.309177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:7072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.711 [2024-11-16 17:06:04.309192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:7080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.712 [2024-11-16 17:06:04.309225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:7088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:7096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:7112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:6528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:6568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:6576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:6584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:6592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:6624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:6632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:7128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.712 [2024-11-16 17:06:04.309720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:7136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.712 [2024-11-16 17:06:04.309749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:7144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:18.712 [2024-11-16 17:06:04.309779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:7152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:7160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:6656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:6664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:6680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.309977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:6688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.309994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.310011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:6712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.310027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.310044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:6720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.310059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.310076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:6728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:18.712 [2024-11-16 17:06:04.310098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.310116] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7379a0 is same with the state(5) to be set 00:30:18.712 [2024-11-16 17:06:04.310135] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:18.712 [2024-11-16 17:06:04.310149] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:18.712 [2024-11-16 17:06:04.310162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6744 len:8 PRP1 0x0 PRP2 0x0 00:30:18.712 [2024-11-16 17:06:04.310176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.310244] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x7379a0 was disconnected and freed. reset controller. 00:30:18.712 [2024-11-16 17:06:04.310318] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:18.712 [2024-11-16 17:06:04.310342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.310360] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:18.712 [2024-11-16 17:06:04.310375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.310390] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:18.712 [2024-11-16 17:06:04.310404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.310421] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:18.712 [2024-11-16 17:06:04.310436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:18.712 [2024-11-16 17:06:04.310450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.712 [2024-11-16 17:06:04.312790] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.712 [2024-11-16 17:06:04.312829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.712 [2024-11-16 17:06:04.313467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.712 [2024-11-16 17:06:04.313634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.712 [2024-11-16 17:06:04.313686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.712 [2024-11-16 17:06:04.313704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.712 [2024-11-16 17:06:04.313839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.712 [2024-11-16 17:06:04.314043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.712 [2024-11-16 17:06:04.314067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.712 [2024-11-16 17:06:04.314088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.712 [2024-11-16 17:06:04.316802] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.712 [2024-11-16 17:06:04.325664] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.712 [2024-11-16 17:06:04.326071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.712 [2024-11-16 17:06:04.326267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.712 [2024-11-16 17:06:04.326297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.713 [2024-11-16 17:06:04.326316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.713 [2024-11-16 17:06:04.326500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.713 [2024-11-16 17:06:04.326696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.713 [2024-11-16 17:06:04.326722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.713 [2024-11-16 17:06:04.326738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.713 [2024-11-16 17:06:04.328920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.713 [2024-11-16 17:06:04.338160] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.713 [2024-11-16 17:06:04.338448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.713 [2024-11-16 17:06:04.338633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.713 [2024-11-16 17:06:04.338661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.713 [2024-11-16 17:06:04.338679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.713 [2024-11-16 17:06:04.338795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.713 [2024-11-16 17:06:04.338966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.713 [2024-11-16 17:06:04.338991] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.713 [2024-11-16 17:06:04.339007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.713 [2024-11-16 17:06:04.341328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.713 [2024-11-16 17:06:04.350768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.713 [2024-11-16 17:06:04.351096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.713 [2024-11-16 17:06:04.351285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.713 [2024-11-16 17:06:04.351336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.713 [2024-11-16 17:06:04.351360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.713 [2024-11-16 17:06:04.351527] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.713 [2024-11-16 17:06:04.351701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.713 [2024-11-16 17:06:04.351723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.713 [2024-11-16 17:06:04.351738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.713 [2024-11-16 17:06:04.354015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.713 [2024-11-16 17:06:04.363326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.713 [2024-11-16 17:06:04.363675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.713 [2024-11-16 17:06:04.363793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.713 [2024-11-16 17:06:04.363823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.713 [2024-11-16 17:06:04.363842] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.713 [2024-11-16 17:06:04.363990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.713 [2024-11-16 17:06:04.364141] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.713 [2024-11-16 17:06:04.364165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.713 [2024-11-16 17:06:04.364183] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.713 [2024-11-16 17:06:04.366423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.713 [2024-11-16 17:06:04.375857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.713 [2024-11-16 17:06:04.376223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.713 [2024-11-16 17:06:04.376342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.713 [2024-11-16 17:06:04.376367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.713 [2024-11-16 17:06:04.376384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.713 [2024-11-16 17:06:04.376558] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.713 [2024-11-16 17:06:04.376755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.713 [2024-11-16 17:06:04.376781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.713 [2024-11-16 17:06:04.376797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.713 [2024-11-16 17:06:04.379152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.713 [2024-11-16 17:06:04.388282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.713 [2024-11-16 17:06:04.388544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.713 [2024-11-16 17:06:04.388648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.713 [2024-11-16 17:06:04.388679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.713 [2024-11-16 17:06:04.388698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.713 [2024-11-16 17:06:04.388870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.713 [2024-11-16 17:06:04.389040] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.713 [2024-11-16 17:06:04.389064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.713 [2024-11-16 17:06:04.389081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.713 [2024-11-16 17:06:04.391575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.713 [2024-11-16 17:06:04.400658] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.713 [2024-11-16 17:06:04.400900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.713 [2024-11-16 17:06:04.401052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.713 [2024-11-16 17:06:04.401079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.713 [2024-11-16 17:06:04.401097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.713 [2024-11-16 17:06:04.401314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.713 [2024-11-16 17:06:04.401517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.713 [2024-11-16 17:06:04.401541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.713 [2024-11-16 17:06:04.401557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.713 [2024-11-16 17:06:04.403974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.713 [2024-11-16 17:06:04.413167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.713 [2024-11-16 17:06:04.413473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.713 [2024-11-16 17:06:04.413630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.713 [2024-11-16 17:06:04.413661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.713 [2024-11-16 17:06:04.413680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.713 [2024-11-16 17:06:04.413900] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.713 [2024-11-16 17:06:04.414070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.713 [2024-11-16 17:06:04.414094] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.713 [2024-11-16 17:06:04.414110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.713 [2024-11-16 17:06:04.416262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.713 [2024-11-16 17:06:04.425909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.713 [2024-11-16 17:06:04.426273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.714 [2024-11-16 17:06:04.426454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.714 [2024-11-16 17:06:04.426484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.714 [2024-11-16 17:06:04.426502] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.714 [2024-11-16 17:06:04.426681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.714 [2024-11-16 17:06:04.426822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.714 [2024-11-16 17:06:04.426846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.714 [2024-11-16 17:06:04.426863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.714 [2024-11-16 17:06:04.429049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.714 [2024-11-16 17:06:04.438549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.714 [2024-11-16 17:06:04.438908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.714 [2024-11-16 17:06:04.439105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.714 [2024-11-16 17:06:04.439156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.714 [2024-11-16 17:06:04.439174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.714 [2024-11-16 17:06:04.439323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.714 [2024-11-16 17:06:04.439456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.714 [2024-11-16 17:06:04.439480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.714 [2024-11-16 17:06:04.439496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.714 [2024-11-16 17:06:04.441767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.714 [2024-11-16 17:06:04.451135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.714 [2024-11-16 17:06:04.451528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.714 [2024-11-16 17:06:04.451708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.714 [2024-11-16 17:06:04.451738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.714 [2024-11-16 17:06:04.451757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.714 [2024-11-16 17:06:04.451924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.714 [2024-11-16 17:06:04.452094] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.714 [2024-11-16 17:06:04.452118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.714 [2024-11-16 17:06:04.452135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.714 [2024-11-16 17:06:04.454468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.976 [2024-11-16 17:06:04.463597] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.976 [2024-11-16 17:06:04.463874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.976 [2024-11-16 17:06:04.464058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.976 [2024-11-16 17:06:04.464107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.976 [2024-11-16 17:06:04.464126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.976 [2024-11-16 17:06:04.464257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.976 [2024-11-16 17:06:04.464426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.976 [2024-11-16 17:06:04.464456] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.976 [2024-11-16 17:06:04.464474] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.976 [2024-11-16 17:06:04.466731] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.976 [2024-11-16 17:06:04.476197] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.976 [2024-11-16 17:06:04.476522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.976 [2024-11-16 17:06:04.476658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.976 [2024-11-16 17:06:04.476689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.976 [2024-11-16 17:06:04.476708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.976 [2024-11-16 17:06:04.476875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.976 [2024-11-16 17:06:04.477027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.976 [2024-11-16 17:06:04.477051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.976 [2024-11-16 17:06:04.477068] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.976 [2024-11-16 17:06:04.479712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.976 [2024-11-16 17:06:04.488851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.976 [2024-11-16 17:06:04.489176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.976 [2024-11-16 17:06:04.489326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.976 [2024-11-16 17:06:04.489355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.976 [2024-11-16 17:06:04.489374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.976 [2024-11-16 17:06:04.489558] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.976 [2024-11-16 17:06:04.489739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.976 [2024-11-16 17:06:04.489764] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.976 [2024-11-16 17:06:04.489781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.976 [2024-11-16 17:06:04.492203] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.976 [2024-11-16 17:06:04.501356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.976 [2024-11-16 17:06:04.501669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.976 [2024-11-16 17:06:04.501766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.976 [2024-11-16 17:06:04.501791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.976 [2024-11-16 17:06:04.501808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.976 [2024-11-16 17:06:04.501984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.976 [2024-11-16 17:06:04.502171] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.976 [2024-11-16 17:06:04.502197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.976 [2024-11-16 17:06:04.502221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.976 [2024-11-16 17:06:04.504915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.976 [2024-11-16 17:06:04.513898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.976 [2024-11-16 17:06:04.514200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.514354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.514383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.977 [2024-11-16 17:06:04.514402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.977 [2024-11-16 17:06:04.514550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.977 [2024-11-16 17:06:04.514748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.977 [2024-11-16 17:06:04.514774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.977 [2024-11-16 17:06:04.514790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.977 [2024-11-16 17:06:04.517048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.977 [2024-11-16 17:06:04.526578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.977 [2024-11-16 17:06:04.526911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.527107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.527158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.977 [2024-11-16 17:06:04.527177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.977 [2024-11-16 17:06:04.527324] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.977 [2024-11-16 17:06:04.527512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.977 [2024-11-16 17:06:04.527537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.977 [2024-11-16 17:06:04.527553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.977 [2024-11-16 17:06:04.529976] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.977 [2024-11-16 17:06:04.539310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.977 [2024-11-16 17:06:04.539626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.539775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.539802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.977 [2024-11-16 17:06:04.539819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.977 [2024-11-16 17:06:04.540013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.977 [2024-11-16 17:06:04.540212] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.977 [2024-11-16 17:06:04.540238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.977 [2024-11-16 17:06:04.540254] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.977 [2024-11-16 17:06:04.542841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.977 [2024-11-16 17:06:04.552073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.977 [2024-11-16 17:06:04.552340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.552492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.552523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.977 [2024-11-16 17:06:04.552541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.977 [2024-11-16 17:06:04.552738] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.977 [2024-11-16 17:06:04.552855] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.977 [2024-11-16 17:06:04.552879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.977 [2024-11-16 17:06:04.552896] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.977 [2024-11-16 17:06:04.555177] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.977 [2024-11-16 17:06:04.564680] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.977 [2024-11-16 17:06:04.564995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.565177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.565208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.977 [2024-11-16 17:06:04.565227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.977 [2024-11-16 17:06:04.565429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.977 [2024-11-16 17:06:04.565566] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.977 [2024-11-16 17:06:04.565590] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.977 [2024-11-16 17:06:04.565607] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.977 [2024-11-16 17:06:04.567922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.977 [2024-11-16 17:06:04.577221] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.977 [2024-11-16 17:06:04.577571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.577709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.577741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.977 [2024-11-16 17:06:04.577760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.977 [2024-11-16 17:06:04.577890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.977 [2024-11-16 17:06:04.578008] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.977 [2024-11-16 17:06:04.578033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.977 [2024-11-16 17:06:04.578049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.977 [2024-11-16 17:06:04.580275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.977 [2024-11-16 17:06:04.589783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.977 [2024-11-16 17:06:04.590059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.590225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.590253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.977 [2024-11-16 17:06:04.590270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.977 [2024-11-16 17:06:04.590481] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.977 [2024-11-16 17:06:04.590629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.977 [2024-11-16 17:06:04.590667] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.977 [2024-11-16 17:06:04.590683] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.977 [2024-11-16 17:06:04.593060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.977 [2024-11-16 17:06:04.602356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.977 [2024-11-16 17:06:04.602681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.602851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.602878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.977 [2024-11-16 17:06:04.602895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.977 [2024-11-16 17:06:04.603104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.977 [2024-11-16 17:06:04.603274] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.977 [2024-11-16 17:06:04.603298] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.977 [2024-11-16 17:06:04.603315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.977 [2024-11-16 17:06:04.605680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.977 [2024-11-16 17:06:04.614983] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.977 [2024-11-16 17:06:04.615300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.615427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.615466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.977 [2024-11-16 17:06:04.615485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.977 [2024-11-16 17:06:04.615649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.977 [2024-11-16 17:06:04.615840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.977 [2024-11-16 17:06:04.615865] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.977 [2024-11-16 17:06:04.615881] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.977 [2024-11-16 17:06:04.618089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.977 [2024-11-16 17:06:04.627533] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.977 [2024-11-16 17:06:04.627846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.627990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.977 [2024-11-16 17:06:04.628021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.978 [2024-11-16 17:06:04.628040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.978 [2024-11-16 17:06:04.628230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.978 [2024-11-16 17:06:04.628388] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.978 [2024-11-16 17:06:04.628408] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.978 [2024-11-16 17:06:04.628422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.978 [2024-11-16 17:06:04.630779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.978 [2024-11-16 17:06:04.640094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.978 [2024-11-16 17:06:04.640395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.978 [2024-11-16 17:06:04.640537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.978 [2024-11-16 17:06:04.640564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.978 [2024-11-16 17:06:04.640582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.978 [2024-11-16 17:06:04.640744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.978 [2024-11-16 17:06:04.640921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.978 [2024-11-16 17:06:04.640946] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.978 [2024-11-16 17:06:04.640964] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.978 [2024-11-16 17:06:04.643342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.978 [2024-11-16 17:06:04.652848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.978 [2024-11-16 17:06:04.653246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.978 [2024-11-16 17:06:04.653369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.978 [2024-11-16 17:06:04.653396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.978 [2024-11-16 17:06:04.653413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.978 [2024-11-16 17:06:04.653636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.978 [2024-11-16 17:06:04.653773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.978 [2024-11-16 17:06:04.653796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.978 [2024-11-16 17:06:04.653811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.978 [2024-11-16 17:06:04.656229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.978 [2024-11-16 17:06:04.665542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.978 [2024-11-16 17:06:04.665774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.978 [2024-11-16 17:06:04.665897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.978 [2024-11-16 17:06:04.665953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.978 [2024-11-16 17:06:04.665979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.978 [2024-11-16 17:06:04.666167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.978 [2024-11-16 17:06:04.666323] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.978 [2024-11-16 17:06:04.666362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.978 [2024-11-16 17:06:04.666380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.978 [2024-11-16 17:06:04.668559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.978 [2024-11-16 17:06:04.678109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.978 [2024-11-16 17:06:04.678402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.978 [2024-11-16 17:06:04.678564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.978 [2024-11-16 17:06:04.678594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.978 [2024-11-16 17:06:04.678613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.978 [2024-11-16 17:06:04.678788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.978 [2024-11-16 17:06:04.678954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.978 [2024-11-16 17:06:04.678992] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.978 [2024-11-16 17:06:04.679006] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.978 [2024-11-16 17:06:04.681274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.978 [2024-11-16 17:06:04.690884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.978 [2024-11-16 17:06:04.691188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.978 [2024-11-16 17:06:04.691401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.978 [2024-11-16 17:06:04.691432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.978 [2024-11-16 17:06:04.691452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.978 [2024-11-16 17:06:04.691630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.978 [2024-11-16 17:06:04.691800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.978 [2024-11-16 17:06:04.691823] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.978 [2024-11-16 17:06:04.691838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.978 [2024-11-16 17:06:04.694229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.978 [2024-11-16 17:06:04.703490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.978 [2024-11-16 17:06:04.703753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.978 [2024-11-16 17:06:04.703856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.978 [2024-11-16 17:06:04.703882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.978 [2024-11-16 17:06:04.703900] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.978 [2024-11-16 17:06:04.704053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.978 [2024-11-16 17:06:04.704266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.978 [2024-11-16 17:06:04.704303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.978 [2024-11-16 17:06:04.704321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.978 [2024-11-16 17:06:04.706721] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.978 [2024-11-16 17:06:04.716059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.978 [2024-11-16 17:06:04.716373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.978 [2024-11-16 17:06:04.716500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.978 [2024-11-16 17:06:04.716543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:18.978 [2024-11-16 17:06:04.716561] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:18.978 [2024-11-16 17:06:04.716720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:18.978 [2024-11-16 17:06:04.716840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.978 [2024-11-16 17:06:04.716862] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.978 [2024-11-16 17:06:04.716876] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.978 [2024-11-16 17:06:04.719176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.240 [2024-11-16 17:06:04.728605] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.240 [2024-11-16 17:06:04.728879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.240 [2024-11-16 17:06:04.728988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.240 [2024-11-16 17:06:04.729014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.240 [2024-11-16 17:06:04.729031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.240 [2024-11-16 17:06:04.729149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.240 [2024-11-16 17:06:04.729337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.240 [2024-11-16 17:06:04.729370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.240 [2024-11-16 17:06:04.729387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.240 [2024-11-16 17:06:04.731913] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.240 [2024-11-16 17:06:04.741142] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.240 [2024-11-16 17:06:04.741448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.240 [2024-11-16 17:06:04.741623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.240 [2024-11-16 17:06:04.741674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.240 [2024-11-16 17:06:04.741691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.240 [2024-11-16 17:06:04.741872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.240 [2024-11-16 17:06:04.742083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.240 [2024-11-16 17:06:04.742108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.240 [2024-11-16 17:06:04.742126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.241 [2024-11-16 17:06:04.744321] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.241 [2024-11-16 17:06:04.753898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.241 [2024-11-16 17:06:04.754273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.754430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.754458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.241 [2024-11-16 17:06:04.754490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.241 [2024-11-16 17:06:04.754681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.241 [2024-11-16 17:06:04.754835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.241 [2024-11-16 17:06:04.754863] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.241 [2024-11-16 17:06:04.754878] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.241 [2024-11-16 17:06:04.757049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.241 [2024-11-16 17:06:04.766329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.241 [2024-11-16 17:06:04.766645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.766789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.766816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.241 [2024-11-16 17:06:04.766834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.241 [2024-11-16 17:06:04.767026] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.241 [2024-11-16 17:06:04.767197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.241 [2024-11-16 17:06:04.767222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.241 [2024-11-16 17:06:04.767239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.241 [2024-11-16 17:06:04.769686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.241 [2024-11-16 17:06:04.778851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.241 [2024-11-16 17:06:04.779267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.779387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.779415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.241 [2024-11-16 17:06:04.779434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.241 [2024-11-16 17:06:04.779663] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.241 [2024-11-16 17:06:04.779816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.241 [2024-11-16 17:06:04.779844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.241 [2024-11-16 17:06:04.779859] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.241 [2024-11-16 17:06:04.782321] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.241 [2024-11-16 17:06:04.791409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.241 [2024-11-16 17:06:04.791703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.791905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.791933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.241 [2024-11-16 17:06:04.791949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.241 [2024-11-16 17:06:04.792146] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.241 [2024-11-16 17:06:04.792316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.241 [2024-11-16 17:06:04.792341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.241 [2024-11-16 17:06:04.792358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.241 [2024-11-16 17:06:04.794572] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.241 [2024-11-16 17:06:04.804080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.241 [2024-11-16 17:06:04.804413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.804542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.804572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.241 [2024-11-16 17:06:04.804591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.241 [2024-11-16 17:06:04.804770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.241 [2024-11-16 17:06:04.804905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.241 [2024-11-16 17:06:04.804929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.241 [2024-11-16 17:06:04.804946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.241 [2024-11-16 17:06:04.807244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.241 [2024-11-16 17:06:04.816672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.241 [2024-11-16 17:06:04.816979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.817109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.817147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.241 [2024-11-16 17:06:04.817167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.241 [2024-11-16 17:06:04.817351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.241 [2024-11-16 17:06:04.817538] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.241 [2024-11-16 17:06:04.817564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.241 [2024-11-16 17:06:04.817587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.241 [2024-11-16 17:06:04.819829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.241 [2024-11-16 17:06:04.829285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.241 [2024-11-16 17:06:04.829556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.829686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.829716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.241 [2024-11-16 17:06:04.829736] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.241 [2024-11-16 17:06:04.829903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.241 [2024-11-16 17:06:04.830091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.241 [2024-11-16 17:06:04.830117] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.241 [2024-11-16 17:06:04.830135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.241 [2024-11-16 17:06:04.832436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.241 [2024-11-16 17:06:04.841712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.241 [2024-11-16 17:06:04.842032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.842160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.842191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.241 [2024-11-16 17:06:04.842210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.241 [2024-11-16 17:06:04.842394] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.241 [2024-11-16 17:06:04.842600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.241 [2024-11-16 17:06:04.842646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.241 [2024-11-16 17:06:04.842664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.241 [2024-11-16 17:06:04.845053] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.241 [2024-11-16 17:06:04.854225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.241 [2024-11-16 17:06:04.854552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.854680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.241 [2024-11-16 17:06:04.854724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.241 [2024-11-16 17:06:04.854742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.241 [2024-11-16 17:06:04.854916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.241 [2024-11-16 17:06:04.855132] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.241 [2024-11-16 17:06:04.855158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.241 [2024-11-16 17:06:04.855175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.241 [2024-11-16 17:06:04.857462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.241 [2024-11-16 17:06:04.866777] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.241 [2024-11-16 17:06:04.867081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.867237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.867280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.242 [2024-11-16 17:06:04.867298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.242 [2024-11-16 17:06:04.867477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.242 [2024-11-16 17:06:04.867672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.242 [2024-11-16 17:06:04.867711] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.242 [2024-11-16 17:06:04.867726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.242 [2024-11-16 17:06:04.869975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.242 [2024-11-16 17:06:04.879366] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.242 [2024-11-16 17:06:04.879648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.879804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.879832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.242 [2024-11-16 17:06:04.879850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.242 [2024-11-16 17:06:04.879999] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.242 [2024-11-16 17:06:04.880204] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.242 [2024-11-16 17:06:04.880228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.242 [2024-11-16 17:06:04.880244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.242 [2024-11-16 17:06:04.882454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.242 [2024-11-16 17:06:04.892044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.242 [2024-11-16 17:06:04.892292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.892453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.892482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.242 [2024-11-16 17:06:04.892499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.242 [2024-11-16 17:06:04.892693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.242 [2024-11-16 17:06:04.892845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.242 [2024-11-16 17:06:04.892870] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.242 [2024-11-16 17:06:04.892887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.242 [2024-11-16 17:06:04.895044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.242 [2024-11-16 17:06:04.904715] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.242 [2024-11-16 17:06:04.905009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.905158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.905206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.242 [2024-11-16 17:06:04.905225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.242 [2024-11-16 17:06:04.905392] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.242 [2024-11-16 17:06:04.905579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.242 [2024-11-16 17:06:04.905604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.242 [2024-11-16 17:06:04.905633] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.242 [2024-11-16 17:06:04.907918] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.242 [2024-11-16 17:06:04.917289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.242 [2024-11-16 17:06:04.917650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.917779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.917810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.242 [2024-11-16 17:06:04.917829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.242 [2024-11-16 17:06:04.917977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.242 [2024-11-16 17:06:04.918146] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.242 [2024-11-16 17:06:04.918171] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.242 [2024-11-16 17:06:04.918187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.242 [2024-11-16 17:06:04.920749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.242 [2024-11-16 17:06:04.929782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.242 [2024-11-16 17:06:04.930115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.930232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.930270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.242 [2024-11-16 17:06:04.930289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.242 [2024-11-16 17:06:04.930509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.242 [2024-11-16 17:06:04.930673] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.242 [2024-11-16 17:06:04.930700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.242 [2024-11-16 17:06:04.930716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.242 [2024-11-16 17:06:04.932920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.242 [2024-11-16 17:06:04.942338] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.242 [2024-11-16 17:06:04.942648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.942776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.942806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.242 [2024-11-16 17:06:04.942826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.242 [2024-11-16 17:06:04.942974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.242 [2024-11-16 17:06:04.943144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.242 [2024-11-16 17:06:04.943169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.242 [2024-11-16 17:06:04.943186] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.242 [2024-11-16 17:06:04.945311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.242 [2024-11-16 17:06:04.955013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.242 [2024-11-16 17:06:04.955363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.955519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.955550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.242 [2024-11-16 17:06:04.955569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.242 [2024-11-16 17:06:04.955732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.242 [2024-11-16 17:06:04.955921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.242 [2024-11-16 17:06:04.955947] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.242 [2024-11-16 17:06:04.955963] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.242 [2024-11-16 17:06:04.958281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.242 [2024-11-16 17:06:04.967647] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.242 [2024-11-16 17:06:04.967978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.968128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.968176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.242 [2024-11-16 17:06:04.968196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.242 [2024-11-16 17:06:04.968363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.242 [2024-11-16 17:06:04.968550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.242 [2024-11-16 17:06:04.968575] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.242 [2024-11-16 17:06:04.968592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.242 [2024-11-16 17:06:04.970996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.242 [2024-11-16 17:06:04.980197] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.242 [2024-11-16 17:06:04.980494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.980635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.242 [2024-11-16 17:06:04.980672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.242 [2024-11-16 17:06:04.980692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.243 [2024-11-16 17:06:04.980859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.243 [2024-11-16 17:06:04.981028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.243 [2024-11-16 17:06:04.981054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.243 [2024-11-16 17:06:04.981070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.243 [2024-11-16 17:06:04.983550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.504 [2024-11-16 17:06:04.992778] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.504 [2024-11-16 17:06:04.993113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-16 17:06:04.993281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-16 17:06:04.993311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.504 [2024-11-16 17:06:04.993331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.504 [2024-11-16 17:06:04.993515] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.504 [2024-11-16 17:06:04.993735] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.504 [2024-11-16 17:06:04.993762] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.504 [2024-11-16 17:06:04.993779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.504 [2024-11-16 17:06:04.996045] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.504 [2024-11-16 17:06:05.005262] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.505 [2024-11-16 17:06:05.005551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-16 17:06:05.005681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-16 17:06:05.005708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.505 [2024-11-16 17:06:05.005725] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.505 [2024-11-16 17:06:05.005876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.505 [2024-11-16 17:06:05.006123] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.505 [2024-11-16 17:06:05.006149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.505 [2024-11-16 17:06:05.006167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.505 [2024-11-16 17:06:05.008695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.505 [2024-11-16 17:06:05.017762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.505 [2024-11-16 17:06:05.018090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-16 17:06:05.018259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-16 17:06:05.018287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.505 [2024-11-16 17:06:05.018310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.505 [2024-11-16 17:06:05.018477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.505 [2024-11-16 17:06:05.018698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.505 [2024-11-16 17:06:05.018724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.505 [2024-11-16 17:06:05.018742] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.505 [2024-11-16 17:06:05.021150] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.505 [2024-11-16 17:06:05.030317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.505 [2024-11-16 17:06:05.030610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-16 17:06:05.030753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-16 17:06:05.030784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.505 [2024-11-16 17:06:05.030803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.505 [2024-11-16 17:06:05.030970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.505 [2024-11-16 17:06:05.031102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.505 [2024-11-16 17:06:05.031127] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.505 [2024-11-16 17:06:05.031144] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.505 [2024-11-16 17:06:05.033356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.505 [2024-11-16 17:06:05.042775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.505 [2024-11-16 17:06:05.043088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-16 17:06:05.043217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-16 17:06:05.043247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.505 [2024-11-16 17:06:05.043267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.505 [2024-11-16 17:06:05.043452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.505 [2024-11-16 17:06:05.043639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.505 [2024-11-16 17:06:05.043665] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.505 [2024-11-16 17:06:05.043682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.505 [2024-11-16 17:06:05.046087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.505 [2024-11-16 17:06:05.055234] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.505 [2024-11-16 17:06:05.055545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-16 17:06:05.055648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-16 17:06:05.055678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.505 [2024-11-16 17:06:05.055696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.505 [2024-11-16 17:06:05.055904] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.505 [2024-11-16 17:06:05.056056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.505 [2024-11-16 17:06:05.056082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.505 [2024-11-16 17:06:05.056099] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.505 [2024-11-16 17:06:05.058455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.505 [2024-11-16 17:06:05.068006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.505 [2024-11-16 17:06:05.068319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-16 17:06:05.068465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-16 17:06:05.068493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.505 [2024-11-16 17:06:05.068510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.505 [2024-11-16 17:06:05.068702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.505 [2024-11-16 17:06:05.068871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.505 [2024-11-16 17:06:05.068897] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.505 [2024-11-16 17:06:05.068915] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.505 [2024-11-16 17:06:05.071072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.505 [2024-11-16 17:06:05.080565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.505 [2024-11-16 17:06:05.080897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-16 17:06:05.081036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-16 17:06:05.081087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.506 [2024-11-16 17:06:05.081107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.506 [2024-11-16 17:06:05.081273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.506 [2024-11-16 17:06:05.081460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.506 [2024-11-16 17:06:05.081486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.506 [2024-11-16 17:06:05.081503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.506 [2024-11-16 17:06:05.083704] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.506 [2024-11-16 17:06:05.093046] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.506 [2024-11-16 17:06:05.093341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-16 17:06:05.093481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-16 17:06:05.093509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.506 [2024-11-16 17:06:05.093526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.506 [2024-11-16 17:06:05.093655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.506 [2024-11-16 17:06:05.093838] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.506 [2024-11-16 17:06:05.093862] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.506 [2024-11-16 17:06:05.093878] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.506 [2024-11-16 17:06:05.096339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.506 [2024-11-16 17:06:05.105601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.506 [2024-11-16 17:06:05.105975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-16 17:06:05.106125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-16 17:06:05.106153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.506 [2024-11-16 17:06:05.106170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.506 [2024-11-16 17:06:05.106334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.506 [2024-11-16 17:06:05.106484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.506 [2024-11-16 17:06:05.106510] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.506 [2024-11-16 17:06:05.106526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.506 [2024-11-16 17:06:05.108990] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.506 [2024-11-16 17:06:05.118124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.506 [2024-11-16 17:06:05.118410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-16 17:06:05.118537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-16 17:06:05.118568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.506 [2024-11-16 17:06:05.118587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.506 [2024-11-16 17:06:05.118783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.506 [2024-11-16 17:06:05.118936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.506 [2024-11-16 17:06:05.118962] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.506 [2024-11-16 17:06:05.118979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.506 [2024-11-16 17:06:05.121368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.506 [2024-11-16 17:06:05.130754] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.506 [2024-11-16 17:06:05.131027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-16 17:06:05.131177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-16 17:06:05.131208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.506 [2024-11-16 17:06:05.131227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.506 [2024-11-16 17:06:05.131412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.506 [2024-11-16 17:06:05.131599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.506 [2024-11-16 17:06:05.131643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.506 [2024-11-16 17:06:05.131662] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.506 [2024-11-16 17:06:05.133891] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.506 [2024-11-16 17:06:05.143277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.506 [2024-11-16 17:06:05.143631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-16 17:06:05.143804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-16 17:06:05.143832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.506 [2024-11-16 17:06:05.143849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.506 [2024-11-16 17:06:05.144069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.506 [2024-11-16 17:06:05.144306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.506 [2024-11-16 17:06:05.144331] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.506 [2024-11-16 17:06:05.144348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.506 [2024-11-16 17:06:05.146660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.506 [2024-11-16 17:06:05.155766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.506 [2024-11-16 17:06:05.156130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-16 17:06:05.156324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-16 17:06:05.156353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.506 [2024-11-16 17:06:05.156370] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.506 [2024-11-16 17:06:05.156587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.506 [2024-11-16 17:06:05.156717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.507 [2024-11-16 17:06:05.156743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.507 [2024-11-16 17:06:05.156760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.507 [2024-11-16 17:06:05.159006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.507 [2024-11-16 17:06:05.168222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.507 [2024-11-16 17:06:05.168607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-16 17:06:05.168773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-16 17:06:05.168823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.507 [2024-11-16 17:06:05.168842] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.507 [2024-11-16 17:06:05.169010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.507 [2024-11-16 17:06:05.169197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.507 [2024-11-16 17:06:05.169222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.507 [2024-11-16 17:06:05.169248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.507 [2024-11-16 17:06:05.171499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.507 [2024-11-16 17:06:05.180844] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.507 [2024-11-16 17:06:05.181230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-16 17:06:05.181374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-16 17:06:05.181405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.507 [2024-11-16 17:06:05.181424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.507 [2024-11-16 17:06:05.181608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.507 [2024-11-16 17:06:05.181811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.507 [2024-11-16 17:06:05.181837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.507 [2024-11-16 17:06:05.181853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.507 [2024-11-16 17:06:05.184316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.507 [2024-11-16 17:06:05.193365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.507 [2024-11-16 17:06:05.193690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-16 17:06:05.193846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-16 17:06:05.193876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.507 [2024-11-16 17:06:05.193896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.507 [2024-11-16 17:06:05.194081] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.507 [2024-11-16 17:06:05.194250] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.507 [2024-11-16 17:06:05.194275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.507 [2024-11-16 17:06:05.194292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.507 [2024-11-16 17:06:05.196745] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.507 [2024-11-16 17:06:05.205893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.507 [2024-11-16 17:06:05.206212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-16 17:06:05.206341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-16 17:06:05.206371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.507 [2024-11-16 17:06:05.206390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.507 [2024-11-16 17:06:05.206539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.507 [2024-11-16 17:06:05.206723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.507 [2024-11-16 17:06:05.206749] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.507 [2024-11-16 17:06:05.206766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.507 [2024-11-16 17:06:05.208999] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.507 [2024-11-16 17:06:05.218417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.507 [2024-11-16 17:06:05.218748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-16 17:06:05.218901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-16 17:06:05.218932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.507 [2024-11-16 17:06:05.218951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.507 [2024-11-16 17:06:05.219136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.507 [2024-11-16 17:06:05.219305] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.507 [2024-11-16 17:06:05.219330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.507 [2024-11-16 17:06:05.219347] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.507 [2024-11-16 17:06:05.221712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.507 [2024-11-16 17:06:05.231199] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.507 [2024-11-16 17:06:05.231492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-16 17:06:05.231645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-16 17:06:05.231673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.507 [2024-11-16 17:06:05.231707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.507 [2024-11-16 17:06:05.231875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.507 [2024-11-16 17:06:05.232026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.507 [2024-11-16 17:06:05.232051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.507 [2024-11-16 17:06:05.232068] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.507 [2024-11-16 17:06:05.234406] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.508 [2024-11-16 17:06:05.243890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.508 [2024-11-16 17:06:05.244260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-16 17:06:05.244364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-16 17:06:05.244392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.508 [2024-11-16 17:06:05.244411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.508 [2024-11-16 17:06:05.244578] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.508 [2024-11-16 17:06:05.244723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.508 [2024-11-16 17:06:05.244747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.508 [2024-11-16 17:06:05.244763] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.508 [2024-11-16 17:06:05.247190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.769 [2024-11-16 17:06:05.256655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.769 [2024-11-16 17:06:05.256977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.769 [2024-11-16 17:06:05.257129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.769 [2024-11-16 17:06:05.257160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.769 [2024-11-16 17:06:05.257179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.769 [2024-11-16 17:06:05.257364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.769 [2024-11-16 17:06:05.257550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.769 [2024-11-16 17:06:05.257576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.769 [2024-11-16 17:06:05.257592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.769 [2024-11-16 17:06:05.259799] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.769 [2024-11-16 17:06:05.269045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.769 [2024-11-16 17:06:05.269324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.769 [2024-11-16 17:06:05.269453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.769 [2024-11-16 17:06:05.269482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.769 [2024-11-16 17:06:05.269501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.769 [2024-11-16 17:06:05.269700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.769 [2024-11-16 17:06:05.269851] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.769 [2024-11-16 17:06:05.269876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.769 [2024-11-16 17:06:05.269893] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.769 [2024-11-16 17:06:05.272121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.769 [2024-11-16 17:06:05.281468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.769 [2024-11-16 17:06:05.281780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.769 [2024-11-16 17:06:05.281911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.769 [2024-11-16 17:06:05.281941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.769 [2024-11-16 17:06:05.281960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.769 [2024-11-16 17:06:05.282108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.769 [2024-11-16 17:06:05.282240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.769 [2024-11-16 17:06:05.282263] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.769 [2024-11-16 17:06:05.282279] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.770 [2024-11-16 17:06:05.284580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.770 [2024-11-16 17:06:05.294085] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.770 [2024-11-16 17:06:05.294439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.294599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.294637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.770 [2024-11-16 17:06:05.294656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.770 [2024-11-16 17:06:05.294888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.770 [2024-11-16 17:06:05.295093] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.770 [2024-11-16 17:06:05.295118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.770 [2024-11-16 17:06:05.295135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.770 [2024-11-16 17:06:05.297398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.770 [2024-11-16 17:06:05.306895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.770 [2024-11-16 17:06:05.307236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.307364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.307393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.770 [2024-11-16 17:06:05.307411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.770 [2024-11-16 17:06:05.307560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.770 [2024-11-16 17:06:05.307723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.770 [2024-11-16 17:06:05.307747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.770 [2024-11-16 17:06:05.307764] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.770 [2024-11-16 17:06:05.310169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.770 [2024-11-16 17:06:05.319383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.770 [2024-11-16 17:06:05.319707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.319832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.319857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.770 [2024-11-16 17:06:05.319875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.770 [2024-11-16 17:06:05.320020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.770 [2024-11-16 17:06:05.320179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.770 [2024-11-16 17:06:05.320205] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.770 [2024-11-16 17:06:05.320222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.770 [2024-11-16 17:06:05.322613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.770 [2024-11-16 17:06:05.332098] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.770 [2024-11-16 17:06:05.332407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.332558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.332586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.770 [2024-11-16 17:06:05.332609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.770 [2024-11-16 17:06:05.332720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.770 [2024-11-16 17:06:05.332909] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.770 [2024-11-16 17:06:05.332933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.770 [2024-11-16 17:06:05.332950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.770 [2024-11-16 17:06:05.335268] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.770 [2024-11-16 17:06:05.344527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.770 [2024-11-16 17:06:05.344897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.345048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.345079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.770 [2024-11-16 17:06:05.345098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.770 [2024-11-16 17:06:05.345283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.770 [2024-11-16 17:06:05.345398] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.770 [2024-11-16 17:06:05.345424] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.770 [2024-11-16 17:06:05.345441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.770 [2024-11-16 17:06:05.347936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.770 [2024-11-16 17:06:05.356991] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.770 [2024-11-16 17:06:05.357304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.357443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.357473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.770 [2024-11-16 17:06:05.357492] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.770 [2024-11-16 17:06:05.357673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.770 [2024-11-16 17:06:05.357861] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.770 [2024-11-16 17:06:05.357886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.770 [2024-11-16 17:06:05.357903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.770 [2024-11-16 17:06:05.360242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.770 [2024-11-16 17:06:05.369576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.770 [2024-11-16 17:06:05.369905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.370037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.370068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.770 [2024-11-16 17:06:05.370087] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.770 [2024-11-16 17:06:05.370277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.770 [2024-11-16 17:06:05.370409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.770 [2024-11-16 17:06:05.370435] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.770 [2024-11-16 17:06:05.370452] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.770 [2024-11-16 17:06:05.372692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.770 [2024-11-16 17:06:05.382000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.770 [2024-11-16 17:06:05.382335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.382473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.382501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.770 [2024-11-16 17:06:05.382519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.770 [2024-11-16 17:06:05.382713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.770 [2024-11-16 17:06:05.382866] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.770 [2024-11-16 17:06:05.382891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.770 [2024-11-16 17:06:05.382908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.770 [2024-11-16 17:06:05.385208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.770 [2024-11-16 17:06:05.394563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.770 [2024-11-16 17:06:05.394843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.394986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.395013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.770 [2024-11-16 17:06:05.395030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.770 [2024-11-16 17:06:05.395234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.770 [2024-11-16 17:06:05.395403] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.770 [2024-11-16 17:06:05.395428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.770 [2024-11-16 17:06:05.395446] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.770 [2024-11-16 17:06:05.397919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.770 [2024-11-16 17:06:05.407358] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.770 [2024-11-16 17:06:05.407647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.770 [2024-11-16 17:06:05.407775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.407803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.771 [2024-11-16 17:06:05.407820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.771 [2024-11-16 17:06:05.407982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.771 [2024-11-16 17:06:05.408104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.771 [2024-11-16 17:06:05.408130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.771 [2024-11-16 17:06:05.408147] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.771 [2024-11-16 17:06:05.410611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.771 [2024-11-16 17:06:05.419967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.771 [2024-11-16 17:06:05.420315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.420476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.420505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.771 [2024-11-16 17:06:05.420523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.771 [2024-11-16 17:06:05.420739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.771 [2024-11-16 17:06:05.420909] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.771 [2024-11-16 17:06:05.420932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.771 [2024-11-16 17:06:05.420948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.771 [2024-11-16 17:06:05.423363] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.771 [2024-11-16 17:06:05.432543] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.771 [2024-11-16 17:06:05.432852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.433089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.433147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.771 [2024-11-16 17:06:05.433166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.771 [2024-11-16 17:06:05.433296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.771 [2024-11-16 17:06:05.433484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.771 [2024-11-16 17:06:05.433509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.771 [2024-11-16 17:06:05.433526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.771 [2024-11-16 17:06:05.435876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.771 [2024-11-16 17:06:05.445064] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.771 [2024-11-16 17:06:05.445346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.445469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.445512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.771 [2024-11-16 17:06:05.445530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.771 [2024-11-16 17:06:05.445780] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.771 [2024-11-16 17:06:05.445969] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.771 [2024-11-16 17:06:05.446003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.771 [2024-11-16 17:06:05.446021] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.771 [2024-11-16 17:06:05.448393] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.771 [2024-11-16 17:06:05.457655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.771 [2024-11-16 17:06:05.457964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.458120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.458150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.771 [2024-11-16 17:06:05.458170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.771 [2024-11-16 17:06:05.458354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.771 [2024-11-16 17:06:05.458524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.771 [2024-11-16 17:06:05.458549] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.771 [2024-11-16 17:06:05.458565] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.771 [2024-11-16 17:06:05.460879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.771 [2024-11-16 17:06:05.470184] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.771 [2024-11-16 17:06:05.470534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.470690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.470722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.771 [2024-11-16 17:06:05.470741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.771 [2024-11-16 17:06:05.470909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.771 [2024-11-16 17:06:05.471076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.771 [2024-11-16 17:06:05.471101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.771 [2024-11-16 17:06:05.471118] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.771 [2024-11-16 17:06:05.473402] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.771 [2024-11-16 17:06:05.482825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.771 [2024-11-16 17:06:05.483182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.483334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.483365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.771 [2024-11-16 17:06:05.483384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.771 [2024-11-16 17:06:05.483550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.771 [2024-11-16 17:06:05.483786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.771 [2024-11-16 17:06:05.483812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.771 [2024-11-16 17:06:05.483835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.771 [2024-11-16 17:06:05.486031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.771 [2024-11-16 17:06:05.495590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.771 [2024-11-16 17:06:05.495946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.496065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.496093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.771 [2024-11-16 17:06:05.496110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.771 [2024-11-16 17:06:05.496271] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.771 [2024-11-16 17:06:05.496422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.771 [2024-11-16 17:06:05.496447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.771 [2024-11-16 17:06:05.496464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.771 [2024-11-16 17:06:05.498988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.771 [2024-11-16 17:06:05.508182] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.771 [2024-11-16 17:06:05.508467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.508659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.771 [2024-11-16 17:06:05.508687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:19.771 [2024-11-16 17:06:05.508704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:19.771 [2024-11-16 17:06:05.508884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:19.771 [2024-11-16 17:06:05.509052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.771 [2024-11-16 17:06:05.509078] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.771 [2024-11-16 17:06:05.509094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.771 [2024-11-16 17:06:05.511320] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.031 [2024-11-16 17:06:05.520854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.031 [2024-11-16 17:06:05.521212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.521389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.521419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.031 [2024-11-16 17:06:05.521438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.031 [2024-11-16 17:06:05.521587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.031 [2024-11-16 17:06:05.521750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.031 [2024-11-16 17:06:05.521775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.031 [2024-11-16 17:06:05.521792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.031 [2024-11-16 17:06:05.524009] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.031 [2024-11-16 17:06:05.533593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.031 [2024-11-16 17:06:05.533844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.534069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.534141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.031 [2024-11-16 17:06:05.534160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.031 [2024-11-16 17:06:05.534325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.031 [2024-11-16 17:06:05.534495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.031 [2024-11-16 17:06:05.534520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.031 [2024-11-16 17:06:05.534538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.031 [2024-11-16 17:06:05.537005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.031 [2024-11-16 17:06:05.545971] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.031 [2024-11-16 17:06:05.546311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.546439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.546469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.031 [2024-11-16 17:06:05.546488] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.031 [2024-11-16 17:06:05.546685] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.031 [2024-11-16 17:06:05.546873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.031 [2024-11-16 17:06:05.546897] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.031 [2024-11-16 17:06:05.546914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.031 [2024-11-16 17:06:05.549136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.031 [2024-11-16 17:06:05.558412] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.031 [2024-11-16 17:06:05.558825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.558948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.558975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.031 [2024-11-16 17:06:05.559008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.031 [2024-11-16 17:06:05.559174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.031 [2024-11-16 17:06:05.559345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.031 [2024-11-16 17:06:05.559369] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.031 [2024-11-16 17:06:05.559386] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.031 [2024-11-16 17:06:05.561778] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.031 [2024-11-16 17:06:05.570837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.031 [2024-11-16 17:06:05.571185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.571310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.571338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.031 [2024-11-16 17:06:05.571355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.031 [2024-11-16 17:06:05.571559] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.031 [2024-11-16 17:06:05.571724] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.031 [2024-11-16 17:06:05.571749] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.031 [2024-11-16 17:06:05.571766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.031 [2024-11-16 17:06:05.574172] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.031 [2024-11-16 17:06:05.583608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.031 [2024-11-16 17:06:05.583965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.584098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.584127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.031 [2024-11-16 17:06:05.584146] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.031 [2024-11-16 17:06:05.584294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.031 [2024-11-16 17:06:05.584409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.031 [2024-11-16 17:06:05.584434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.031 [2024-11-16 17:06:05.584451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.031 [2024-11-16 17:06:05.586866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.031 [2024-11-16 17:06:05.596256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.031 [2024-11-16 17:06:05.596498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.596625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.596670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.031 [2024-11-16 17:06:05.596688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.031 [2024-11-16 17:06:05.596864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.031 [2024-11-16 17:06:05.597063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.031 [2024-11-16 17:06:05.597088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.031 [2024-11-16 17:06:05.597105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.031 [2024-11-16 17:06:05.599436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.031 [2024-11-16 17:06:05.608621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.031 [2024-11-16 17:06:05.609008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.609162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.609191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.031 [2024-11-16 17:06:05.609210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.031 [2024-11-16 17:06:05.609340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.031 [2024-11-16 17:06:05.609455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.031 [2024-11-16 17:06:05.609479] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.031 [2024-11-16 17:06:05.609496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.031 [2024-11-16 17:06:05.611926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.031 [2024-11-16 17:06:05.621160] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.031 [2024-11-16 17:06:05.621488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.621643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.621674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.031 [2024-11-16 17:06:05.621693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.031 [2024-11-16 17:06:05.621841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.031 [2024-11-16 17:06:05.622011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.031 [2024-11-16 17:06:05.622036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.031 [2024-11-16 17:06:05.622052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.031 [2024-11-16 17:06:05.624439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.031 [2024-11-16 17:06:05.633641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.031 [2024-11-16 17:06:05.633952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.634088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.634115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.031 [2024-11-16 17:06:05.634132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.031 [2024-11-16 17:06:05.634307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.031 [2024-11-16 17:06:05.634495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.031 [2024-11-16 17:06:05.634519] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.031 [2024-11-16 17:06:05.634536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.031 [2024-11-16 17:06:05.636878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.031 [2024-11-16 17:06:05.646057] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.031 [2024-11-16 17:06:05.646334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.646465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.646500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.031 [2024-11-16 17:06:05.646520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.031 [2024-11-16 17:06:05.646732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.031 [2024-11-16 17:06:05.646940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.031 [2024-11-16 17:06:05.646965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.031 [2024-11-16 17:06:05.646981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.031 [2024-11-16 17:06:05.649277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.031 [2024-11-16 17:06:05.658552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.031 [2024-11-16 17:06:05.658848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.659016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.659043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.031 [2024-11-16 17:06:05.659077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.031 [2024-11-16 17:06:05.659188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.031 [2024-11-16 17:06:05.659339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.031 [2024-11-16 17:06:05.659364] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.031 [2024-11-16 17:06:05.659380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.031 [2024-11-16 17:06:05.661585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.031 [2024-11-16 17:06:05.671033] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.031 [2024-11-16 17:06:05.671327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.671456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.671486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.031 [2024-11-16 17:06:05.671504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.031 [2024-11-16 17:06:05.671680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.031 [2024-11-16 17:06:05.671850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.031 [2024-11-16 17:06:05.671874] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.031 [2024-11-16 17:06:05.671891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.031 [2024-11-16 17:06:05.674420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.031 [2024-11-16 17:06:05.683585] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.031 [2024-11-16 17:06:05.683877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.684040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.031 [2024-11-16 17:06:05.684066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.031 [2024-11-16 17:06:05.684088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.032 [2024-11-16 17:06:05.684237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.032 [2024-11-16 17:06:05.684447] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.032 [2024-11-16 17:06:05.684471] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.032 [2024-11-16 17:06:05.684487] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.032 [2024-11-16 17:06:05.686740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.032 [2024-11-16 17:06:05.695806] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.032 [2024-11-16 17:06:05.696085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.032 [2024-11-16 17:06:05.696227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.032 [2024-11-16 17:06:05.696253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.032 [2024-11-16 17:06:05.696270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.032 [2024-11-16 17:06:05.696433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.032 [2024-11-16 17:06:05.696566] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.032 [2024-11-16 17:06:05.696587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.032 [2024-11-16 17:06:05.696602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.032 [2024-11-16 17:06:05.698511] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.032 [2024-11-16 17:06:05.708509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.032 [2024-11-16 17:06:05.708812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.032 [2024-11-16 17:06:05.708902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.032 [2024-11-16 17:06:05.708929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.032 [2024-11-16 17:06:05.708946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.032 [2024-11-16 17:06:05.709124] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.032 [2024-11-16 17:06:05.709293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.032 [2024-11-16 17:06:05.709318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.032 [2024-11-16 17:06:05.709334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.032 [2024-11-16 17:06:05.711608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.032 [2024-11-16 17:06:05.721038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.032 [2024-11-16 17:06:05.721346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.032 [2024-11-16 17:06:05.721446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.032 [2024-11-16 17:06:05.721471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.032 [2024-11-16 17:06:05.721487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.032 [2024-11-16 17:06:05.721646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.032 [2024-11-16 17:06:05.721796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.032 [2024-11-16 17:06:05.721821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.032 [2024-11-16 17:06:05.721838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.032 [2024-11-16 17:06:05.724241] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.032 [2024-11-16 17:06:05.733669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.032 [2024-11-16 17:06:05.733986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.032 [2024-11-16 17:06:05.734103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.032 [2024-11-16 17:06:05.734130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.032 [2024-11-16 17:06:05.734148] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.032 [2024-11-16 17:06:05.734291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.032 [2024-11-16 17:06:05.734511] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.032 [2024-11-16 17:06:05.734536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.032 [2024-11-16 17:06:05.734552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.032 [2024-11-16 17:06:05.736806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.032 [2024-11-16 17:06:05.746186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.032 [2024-11-16 17:06:05.746505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.032 [2024-11-16 17:06:05.746582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.032 [2024-11-16 17:06:05.746631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.032 [2024-11-16 17:06:05.746649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.032 [2024-11-16 17:06:05.746815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.032 [2024-11-16 17:06:05.746961] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.032 [2024-11-16 17:06:05.746986] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.032 [2024-11-16 17:06:05.747003] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.032 [2024-11-16 17:06:05.749264] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.032 [2024-11-16 17:06:05.758810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.032 [2024-11-16 17:06:05.759115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.032 [2024-11-16 17:06:05.759246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.032 [2024-11-16 17:06:05.759276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.032 [2024-11-16 17:06:05.759295] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.032 [2024-11-16 17:06:05.759460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.032 [2024-11-16 17:06:05.759603] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.032 [2024-11-16 17:06:05.759637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.032 [2024-11-16 17:06:05.759670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.032 [2024-11-16 17:06:05.762062] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.032 [2024-11-16 17:06:05.771402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.032 [2024-11-16 17:06:05.771702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.032 [2024-11-16 17:06:05.771826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.032 [2024-11-16 17:06:05.771853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.032 [2024-11-16 17:06:05.771871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.032 [2024-11-16 17:06:05.772066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.032 [2024-11-16 17:06:05.772236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.032 [2024-11-16 17:06:05.772260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.032 [2024-11-16 17:06:05.772277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.032 [2024-11-16 17:06:05.774611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.290 [2024-11-16 17:06:05.783997] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.290 [2024-11-16 17:06:05.784290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.290 [2024-11-16 17:06:05.784416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.290 [2024-11-16 17:06:05.784447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.290 [2024-11-16 17:06:05.784466] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.290 [2024-11-16 17:06:05.784644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.290 [2024-11-16 17:06:05.784783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.290 [2024-11-16 17:06:05.784805] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.290 [2024-11-16 17:06:05.784821] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.290 [2024-11-16 17:06:05.787161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.290 [2024-11-16 17:06:05.796650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.290 [2024-11-16 17:06:05.796941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.290 [2024-11-16 17:06:05.797078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.290 [2024-11-16 17:06:05.797105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.290 [2024-11-16 17:06:05.797122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.290 [2024-11-16 17:06:05.797331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.290 [2024-11-16 17:06:05.797502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.290 [2024-11-16 17:06:05.797533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.290 [2024-11-16 17:06:05.797550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.290 [2024-11-16 17:06:05.799850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.290 [2024-11-16 17:06:05.809048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.290 [2024-11-16 17:06:05.809405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.290 [2024-11-16 17:06:05.809497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.290 [2024-11-16 17:06:05.809528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.290 [2024-11-16 17:06:05.809546] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.290 [2024-11-16 17:06:05.809746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.290 [2024-11-16 17:06:05.809901] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.290 [2024-11-16 17:06:05.809939] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.290 [2024-11-16 17:06:05.809956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.290 [2024-11-16 17:06:05.812440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.290 [2024-11-16 17:06:05.821582] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.290 [2024-11-16 17:06:05.821874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.290 [2024-11-16 17:06:05.821988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.290 [2024-11-16 17:06:05.822017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.290 [2024-11-16 17:06:05.822036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.290 [2024-11-16 17:06:05.822239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.290 [2024-11-16 17:06:05.822408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.290 [2024-11-16 17:06:05.822433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.290 [2024-11-16 17:06:05.822451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.290 [2024-11-16 17:06:05.824748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.290 [2024-11-16 17:06:05.834169] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.290 [2024-11-16 17:06:05.834445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.290 [2024-11-16 17:06:05.834596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.290 [2024-11-16 17:06:05.834640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.290 [2024-11-16 17:06:05.834658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.291 [2024-11-16 17:06:05.834810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.291 [2024-11-16 17:06:05.835048] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.291 [2024-11-16 17:06:05.835073] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.291 [2024-11-16 17:06:05.835096] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.291 [2024-11-16 17:06:05.837497] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.291 [2024-11-16 17:06:05.846697] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.291 [2024-11-16 17:06:05.846998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.291 [2024-11-16 17:06:05.847160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.291 [2024-11-16 17:06:05.847186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.291 [2024-11-16 17:06:05.847203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.291 [2024-11-16 17:06:05.847344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.291 [2024-11-16 17:06:05.847515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.291 [2024-11-16 17:06:05.847539] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.291 [2024-11-16 17:06:05.847556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.291 [2024-11-16 17:06:05.849941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.291 [2024-11-16 17:06:05.859367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.291 [2024-11-16 17:06:05.859694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.291 [2024-11-16 17:06:05.859790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.291 [2024-11-16 17:06:05.859817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.291 [2024-11-16 17:06:05.859834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.291 [2024-11-16 17:06:05.859989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.291 [2024-11-16 17:06:05.860159] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.291 [2024-11-16 17:06:05.860183] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.291 [2024-11-16 17:06:05.860200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.291 [2024-11-16 17:06:05.862528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.291 [2024-11-16 17:06:05.871980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.291 [2024-11-16 17:06:05.872277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.291 [2024-11-16 17:06:05.872408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.291 [2024-11-16 17:06:05.872438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.291 [2024-11-16 17:06:05.872457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.291 [2024-11-16 17:06:05.872633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.291 [2024-11-16 17:06:05.872827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.291 [2024-11-16 17:06:05.872849] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.291 [2024-11-16 17:06:05.872864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.291 [2024-11-16 17:06:05.875209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.291 [2024-11-16 17:06:05.884577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.291 [2024-11-16 17:06:05.884850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.291 [2024-11-16 17:06:05.885007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.291 [2024-11-16 17:06:05.885034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.291 [2024-11-16 17:06:05.885051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.291 [2024-11-16 17:06:05.885225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.291 [2024-11-16 17:06:05.885396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.291 [2024-11-16 17:06:05.885420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.291 [2024-11-16 17:06:05.885437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.291 [2024-11-16 17:06:05.887898] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.291 [2024-11-16 17:06:05.897086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.291 [2024-11-16 17:06:05.897448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.291 [2024-11-16 17:06:05.897567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.291 [2024-11-16 17:06:05.897595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.291 [2024-11-16 17:06:05.897613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.291 [2024-11-16 17:06:05.897810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.291 [2024-11-16 17:06:05.897962] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.291 [2024-11-16 17:06:05.897987] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.291 [2024-11-16 17:06:05.898003] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.291 [2024-11-16 17:06:05.900317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.291 [2024-11-16 17:06:05.909561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.291 [2024-11-16 17:06:05.909893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.291 [2024-11-16 17:06:05.910124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.291 [2024-11-16 17:06:05.910168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.291 [2024-11-16 17:06:05.910187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.291 [2024-11-16 17:06:05.910352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.291 [2024-11-16 17:06:05.910539] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.291 [2024-11-16 17:06:05.910564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.291 [2024-11-16 17:06:05.910581] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.291 [2024-11-16 17:06:05.912796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.291 [2024-11-16 17:06:05.922049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.291 [2024-11-16 17:06:05.922397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.291 [2024-11-16 17:06:05.922534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.291 [2024-11-16 17:06:05.922561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.291 [2024-11-16 17:06:05.922578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.291 [2024-11-16 17:06:05.922739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.291 [2024-11-16 17:06:05.922938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.291 [2024-11-16 17:06:05.922963] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.291 [2024-11-16 17:06:05.922980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.291 [2024-11-16 17:06:05.925475] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.292 [2024-11-16 17:06:05.934811] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.292 [2024-11-16 17:06:05.935115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.292 [2024-11-16 17:06:05.935288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.292 [2024-11-16 17:06:05.935336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.292 [2024-11-16 17:06:05.935355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.292 [2024-11-16 17:06:05.935521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.292 [2024-11-16 17:06:05.935702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.292 [2024-11-16 17:06:05.935728] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.292 [2024-11-16 17:06:05.935744] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.292 [2024-11-16 17:06:05.938094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.292 [2024-11-16 17:06:05.947328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.292 [2024-11-16 17:06:05.947641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.292 [2024-11-16 17:06:05.947746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.292 [2024-11-16 17:06:05.947776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.292 [2024-11-16 17:06:05.947794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.292 [2024-11-16 17:06:05.947978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.292 [2024-11-16 17:06:05.948148] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.292 [2024-11-16 17:06:05.948173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.292 [2024-11-16 17:06:05.948189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.292 [2024-11-16 17:06:05.950501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.292 [2024-11-16 17:06:05.959830] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.292 [2024-11-16 17:06:05.960115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.292 [2024-11-16 17:06:05.960271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.292 [2024-11-16 17:06:05.960314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.292 [2024-11-16 17:06:05.960332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.292 [2024-11-16 17:06:05.960474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.292 [2024-11-16 17:06:05.960656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.292 [2024-11-16 17:06:05.960682] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.292 [2024-11-16 17:06:05.960698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.292 [2024-11-16 17:06:05.962975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.292 [2024-11-16 17:06:05.972326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.292 [2024-11-16 17:06:05.972657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.292 [2024-11-16 17:06:05.972801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.292 [2024-11-16 17:06:05.972829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.292 [2024-11-16 17:06:05.972846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.292 [2024-11-16 17:06:05.973007] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.292 [2024-11-16 17:06:05.973190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.292 [2024-11-16 17:06:05.973215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.292 [2024-11-16 17:06:05.973232] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.292 [2024-11-16 17:06:05.975683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.292 [2024-11-16 17:06:05.984841] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.292 [2024-11-16 17:06:05.985117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.292 [2024-11-16 17:06:05.985271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.292 [2024-11-16 17:06:05.985301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.292 [2024-11-16 17:06:05.985320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.292 [2024-11-16 17:06:05.985504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.292 [2024-11-16 17:06:05.985685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.292 [2024-11-16 17:06:05.985710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.292 [2024-11-16 17:06:05.985727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.292 [2024-11-16 17:06:05.987878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.292 [2024-11-16 17:06:05.997420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.292 [2024-11-16 17:06:05.997680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.292 [2024-11-16 17:06:05.997811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.292 [2024-11-16 17:06:05.997846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.292 [2024-11-16 17:06:05.997865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.292 [2024-11-16 17:06:05.998068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.292 [2024-11-16 17:06:05.998293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.292 [2024-11-16 17:06:05.998317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.292 [2024-11-16 17:06:05.998334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.292 [2024-11-16 17:06:06.000675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.292 [2024-11-16 17:06:06.009987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.292 [2024-11-16 17:06:06.010315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.292 [2024-11-16 17:06:06.010440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.292 [2024-11-16 17:06:06.010467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.292 [2024-11-16 17:06:06.010484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.292 [2024-11-16 17:06:06.010658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.292 [2024-11-16 17:06:06.010842] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.292 [2024-11-16 17:06:06.010867] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.292 [2024-11-16 17:06:06.010884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.292 [2024-11-16 17:06:06.013200] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.293 [2024-11-16 17:06:06.022458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.293 [2024-11-16 17:06:06.022842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.293 [2024-11-16 17:06:06.023004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.293 [2024-11-16 17:06:06.023048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.293 [2024-11-16 17:06:06.023067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.293 [2024-11-16 17:06:06.023233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.293 [2024-11-16 17:06:06.023366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.293 [2024-11-16 17:06:06.023391] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.293 [2024-11-16 17:06:06.023407] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.293 [2024-11-16 17:06:06.025786] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.293 [2024-11-16 17:06:06.035130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.293 [2024-11-16 17:06:06.035417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.293 [2024-11-16 17:06:06.035582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.293 [2024-11-16 17:06:06.035609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.293 [2024-11-16 17:06:06.035641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.293 [2024-11-16 17:06:06.035808] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.293 [2024-11-16 17:06:06.035975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.293 [2024-11-16 17:06:06.035999] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.293 [2024-11-16 17:06:06.036016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.293 [2024-11-16 17:06:06.038377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.553 [2024-11-16 17:06:06.047713] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.553 [2024-11-16 17:06:06.047972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-16 17:06:06.048128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-16 17:06:06.048158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.553 [2024-11-16 17:06:06.048177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.553 [2024-11-16 17:06:06.048343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.553 [2024-11-16 17:06:06.048567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.553 [2024-11-16 17:06:06.048591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.553 [2024-11-16 17:06:06.048609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.553 [2024-11-16 17:06:06.050849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.553 [2024-11-16 17:06:06.060307] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.553 [2024-11-16 17:06:06.060637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-16 17:06:06.060765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-16 17:06:06.060795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.553 [2024-11-16 17:06:06.060813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.553 [2024-11-16 17:06:06.060962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.553 [2024-11-16 17:06:06.061114] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.553 [2024-11-16 17:06:06.061138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.553 [2024-11-16 17:06:06.061155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.553 [2024-11-16 17:06:06.063475] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.553 [2024-11-16 17:06:06.072946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.553 [2024-11-16 17:06:06.073269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-16 17:06:06.073396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-16 17:06:06.073426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.553 [2024-11-16 17:06:06.073451] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.553 [2024-11-16 17:06:06.073604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.553 [2024-11-16 17:06:06.073749] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.553 [2024-11-16 17:06:06.073774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.553 [2024-11-16 17:06:06.073791] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.553 [2024-11-16 17:06:06.075997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.553 [2024-11-16 17:06:06.085413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.554 [2024-11-16 17:06:06.085748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.085911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.085938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.554 [2024-11-16 17:06:06.085955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.554 [2024-11-16 17:06:06.086169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.554 [2024-11-16 17:06:06.086357] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.554 [2024-11-16 17:06:06.086381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.554 [2024-11-16 17:06:06.086398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.554 [2024-11-16 17:06:06.088737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.554 [2024-11-16 17:06:06.097965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.554 [2024-11-16 17:06:06.098307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.098465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.098491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.554 [2024-11-16 17:06:06.098523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.554 [2024-11-16 17:06:06.098709] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.554 [2024-11-16 17:06:06.098900] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.554 [2024-11-16 17:06:06.098925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.554 [2024-11-16 17:06:06.098941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.554 [2024-11-16 17:06:06.101365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.554 [2024-11-16 17:06:06.110602] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.554 [2024-11-16 17:06:06.110921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.111070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.111099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.554 [2024-11-16 17:06:06.111118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.554 [2024-11-16 17:06:06.111248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.554 [2024-11-16 17:06:06.111418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.554 [2024-11-16 17:06:06.111447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.554 [2024-11-16 17:06:06.111464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.554 [2024-11-16 17:06:06.113563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.554 [2024-11-16 17:06:06.123099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.554 [2024-11-16 17:06:06.123435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.123561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.123587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.554 [2024-11-16 17:06:06.123604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.554 [2024-11-16 17:06:06.123830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.554 [2024-11-16 17:06:06.124018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.554 [2024-11-16 17:06:06.124042] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.554 [2024-11-16 17:06:06.124059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.554 [2024-11-16 17:06:06.126322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.554 [2024-11-16 17:06:06.135612] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.554 [2024-11-16 17:06:06.135928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.136096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.136123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.554 [2024-11-16 17:06:06.136139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.554 [2024-11-16 17:06:06.136253] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.554 [2024-11-16 17:06:06.136444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.554 [2024-11-16 17:06:06.136469] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.554 [2024-11-16 17:06:06.136486] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.554 [2024-11-16 17:06:06.138848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.554 [2024-11-16 17:06:06.148166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.554 [2024-11-16 17:06:06.148511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.148663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.148694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.554 [2024-11-16 17:06:06.148713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.554 [2024-11-16 17:06:06.148861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.554 [2024-11-16 17:06:06.149012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.554 [2024-11-16 17:06:06.149036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.554 [2024-11-16 17:06:06.149059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.554 [2024-11-16 17:06:06.151391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.554 [2024-11-16 17:06:06.160590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.554 [2024-11-16 17:06:06.160844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.161052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.161079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.554 [2024-11-16 17:06:06.161096] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.554 [2024-11-16 17:06:06.161258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.554 [2024-11-16 17:06:06.161464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.554 [2024-11-16 17:06:06.161488] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.554 [2024-11-16 17:06:06.161505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.554 [2024-11-16 17:06:06.164010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.554 [2024-11-16 17:06:06.173209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.554 [2024-11-16 17:06:06.173459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.173588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.173627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.554 [2024-11-16 17:06:06.173648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.554 [2024-11-16 17:06:06.173796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.554 [2024-11-16 17:06:06.173930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.554 [2024-11-16 17:06:06.173954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.554 [2024-11-16 17:06:06.173971] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.554 [2024-11-16 17:06:06.176124] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.554 [2024-11-16 17:06:06.185655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.554 [2024-11-16 17:06:06.185950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.186078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.186107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.554 [2024-11-16 17:06:06.186125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.554 [2024-11-16 17:06:06.186291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.554 [2024-11-16 17:06:06.186478] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.554 [2024-11-16 17:06:06.186503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.554 [2024-11-16 17:06:06.186519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.554 [2024-11-16 17:06:06.188904] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.554 [2024-11-16 17:06:06.198360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.554 [2024-11-16 17:06:06.198677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.198830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-16 17:06:06.198860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.555 [2024-11-16 17:06:06.198878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.555 [2024-11-16 17:06:06.199062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.555 [2024-11-16 17:06:06.199196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.555 [2024-11-16 17:06:06.199221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.555 [2024-11-16 17:06:06.199238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.555 [2024-11-16 17:06:06.201707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.555 [2024-11-16 17:06:06.210911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.555 [2024-11-16 17:06:06.211232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.211421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.211448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.555 [2024-11-16 17:06:06.211465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.555 [2024-11-16 17:06:06.211709] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.555 [2024-11-16 17:06:06.211915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.555 [2024-11-16 17:06:06.211940] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.555 [2024-11-16 17:06:06.211957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.555 [2024-11-16 17:06:06.214341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.555 [2024-11-16 17:06:06.223625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.555 [2024-11-16 17:06:06.223956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.224091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.224123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.555 [2024-11-16 17:06:06.224142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.555 [2024-11-16 17:06:06.224308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.555 [2024-11-16 17:06:06.224477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.555 [2024-11-16 17:06:06.224502] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.555 [2024-11-16 17:06:06.224518] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.555 [2024-11-16 17:06:06.226681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.555 [2024-11-16 17:06:06.236143] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.555 [2024-11-16 17:06:06.236414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.236508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.236538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.555 [2024-11-16 17:06:06.236557] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.555 [2024-11-16 17:06:06.236734] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.555 [2024-11-16 17:06:06.236886] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.555 [2024-11-16 17:06:06.236922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.555 [2024-11-16 17:06:06.236939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.555 [2024-11-16 17:06:06.239270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.555 [2024-11-16 17:06:06.248738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.555 [2024-11-16 17:06:06.249022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.249176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.249206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.555 [2024-11-16 17:06:06.249225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.555 [2024-11-16 17:06:06.249409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.555 [2024-11-16 17:06:06.249562] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.555 [2024-11-16 17:06:06.249586] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.555 [2024-11-16 17:06:06.249602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.555 [2024-11-16 17:06:06.252107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.555 [2024-11-16 17:06:06.261149] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.555 [2024-11-16 17:06:06.261434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.261555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.261586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.555 [2024-11-16 17:06:06.261604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.555 [2024-11-16 17:06:06.261804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.555 [2024-11-16 17:06:06.261975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.555 [2024-11-16 17:06:06.261999] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.555 [2024-11-16 17:06:06.262015] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.555 [2024-11-16 17:06:06.264399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.555 [2024-11-16 17:06:06.273806] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.555 [2024-11-16 17:06:06.274098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.274251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.274281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.555 [2024-11-16 17:06:06.274299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.555 [2024-11-16 17:06:06.274502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.555 [2024-11-16 17:06:06.274704] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.555 [2024-11-16 17:06:06.274729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.555 [2024-11-16 17:06:06.274746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.555 [2024-11-16 17:06:06.277113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.555 [2024-11-16 17:06:06.286402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.555 [2024-11-16 17:06:06.286793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.286899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.286928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.555 [2024-11-16 17:06:06.286947] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.555 [2024-11-16 17:06:06.287130] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.555 [2024-11-16 17:06:06.287319] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.555 [2024-11-16 17:06:06.287343] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.555 [2024-11-16 17:06:06.287360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.555 [2024-11-16 17:06:06.289949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.555 [2024-11-16 17:06:06.299225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.555 [2024-11-16 17:06:06.299487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.299637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-16 17:06:06.299667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.555 [2024-11-16 17:06:06.299686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.555 [2024-11-16 17:06:06.299816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.555 [2024-11-16 17:06:06.299986] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.555 [2024-11-16 17:06:06.300010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.555 [2024-11-16 17:06:06.300026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.817 [2024-11-16 17:06:06.302323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.817 [2024-11-16 17:06:06.311918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.817 [2024-11-16 17:06:06.312267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-16 17:06:06.312420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-16 17:06:06.312455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.817 [2024-11-16 17:06:06.312474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.817 [2024-11-16 17:06:06.312631] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.817 [2024-11-16 17:06:06.312766] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.817 [2024-11-16 17:06:06.312790] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.817 [2024-11-16 17:06:06.312806] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.817 [2024-11-16 17:06:06.315046] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.817 [2024-11-16 17:06:06.324358] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.817 [2024-11-16 17:06:06.324703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-16 17:06:06.324831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-16 17:06:06.324858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.817 [2024-11-16 17:06:06.324875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.817 [2024-11-16 17:06:06.325113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.817 [2024-11-16 17:06:06.325302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.817 [2024-11-16 17:06:06.325332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.817 [2024-11-16 17:06:06.325349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.817 [2024-11-16 17:06:06.327537] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.817 [2024-11-16 17:06:06.337009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.817 [2024-11-16 17:06:06.337356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-16 17:06:06.337506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-16 17:06:06.337535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.817 [2024-11-16 17:06:06.337553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.817 [2024-11-16 17:06:06.337674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.817 [2024-11-16 17:06:06.337845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.817 [2024-11-16 17:06:06.337869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.817 [2024-11-16 17:06:06.337886] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.817 [2024-11-16 17:06:06.340088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.817 [2024-11-16 17:06:06.349593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.817 [2024-11-16 17:06:06.349920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-16 17:06:06.350068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-16 17:06:06.350094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.817 [2024-11-16 17:06:06.350120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.817 [2024-11-16 17:06:06.350318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.817 [2024-11-16 17:06:06.350488] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.817 [2024-11-16 17:06:06.350512] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.817 [2024-11-16 17:06:06.350529] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.817 [2024-11-16 17:06:06.352783] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.817 [2024-11-16 17:06:06.362204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.817 [2024-11-16 17:06:06.362501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-16 17:06:06.362630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-16 17:06:06.362658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.817 [2024-11-16 17:06:06.362675] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.817 [2024-11-16 17:06:06.362836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.817 [2024-11-16 17:06:06.362988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.817 [2024-11-16 17:06:06.363012] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.817 [2024-11-16 17:06:06.363028] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.817 [2024-11-16 17:06:06.365652] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.817 [2024-11-16 17:06:06.374733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.817 [2024-11-16 17:06:06.375061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.817 [2024-11-16 17:06:06.375216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.375246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.818 [2024-11-16 17:06:06.375265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.818 [2024-11-16 17:06:06.375432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.818 [2024-11-16 17:06:06.375668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.818 [2024-11-16 17:06:06.375693] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.818 [2024-11-16 17:06:06.375709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.818 [2024-11-16 17:06:06.378070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.818 [2024-11-16 17:06:06.387239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.818 [2024-11-16 17:06:06.387533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.387651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.387682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.818 [2024-11-16 17:06:06.387701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.818 [2024-11-16 17:06:06.387873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.818 [2024-11-16 17:06:06.388061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.818 [2024-11-16 17:06:06.388085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.818 [2024-11-16 17:06:06.388102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.818 [2024-11-16 17:06:06.390451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.818 [2024-11-16 17:06:06.399800] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.818 [2024-11-16 17:06:06.400169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.400321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.400349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.818 [2024-11-16 17:06:06.400368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.818 [2024-11-16 17:06:06.400533] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.818 [2024-11-16 17:06:06.400730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.818 [2024-11-16 17:06:06.400755] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.818 [2024-11-16 17:06:06.400772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.818 [2024-11-16 17:06:06.403119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.818 [2024-11-16 17:06:06.412183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.818 [2024-11-16 17:06:06.412477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.412604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.412645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.818 [2024-11-16 17:06:06.412665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.818 [2024-11-16 17:06:06.412849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.818 [2024-11-16 17:06:06.412982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.818 [2024-11-16 17:06:06.413006] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.818 [2024-11-16 17:06:06.413022] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.818 [2024-11-16 17:06:06.415227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.818 [2024-11-16 17:06:06.424816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.818 [2024-11-16 17:06:06.425117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.425219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.425249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.818 [2024-11-16 17:06:06.425267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.818 [2024-11-16 17:06:06.425417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.818 [2024-11-16 17:06:06.425593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.818 [2024-11-16 17:06:06.425628] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.818 [2024-11-16 17:06:06.425647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.818 [2024-11-16 17:06:06.427800] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.818 [2024-11-16 17:06:06.437492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.818 [2024-11-16 17:06:06.437770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.437937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.437963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.818 [2024-11-16 17:06:06.437980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.818 [2024-11-16 17:06:06.438123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.818 [2024-11-16 17:06:06.438267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.818 [2024-11-16 17:06:06.438292] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.818 [2024-11-16 17:06:06.438308] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.818 [2024-11-16 17:06:06.440634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.818 [2024-11-16 17:06:06.449947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.818 [2024-11-16 17:06:06.450234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.450442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.450470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.818 [2024-11-16 17:06:06.450487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.818 [2024-11-16 17:06:06.450661] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.818 [2024-11-16 17:06:06.450849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.818 [2024-11-16 17:06:06.450873] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.818 [2024-11-16 17:06:06.450890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.818 [2024-11-16 17:06:06.453278] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.818 [2024-11-16 17:06:06.462499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.818 [2024-11-16 17:06:06.462796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.462950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.462978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.818 [2024-11-16 17:06:06.462995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.818 [2024-11-16 17:06:06.463191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.818 [2024-11-16 17:06:06.463342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.818 [2024-11-16 17:06:06.463379] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.818 [2024-11-16 17:06:06.463397] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.818 [2024-11-16 17:06:06.465874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.818 [2024-11-16 17:06:06.475242] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.818 [2024-11-16 17:06:06.475571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.475672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.475701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.818 [2024-11-16 17:06:06.475720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.818 [2024-11-16 17:06:06.475887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.818 [2024-11-16 17:06:06.476092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.818 [2024-11-16 17:06:06.476118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.818 [2024-11-16 17:06:06.476136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.818 [2024-11-16 17:06:06.478151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.818 [2024-11-16 17:06:06.487845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.818 [2024-11-16 17:06:06.488174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.488325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.818 [2024-11-16 17:06:06.488353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.818 [2024-11-16 17:06:06.488370] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.818 [2024-11-16 17:06:06.488564] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.819 [2024-11-16 17:06:06.488766] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.819 [2024-11-16 17:06:06.488792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.819 [2024-11-16 17:06:06.488810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.819 [2024-11-16 17:06:06.491036] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.819 [2024-11-16 17:06:06.500352] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.819 [2024-11-16 17:06:06.500682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-16 17:06:06.500827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-16 17:06:06.500854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.819 [2024-11-16 17:06:06.500887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.819 [2024-11-16 17:06:06.501048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.819 [2024-11-16 17:06:06.501245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.819 [2024-11-16 17:06:06.501271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.819 [2024-11-16 17:06:06.501306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.819 [2024-11-16 17:06:06.503654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.819 [2024-11-16 17:06:06.512815] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.819 [2024-11-16 17:06:06.513130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-16 17:06:06.513258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-16 17:06:06.513288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.819 [2024-11-16 17:06:06.513306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.819 [2024-11-16 17:06:06.513508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.819 [2024-11-16 17:06:06.513672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.819 [2024-11-16 17:06:06.513699] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.819 [2024-11-16 17:06:06.513716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.819 [2024-11-16 17:06:06.516197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.819 [2024-11-16 17:06:06.525282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.819 [2024-11-16 17:06:06.525557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-16 17:06:06.525674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-16 17:06:06.525702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.819 [2024-11-16 17:06:06.525718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.819 [2024-11-16 17:06:06.525899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.819 [2024-11-16 17:06:06.526061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.819 [2024-11-16 17:06:06.526087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.819 [2024-11-16 17:06:06.526104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.819 [2024-11-16 17:06:06.528459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.819 [2024-11-16 17:06:06.537881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.819 [2024-11-16 17:06:06.538204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-16 17:06:06.538376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-16 17:06:06.538404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.819 [2024-11-16 17:06:06.538421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.819 [2024-11-16 17:06:06.538566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.819 [2024-11-16 17:06:06.538746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.819 [2024-11-16 17:06:06.538771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.819 [2024-11-16 17:06:06.538787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.819 [2024-11-16 17:06:06.541239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.819 [2024-11-16 17:06:06.550551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.819 [2024-11-16 17:06:06.550846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-16 17:06:06.550967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-16 17:06:06.550995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.819 [2024-11-16 17:06:06.551015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.819 [2024-11-16 17:06:06.551199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.819 [2024-11-16 17:06:06.551388] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.819 [2024-11-16 17:06:06.551414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.819 [2024-11-16 17:06:06.551431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.819 [2024-11-16 17:06:06.553922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.819 [2024-11-16 17:06:06.563298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.819 [2024-11-16 17:06:06.563553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-16 17:06:06.563680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.819 [2024-11-16 17:06:06.563710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:20.819 [2024-11-16 17:06:06.563729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:20.819 [2024-11-16 17:06:06.563931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:20.819 [2024-11-16 17:06:06.564065] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.819 [2024-11-16 17:06:06.564090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.819 [2024-11-16 17:06:06.564107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.081 [2024-11-16 17:06:06.566412] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.081 [2024-11-16 17:06:06.575905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.081 [2024-11-16 17:06:06.576247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.081 [2024-11-16 17:06:06.576374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.081 [2024-11-16 17:06:06.576405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.081 [2024-11-16 17:06:06.576424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.081 [2024-11-16 17:06:06.576591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.081 [2024-11-16 17:06:06.576758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.081 [2024-11-16 17:06:06.576786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.081 [2024-11-16 17:06:06.576803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.081 [2024-11-16 17:06:06.579032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.081 [2024-11-16 17:06:06.588383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.081 [2024-11-16 17:06:06.588655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.081 [2024-11-16 17:06:06.588763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.081 [2024-11-16 17:06:06.588789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.081 [2024-11-16 17:06:06.588806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.081 [2024-11-16 17:06:06.588961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.081 [2024-11-16 17:06:06.589113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.081 [2024-11-16 17:06:06.589138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.081 [2024-11-16 17:06:06.589155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.081 [2024-11-16 17:06:06.591311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.081 [2024-11-16 17:06:06.601009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.081 [2024-11-16 17:06:06.601277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.081 [2024-11-16 17:06:06.601405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.081 [2024-11-16 17:06:06.601434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.081 [2024-11-16 17:06:06.601454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.081 [2024-11-16 17:06:06.601632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.081 [2024-11-16 17:06:06.601802] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.081 [2024-11-16 17:06:06.601827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.081 [2024-11-16 17:06:06.601843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.081 [2024-11-16 17:06:06.604093] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.081 [2024-11-16 17:06:06.613573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.081 [2024-11-16 17:06:06.613876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.081 [2024-11-16 17:06:06.614037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.081 [2024-11-16 17:06:06.614068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.081 [2024-11-16 17:06:06.614087] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.081 [2024-11-16 17:06:06.614307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.081 [2024-11-16 17:06:06.614458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.081 [2024-11-16 17:06:06.614484] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.081 [2024-11-16 17:06:06.614500] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.081 [2024-11-16 17:06:06.616796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.081 [2024-11-16 17:06:06.626255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.081 [2024-11-16 17:06:06.626582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.081 [2024-11-16 17:06:06.626723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.081 [2024-11-16 17:06:06.626750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.081 [2024-11-16 17:06:06.626767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.081 [2024-11-16 17:06:06.626965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.081 [2024-11-16 17:06:06.627136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.081 [2024-11-16 17:06:06.627162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.081 [2024-11-16 17:06:06.627178] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.081 [2024-11-16 17:06:06.629587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.081 [2024-11-16 17:06:06.638986] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.081 [2024-11-16 17:06:06.639290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.081 [2024-11-16 17:06:06.639428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.081 [2024-11-16 17:06:06.639459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.081 [2024-11-16 17:06:06.639478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.081 [2024-11-16 17:06:06.639609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.082 [2024-11-16 17:06:06.639756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.082 [2024-11-16 17:06:06.639780] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.082 [2024-11-16 17:06:06.639796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.082 [2024-11-16 17:06:06.641986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.082 [2024-11-16 17:06:06.651570] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.082 [2024-11-16 17:06:06.651892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.652048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.652079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.082 [2024-11-16 17:06:06.652098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.082 [2024-11-16 17:06:06.652265] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.082 [2024-11-16 17:06:06.652434] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.082 [2024-11-16 17:06:06.652460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.082 [2024-11-16 17:06:06.652477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.082 [2024-11-16 17:06:06.654949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.082 [2024-11-16 17:06:06.664083] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.082 [2024-11-16 17:06:06.664451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.664561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.664595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.082 [2024-11-16 17:06:06.664627] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.082 [2024-11-16 17:06:06.664833] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.082 [2024-11-16 17:06:06.664984] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.082 [2024-11-16 17:06:06.665007] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.082 [2024-11-16 17:06:06.665023] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.082 [2024-11-16 17:06:06.667301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.082 [2024-11-16 17:06:06.676811] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.082 [2024-11-16 17:06:06.677131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.677311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.677339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.082 [2024-11-16 17:06:06.677356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.082 [2024-11-16 17:06:06.677535] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.082 [2024-11-16 17:06:06.677660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.082 [2024-11-16 17:06:06.677694] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.082 [2024-11-16 17:06:06.677712] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.082 [2024-11-16 17:06:06.680280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.082 [2024-11-16 17:06:06.689282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.082 [2024-11-16 17:06:06.689604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.689738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.689766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.082 [2024-11-16 17:06:06.689785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.082 [2024-11-16 17:06:06.689914] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.082 [2024-11-16 17:06:06.690101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.082 [2024-11-16 17:06:06.690124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.082 [2024-11-16 17:06:06.690141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.082 [2024-11-16 17:06:06.692451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.082 [2024-11-16 17:06:06.701752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.082 [2024-11-16 17:06:06.702056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.702187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.702216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.082 [2024-11-16 17:06:06.702240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.082 [2024-11-16 17:06:06.702408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.082 [2024-11-16 17:06:06.702613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.082 [2024-11-16 17:06:06.702652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.082 [2024-11-16 17:06:06.702669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.082 [2024-11-16 17:06:06.704842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.082 [2024-11-16 17:06:06.714262] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.082 [2024-11-16 17:06:06.714574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.714685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.714715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.082 [2024-11-16 17:06:06.714733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.082 [2024-11-16 17:06:06.714864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.082 [2024-11-16 17:06:06.714996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.082 [2024-11-16 17:06:06.715020] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.082 [2024-11-16 17:06:06.715035] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.082 [2024-11-16 17:06:06.717243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.082 [2024-11-16 17:06:06.726925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.082 [2024-11-16 17:06:06.727283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.727410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.727437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.082 [2024-11-16 17:06:06.727455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.082 [2024-11-16 17:06:06.727682] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.082 [2024-11-16 17:06:06.727870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.082 [2024-11-16 17:06:06.727895] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.082 [2024-11-16 17:06:06.727912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.082 [2024-11-16 17:06:06.730300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.082 [2024-11-16 17:06:06.739237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.082 [2024-11-16 17:06:06.739561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.739691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.082 [2024-11-16 17:06:06.739734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.082 [2024-11-16 17:06:06.739751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.083 [2024-11-16 17:06:06.739919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.083 [2024-11-16 17:06:06.740044] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.083 [2024-11-16 17:06:06.740069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.083 [2024-11-16 17:06:06.740085] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.083 [2024-11-16 17:06:06.742366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.083 [2024-11-16 17:06:06.751854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.083 [2024-11-16 17:06:06.752187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.083 [2024-11-16 17:06:06.752336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.083 [2024-11-16 17:06:06.752362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.083 [2024-11-16 17:06:06.752378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.083 [2024-11-16 17:06:06.752553] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.083 [2024-11-16 17:06:06.752755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.083 [2024-11-16 17:06:06.752781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.083 [2024-11-16 17:06:06.752798] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.083 [2024-11-16 17:06:06.755044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.083 [2024-11-16 17:06:06.764535] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.083 [2024-11-16 17:06:06.764774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.083 [2024-11-16 17:06:06.764902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.083 [2024-11-16 17:06:06.764927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.083 [2024-11-16 17:06:06.764944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.083 [2024-11-16 17:06:06.765170] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.083 [2024-11-16 17:06:06.765305] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.083 [2024-11-16 17:06:06.765330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.083 [2024-11-16 17:06:06.765347] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.083 [2024-11-16 17:06:06.767634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.083 [2024-11-16 17:06:06.777150] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.083 [2024-11-16 17:06:06.777441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.083 [2024-11-16 17:06:06.777565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.083 [2024-11-16 17:06:06.777593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.083 [2024-11-16 17:06:06.777610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.083 [2024-11-16 17:06:06.777793] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.083 [2024-11-16 17:06:06.777957] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.083 [2024-11-16 17:06:06.777981] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.083 [2024-11-16 17:06:06.777997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.083 [2024-11-16 17:06:06.780219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.083 [2024-11-16 17:06:06.789437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.083 [2024-11-16 17:06:06.789719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.083 [2024-11-16 17:06:06.789819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.083 [2024-11-16 17:06:06.789844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.083 [2024-11-16 17:06:06.789862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.083 [2024-11-16 17:06:06.790010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.083 [2024-11-16 17:06:06.790140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.083 [2024-11-16 17:06:06.790162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.083 [2024-11-16 17:06:06.790176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.083 [2024-11-16 17:06:06.791918] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.083 [2024-11-16 17:06:06.801749] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.083 [2024-11-16 17:06:06.802010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.083 [2024-11-16 17:06:06.802127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.083 [2024-11-16 17:06:06.802156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.083 [2024-11-16 17:06:06.802175] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.083 [2024-11-16 17:06:06.802287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.083 [2024-11-16 17:06:06.802438] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.083 [2024-11-16 17:06:06.802462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.083 [2024-11-16 17:06:06.802478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.083 [2024-11-16 17:06:06.804624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.083 [2024-11-16 17:06:06.814307] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.083 [2024-11-16 17:06:06.814562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.083 [2024-11-16 17:06:06.814719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.083 [2024-11-16 17:06:06.814745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.083 [2024-11-16 17:06:06.814762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.083 [2024-11-16 17:06:06.814902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.083 [2024-11-16 17:06:06.815034] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.083 [2024-11-16 17:06:06.815057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.083 [2024-11-16 17:06:06.815079] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.083 [2024-11-16 17:06:06.817544] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.083 [2024-11-16 17:06:06.826908] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.083 [2024-11-16 17:06:06.827220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.083 [2024-11-16 17:06:06.827370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.083 [2024-11-16 17:06:06.827401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.083 [2024-11-16 17:06:06.827420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.083 [2024-11-16 17:06:06.827604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.083 [2024-11-16 17:06:06.827769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.083 [2024-11-16 17:06:06.827796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.083 [2024-11-16 17:06:06.827813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.346 [2024-11-16 17:06:06.830168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.346 [2024-11-16 17:06:06.839178] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.346 [2024-11-16 17:06:06.839539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.346 [2024-11-16 17:06:06.839699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.346 [2024-11-16 17:06:06.839731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.346 [2024-11-16 17:06:06.839751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.346 [2024-11-16 17:06:06.839918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.346 [2024-11-16 17:06:06.840088] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.346 [2024-11-16 17:06:06.840114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.346 [2024-11-16 17:06:06.840131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.346 [2024-11-16 17:06:06.842520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.346 [2024-11-16 17:06:06.851740] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.346 [2024-11-16 17:06:06.852075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.346 [2024-11-16 17:06:06.852241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.346 [2024-11-16 17:06:06.852269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.346 [2024-11-16 17:06:06.852287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.346 [2024-11-16 17:06:06.852472] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.346 [2024-11-16 17:06:06.852586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.346 [2024-11-16 17:06:06.852609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.346 [2024-11-16 17:06:06.852639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.346 [2024-11-16 17:06:06.855037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.346 [2024-11-16 17:06:06.863959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.346 [2024-11-16 17:06:06.864329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.346 [2024-11-16 17:06:06.864448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.346 [2024-11-16 17:06:06.864474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.346 [2024-11-16 17:06:06.864490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.346 [2024-11-16 17:06:06.864687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.346 [2024-11-16 17:06:06.864824] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.346 [2024-11-16 17:06:06.864846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.346 [2024-11-16 17:06:06.864861] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.346 [2024-11-16 17:06:06.866871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.346 [2024-11-16 17:06:06.876056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.346 [2024-11-16 17:06:06.876435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.346 [2024-11-16 17:06:06.876589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.346 [2024-11-16 17:06:06.876627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.346 [2024-11-16 17:06:06.876648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.346 [2024-11-16 17:06:06.876765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.346 [2024-11-16 17:06:06.876915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.346 [2024-11-16 17:06:06.876950] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.346 [2024-11-16 17:06:06.876964] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.346 [2024-11-16 17:06:06.878916] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.346 [2024-11-16 17:06:06.888299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.346 [2024-11-16 17:06:06.888599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.346 [2024-11-16 17:06:06.888714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.346 [2024-11-16 17:06:06.888742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.346 [2024-11-16 17:06:06.888759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.346 [2024-11-16 17:06:06.888875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.346 [2024-11-16 17:06:06.889055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.346 [2024-11-16 17:06:06.889075] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.347 [2024-11-16 17:06:06.889089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.347 [2024-11-16 17:06:06.891281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.347 [2024-11-16 17:06:06.900680] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.347 [2024-11-16 17:06:06.901083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.901288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.901318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.347 [2024-11-16 17:06:06.901337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.347 [2024-11-16 17:06:06.901486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.347 [2024-11-16 17:06:06.901680] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.347 [2024-11-16 17:06:06.901702] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.347 [2024-11-16 17:06:06.901716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.347 [2024-11-16 17:06:06.904017] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.347 [2024-11-16 17:06:06.913233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.347 [2024-11-16 17:06:06.913564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.913700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.913731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.347 [2024-11-16 17:06:06.913750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.347 [2024-11-16 17:06:06.913935] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.347 [2024-11-16 17:06:06.914114] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.347 [2024-11-16 17:06:06.914148] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.347 [2024-11-16 17:06:06.914165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.347 [2024-11-16 17:06:06.916657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.347 [2024-11-16 17:06:06.925568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.347 [2024-11-16 17:06:06.925901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.926031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.926068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.347 [2024-11-16 17:06:06.926087] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.347 [2024-11-16 17:06:06.926307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.347 [2024-11-16 17:06:06.926477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.347 [2024-11-16 17:06:06.926501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.347 [2024-11-16 17:06:06.926518] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.347 [2024-11-16 17:06:06.928814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.347 [2024-11-16 17:06:06.938229] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.347 [2024-11-16 17:06:06.938534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.938671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.938717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.347 [2024-11-16 17:06:06.938734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.347 [2024-11-16 17:06:06.938916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.347 [2024-11-16 17:06:06.939144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.347 [2024-11-16 17:06:06.939169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.347 [2024-11-16 17:06:06.939185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.347 [2024-11-16 17:06:06.941613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.347 [2024-11-16 17:06:06.950906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.347 [2024-11-16 17:06:06.951250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.951408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.951437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.347 [2024-11-16 17:06:06.951456] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.347 [2024-11-16 17:06:06.951632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.347 [2024-11-16 17:06:06.951848] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.347 [2024-11-16 17:06:06.951873] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.347 [2024-11-16 17:06:06.951890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.347 [2024-11-16 17:06:06.954098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.347 [2024-11-16 17:06:06.963495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.347 [2024-11-16 17:06:06.963782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.963882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.963920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.347 [2024-11-16 17:06:06.963939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.347 [2024-11-16 17:06:06.964140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.347 [2024-11-16 17:06:06.964256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.347 [2024-11-16 17:06:06.964281] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.347 [2024-11-16 17:06:06.964307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.347 [2024-11-16 17:06:06.966605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.347 [2024-11-16 17:06:06.976106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.347 [2024-11-16 17:06:06.976470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.976591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.976632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.347 [2024-11-16 17:06:06.976653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.347 [2024-11-16 17:06:06.976841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.347 [2024-11-16 17:06:06.976993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.347 [2024-11-16 17:06:06.977018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.347 [2024-11-16 17:06:06.977036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.347 [2024-11-16 17:06:06.979323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.347 [2024-11-16 17:06:06.988576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.347 [2024-11-16 17:06:06.988942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.989136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:06.989165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.347 [2024-11-16 17:06:06.989193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.347 [2024-11-16 17:06:06.989340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.347 [2024-11-16 17:06:06.989493] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.347 [2024-11-16 17:06:06.989517] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.347 [2024-11-16 17:06:06.989535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.347 [2024-11-16 17:06:06.991694] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.347 [2024-11-16 17:06:07.001224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.347 [2024-11-16 17:06:07.001575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:07.001755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.347 [2024-11-16 17:06:07.001785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.347 [2024-11-16 17:06:07.001804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.347 [2024-11-16 17:06:07.001970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.347 [2024-11-16 17:06:07.002159] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.347 [2024-11-16 17:06:07.002185] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.347 [2024-11-16 17:06:07.002202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.347 [2024-11-16 17:06:07.004495] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.347 [2024-11-16 17:06:07.013709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.347 [2024-11-16 17:06:07.014041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.348 [2024-11-16 17:06:07.014160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.348 [2024-11-16 17:06:07.014188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.348 [2024-11-16 17:06:07.014212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.348 [2024-11-16 17:06:07.014343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.348 [2024-11-16 17:06:07.014457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.348 [2024-11-16 17:06:07.014481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.348 [2024-11-16 17:06:07.014497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.348 [2024-11-16 17:06:07.016872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.348 [2024-11-16 17:06:07.026232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.348 [2024-11-16 17:06:07.026535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.348 [2024-11-16 17:06:07.026695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.348 [2024-11-16 17:06:07.026725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.348 [2024-11-16 17:06:07.026744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.348 [2024-11-16 17:06:07.026910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.348 [2024-11-16 17:06:07.027099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.348 [2024-11-16 17:06:07.027124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.348 [2024-11-16 17:06:07.027142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.348 [2024-11-16 17:06:07.029437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.348 [2024-11-16 17:06:07.038932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.348 [2024-11-16 17:06:07.039206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.348 [2024-11-16 17:06:07.039335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.348 [2024-11-16 17:06:07.039366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.348 [2024-11-16 17:06:07.039385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.348 [2024-11-16 17:06:07.039533] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.348 [2024-11-16 17:06:07.039711] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.348 [2024-11-16 17:06:07.039736] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.348 [2024-11-16 17:06:07.039753] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.348 [2024-11-16 17:06:07.041975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.348 [2024-11-16 17:06:07.051450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.348 [2024-11-16 17:06:07.051784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.348 [2024-11-16 17:06:07.051994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.348 [2024-11-16 17:06:07.052038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.348 [2024-11-16 17:06:07.052058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.348 [2024-11-16 17:06:07.052230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.348 [2024-11-16 17:06:07.052417] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.348 [2024-11-16 17:06:07.052442] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.348 [2024-11-16 17:06:07.052459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.348 [2024-11-16 17:06:07.054864] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.348 [2024-11-16 17:06:07.063942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.348 [2024-11-16 17:06:07.064191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.348 [2024-11-16 17:06:07.064299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.348 [2024-11-16 17:06:07.064327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.348 [2024-11-16 17:06:07.064347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.348 [2024-11-16 17:06:07.064495] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.348 [2024-11-16 17:06:07.064660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.348 [2024-11-16 17:06:07.064685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.348 [2024-11-16 17:06:07.064702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.348 [2024-11-16 17:06:07.067112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.348 [2024-11-16 17:06:07.076485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.348 [2024-11-16 17:06:07.076768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.348 [2024-11-16 17:06:07.076856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.348 [2024-11-16 17:06:07.076898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.348 [2024-11-16 17:06:07.076915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.348 [2024-11-16 17:06:07.077044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.348 [2024-11-16 17:06:07.077230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.348 [2024-11-16 17:06:07.077264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.348 [2024-11-16 17:06:07.077280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.348 [2024-11-16 17:06:07.079777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.348 [2024-11-16 17:06:07.089063] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.348 [2024-11-16 17:06:07.089357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.348 [2024-11-16 17:06:07.089497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.348 [2024-11-16 17:06:07.089524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.348 [2024-11-16 17:06:07.089543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.348 [2024-11-16 17:06:07.089722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.348 [2024-11-16 17:06:07.089876] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.348 [2024-11-16 17:06:07.089902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.348 [2024-11-16 17:06:07.089919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.348 [2024-11-16 17:06:07.092275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.609 [2024-11-16 17:06:07.101794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.609 [2024-11-16 17:06:07.102123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.609 [2024-11-16 17:06:07.102240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.609 [2024-11-16 17:06:07.102266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.609 [2024-11-16 17:06:07.102284] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.609 [2024-11-16 17:06:07.102463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.609 [2024-11-16 17:06:07.102664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.609 [2024-11-16 17:06:07.102690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.609 [2024-11-16 17:06:07.102707] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.609 [2024-11-16 17:06:07.104949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.609 [2024-11-16 17:06:07.114450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.609 [2024-11-16 17:06:07.114755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.609 [2024-11-16 17:06:07.114881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.609 [2024-11-16 17:06:07.114911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.609 [2024-11-16 17:06:07.114929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.609 [2024-11-16 17:06:07.115078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.609 [2024-11-16 17:06:07.115227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.609 [2024-11-16 17:06:07.115252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.609 [2024-11-16 17:06:07.115269] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.609 [2024-11-16 17:06:07.117518] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.609 [2024-11-16 17:06:07.127216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.609 [2024-11-16 17:06:07.127606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.609 [2024-11-16 17:06:07.127752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.609 [2024-11-16 17:06:07.127777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.609 [2024-11-16 17:06:07.127793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.609 [2024-11-16 17:06:07.127951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.609 [2024-11-16 17:06:07.128102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.609 [2024-11-16 17:06:07.128133] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.609 [2024-11-16 17:06:07.128150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.609 [2024-11-16 17:06:07.130525] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.609 [2024-11-16 17:06:07.139736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.609 [2024-11-16 17:06:07.140038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.609 [2024-11-16 17:06:07.140179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.609 [2024-11-16 17:06:07.140205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.609 [2024-11-16 17:06:07.140223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.609 [2024-11-16 17:06:07.140382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.610 [2024-11-16 17:06:07.140587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.610 [2024-11-16 17:06:07.140612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.610 [2024-11-16 17:06:07.140646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.610 [2024-11-16 17:06:07.143127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.610 [2024-11-16 17:06:07.152039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.610 [2024-11-16 17:06:07.152362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.152542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.152570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.610 [2024-11-16 17:06:07.152587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.610 [2024-11-16 17:06:07.152777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.610 [2024-11-16 17:06:07.152941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.610 [2024-11-16 17:06:07.152970] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.610 [2024-11-16 17:06:07.152987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.610 [2024-11-16 17:06:07.155454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.610 [2024-11-16 17:06:07.164789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.610 [2024-11-16 17:06:07.165092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.165209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.165239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.610 [2024-11-16 17:06:07.165258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.610 [2024-11-16 17:06:07.165424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.610 [2024-11-16 17:06:07.165557] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.610 [2024-11-16 17:06:07.165582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.610 [2024-11-16 17:06:07.165604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.610 [2024-11-16 17:06:07.167823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.610 [2024-11-16 17:06:07.177205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.610 [2024-11-16 17:06:07.177579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.177689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.177720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.610 [2024-11-16 17:06:07.177739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.610 [2024-11-16 17:06:07.177850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.610 [2024-11-16 17:06:07.178001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.610 [2024-11-16 17:06:07.178026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.610 [2024-11-16 17:06:07.178043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.610 [2024-11-16 17:06:07.180413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.610 [2024-11-16 17:06:07.189726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.610 [2024-11-16 17:06:07.190104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.190217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.190244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.610 [2024-11-16 17:06:07.190262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.610 [2024-11-16 17:06:07.190458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.610 [2024-11-16 17:06:07.190677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.610 [2024-11-16 17:06:07.190703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.610 [2024-11-16 17:06:07.190720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.610 [2024-11-16 17:06:07.193089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.610 [2024-11-16 17:06:07.202277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.610 [2024-11-16 17:06:07.202534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.202708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.202741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.610 [2024-11-16 17:06:07.202757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.610 [2024-11-16 17:06:07.202957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.610 [2024-11-16 17:06:07.203090] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.610 [2024-11-16 17:06:07.203115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.610 [2024-11-16 17:06:07.203132] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.610 [2024-11-16 17:06:07.205561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.610 [2024-11-16 17:06:07.214750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.610 [2024-11-16 17:06:07.215068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.215310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.215337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.610 [2024-11-16 17:06:07.215369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.610 [2024-11-16 17:06:07.215523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.610 [2024-11-16 17:06:07.215727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.610 [2024-11-16 17:06:07.215753] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.610 [2024-11-16 17:06:07.215769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.610 [2024-11-16 17:06:07.218253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.610 [2024-11-16 17:06:07.227369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.610 [2024-11-16 17:06:07.227723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.227907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.227969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.610 [2024-11-16 17:06:07.227989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.610 [2024-11-16 17:06:07.228155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.610 [2024-11-16 17:06:07.228270] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.610 [2024-11-16 17:06:07.228293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.610 [2024-11-16 17:06:07.228310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.610 [2024-11-16 17:06:07.230669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.610 [2024-11-16 17:06:07.240103] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.610 [2024-11-16 17:06:07.240418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.240569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.240596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.610 [2024-11-16 17:06:07.240614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.610 [2024-11-16 17:06:07.240828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.610 [2024-11-16 17:06:07.240981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.610 [2024-11-16 17:06:07.241006] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.610 [2024-11-16 17:06:07.241022] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.610 [2024-11-16 17:06:07.243418] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.610 [2024-11-16 17:06:07.252648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.610 [2024-11-16 17:06:07.252915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.253048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.610 [2024-11-16 17:06:07.253079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.610 [2024-11-16 17:06:07.253098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.610 [2024-11-16 17:06:07.253283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.610 [2024-11-16 17:06:07.253453] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.610 [2024-11-16 17:06:07.253479] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.610 [2024-11-16 17:06:07.253496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.611 [2024-11-16 17:06:07.255846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.611 [2024-11-16 17:06:07.265241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.611 [2024-11-16 17:06:07.265541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.265683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.265713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.611 [2024-11-16 17:06:07.265732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.611 [2024-11-16 17:06:07.265899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.611 [2024-11-16 17:06:07.266068] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.611 [2024-11-16 17:06:07.266093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.611 [2024-11-16 17:06:07.266110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.611 [2024-11-16 17:06:07.268283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.611 [2024-11-16 17:06:07.277758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.611 [2024-11-16 17:06:07.278051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.278203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.278234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.611 [2024-11-16 17:06:07.278253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.611 [2024-11-16 17:06:07.278402] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.611 [2024-11-16 17:06:07.278606] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.611 [2024-11-16 17:06:07.278645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.611 [2024-11-16 17:06:07.278663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.611 [2024-11-16 17:06:07.280931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.611 [2024-11-16 17:06:07.290323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.611 [2024-11-16 17:06:07.290635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.290784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.290812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.611 [2024-11-16 17:06:07.290829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.611 [2024-11-16 17:06:07.290946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.611 [2024-11-16 17:06:07.291140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.611 [2024-11-16 17:06:07.291173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.611 [2024-11-16 17:06:07.291189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.611 [2024-11-16 17:06:07.293541] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.611 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1326578 Killed "${NVMF_APP[@]}" "$@" 00:30:21.611 17:06:07 -- host/bdevperf.sh@36 -- # tgt_init 00:30:21.611 17:06:07 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:21.611 17:06:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:21.611 17:06:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:21.611 17:06:07 -- common/autotest_common.sh@10 -- # set +x 00:30:21.611 [2024-11-16 17:06:07.303064] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.611 [2024-11-16 17:06:07.303315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.303450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.303480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.611 [2024-11-16 17:06:07.303499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.611 17:06:07 -- nvmf/common.sh@469 -- # nvmfpid=1327799 00:30:21.611 [2024-11-16 17:06:07.303676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.611 17:06:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:21.611 17:06:07 -- nvmf/common.sh@470 -- # waitforlisten 1327799 00:30:21.611 [2024-11-16 17:06:07.303811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.611 [2024-11-16 17:06:07.303836] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.611 [2024-11-16 17:06:07.303853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.611 17:06:07 -- common/autotest_common.sh@829 -- # '[' -z 1327799 ']' 00:30:21.611 17:06:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:21.611 17:06:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:21.611 17:06:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:21.611 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:21.611 17:06:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:21.611 17:06:07 -- common/autotest_common.sh@10 -- # set +x 00:30:21.611 [2024-11-16 17:06:07.306115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.611 [2024-11-16 17:06:07.315696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.611 [2024-11-16 17:06:07.315962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.316088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.316116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.611 [2024-11-16 17:06:07.316139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.611 [2024-11-16 17:06:07.316342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.611 [2024-11-16 17:06:07.316530] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.611 [2024-11-16 17:06:07.316555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.611 [2024-11-16 17:06:07.316571] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.611 [2024-11-16 17:06:07.319061] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.611 [2024-11-16 17:06:07.328076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.611 [2024-11-16 17:06:07.328344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.328453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.328480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.611 [2024-11-16 17:06:07.328498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.611 [2024-11-16 17:06:07.328655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.611 [2024-11-16 17:06:07.328794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.611 [2024-11-16 17:06:07.328816] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.611 [2024-11-16 17:06:07.328832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.611 [2024-11-16 17:06:07.330971] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.611 [2024-11-16 17:06:07.340374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.611 [2024-11-16 17:06:07.340699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.340820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.340847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.611 [2024-11-16 17:06:07.340865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.611 [2024-11-16 17:06:07.340981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.611 [2024-11-16 17:06:07.341110] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.611 [2024-11-16 17:06:07.341131] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.611 [2024-11-16 17:06:07.341145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.611 [2024-11-16 17:06:07.343035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.611 [2024-11-16 17:06:07.345853] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:21.611 [2024-11-16 17:06:07.345925] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:21.611 [2024-11-16 17:06:07.352603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.611 [2024-11-16 17:06:07.352885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.353762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.611 [2024-11-16 17:06:07.353794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.611 [2024-11-16 17:06:07.353812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.611 [2024-11-16 17:06:07.353954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.611 [2024-11-16 17:06:07.354140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.612 [2024-11-16 17:06:07.354161] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.612 [2024-11-16 17:06:07.354175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.612 [2024-11-16 17:06:07.356228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.871 [2024-11-16 17:06:07.365132] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.871 [2024-11-16 17:06:07.365451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.871 [2024-11-16 17:06:07.365585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.871 [2024-11-16 17:06:07.365611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.871 [2024-11-16 17:06:07.365640] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.871 [2024-11-16 17:06:07.365774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.871 [2024-11-16 17:06:07.365925] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.871 [2024-11-16 17:06:07.365945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.871 [2024-11-16 17:06:07.365959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.872 [2024-11-16 17:06:07.368124] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.872 [2024-11-16 17:06:07.377390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.872 [2024-11-16 17:06:07.377677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.377777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.377804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.872 [2024-11-16 17:06:07.377821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.872 [2024-11-16 17:06:07.378001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.872 [2024-11-16 17:06:07.378199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.872 [2024-11-16 17:06:07.378220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.872 [2024-11-16 17:06:07.378233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.872 [2024-11-16 17:06:07.380224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.872 EAL: No free 2048 kB hugepages reported on node 1 00:30:21.872 [2024-11-16 17:06:07.389865] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.872 [2024-11-16 17:06:07.390227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.390359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.390391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.872 [2024-11-16 17:06:07.390409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.872 [2024-11-16 17:06:07.390603] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.872 [2024-11-16 17:06:07.390750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.872 [2024-11-16 17:06:07.390772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.872 [2024-11-16 17:06:07.390787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.872 [2024-11-16 17:06:07.393205] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.872 [2024-11-16 17:06:07.402507] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.872 [2024-11-16 17:06:07.402819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.402904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.402946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.872 [2024-11-16 17:06:07.402962] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.872 [2024-11-16 17:06:07.403123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.872 [2024-11-16 17:06:07.403329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.872 [2024-11-16 17:06:07.403354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.872 [2024-11-16 17:06:07.403371] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.872 [2024-11-16 17:06:07.405699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.872 [2024-11-16 17:06:07.415000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.872 [2024-11-16 17:06:07.415342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.415497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.415528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.872 [2024-11-16 17:06:07.415547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.872 [2024-11-16 17:06:07.415763] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.872 [2024-11-16 17:06:07.415936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.872 [2024-11-16 17:06:07.415957] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.872 [2024-11-16 17:06:07.415970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.872 [2024-11-16 17:06:07.416719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:21.872 [2024-11-16 17:06:07.418334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.872 [2024-11-16 17:06:07.427449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.872 [2024-11-16 17:06:07.428001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.428110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.428141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.872 [2024-11-16 17:06:07.428176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.872 [2024-11-16 17:06:07.428337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.872 [2024-11-16 17:06:07.428532] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.872 [2024-11-16 17:06:07.428559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.872 [2024-11-16 17:06:07.428579] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.872 [2024-11-16 17:06:07.430939] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.872 [2024-11-16 17:06:07.440104] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.872 [2024-11-16 17:06:07.440431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.440561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.440588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.872 [2024-11-16 17:06:07.440607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.872 [2024-11-16 17:06:07.440782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.872 [2024-11-16 17:06:07.440955] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.872 [2024-11-16 17:06:07.440980] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.872 [2024-11-16 17:06:07.440999] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.872 [2024-11-16 17:06:07.443296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.872 [2024-11-16 17:06:07.452838] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.872 [2024-11-16 17:06:07.453503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.453683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.453712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.872 [2024-11-16 17:06:07.453730] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.872 [2024-11-16 17:06:07.453867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.872 [2024-11-16 17:06:07.454070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.872 [2024-11-16 17:06:07.454095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.872 [2024-11-16 17:06:07.454112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.872 [2024-11-16 17:06:07.456460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.872 [2024-11-16 17:06:07.465516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.872 [2024-11-16 17:06:07.465889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.466107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.466135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.872 [2024-11-16 17:06:07.466154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.872 [2024-11-16 17:06:07.466330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.872 [2024-11-16 17:06:07.466522] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.872 [2024-11-16 17:06:07.466547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.872 [2024-11-16 17:06:07.466564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.872 [2024-11-16 17:06:07.468822] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.872 [2024-11-16 17:06:07.478347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.872 [2024-11-16 17:06:07.478863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.479076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.872 [2024-11-16 17:06:07.479103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.872 [2024-11-16 17:06:07.479124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.872 [2024-11-16 17:06:07.479248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.872 [2024-11-16 17:06:07.479424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.873 [2024-11-16 17:06:07.479450] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.873 [2024-11-16 17:06:07.479470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.873 [2024-11-16 17:06:07.481810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.873 [2024-11-16 17:06:07.490970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.873 [2024-11-16 17:06:07.491277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.491441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.491485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.873 [2024-11-16 17:06:07.491505] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.873 [2024-11-16 17:06:07.491706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.873 [2024-11-16 17:06:07.491844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.873 [2024-11-16 17:06:07.491866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.873 [2024-11-16 17:06:07.491881] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.873 [2024-11-16 17:06:07.494256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.873 [2024-11-16 17:06:07.503684] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.873 [2024-11-16 17:06:07.504052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.504188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.504215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.873 [2024-11-16 17:06:07.504233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.873 [2024-11-16 17:06:07.504387] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.873 [2024-11-16 17:06:07.504552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.873 [2024-11-16 17:06:07.504576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.873 [2024-11-16 17:06:07.504593] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.873 [2024-11-16 17:06:07.506789] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.873 [2024-11-16 17:06:07.513369] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:21.873 [2024-11-16 17:06:07.513499] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:21.873 [2024-11-16 17:06:07.513519] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:21.873 [2024-11-16 17:06:07.513532] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:21.873 [2024-11-16 17:06:07.513591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:21.873 [2024-11-16 17:06:07.513644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:21.873 [2024-11-16 17:06:07.513649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:21.873 [2024-11-16 17:06:07.516322] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.873 [2024-11-16 17:06:07.516665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.516762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.516791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.873 [2024-11-16 17:06:07.516810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.873 [2024-11-16 17:06:07.516948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.873 [2024-11-16 17:06:07.517080] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.873 [2024-11-16 17:06:07.517102] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.873 [2024-11-16 17:06:07.517119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.873 [2024-11-16 17:06:07.519229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.873 [2024-11-16 17:06:07.528732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.873 [2024-11-16 17:06:07.529268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.529443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.529470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.873 [2024-11-16 17:06:07.529491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.873 [2024-11-16 17:06:07.529647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.873 [2024-11-16 17:06:07.529774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.873 [2024-11-16 17:06:07.529796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.873 [2024-11-16 17:06:07.529815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.873 [2024-11-16 17:06:07.531770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.873 [2024-11-16 17:06:07.541124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.873 [2024-11-16 17:06:07.541580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.541745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.541773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.873 [2024-11-16 17:06:07.541794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.873 [2024-11-16 17:06:07.541922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.873 [2024-11-16 17:06:07.542116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.873 [2024-11-16 17:06:07.542138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.873 [2024-11-16 17:06:07.542156] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.873 [2024-11-16 17:06:07.544191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.873 [2024-11-16 17:06:07.553443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.873 [2024-11-16 17:06:07.553903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.554063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.554091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.873 [2024-11-16 17:06:07.554112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.873 [2024-11-16 17:06:07.554272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.873 [2024-11-16 17:06:07.554455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.873 [2024-11-16 17:06:07.554477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.873 [2024-11-16 17:06:07.554496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.873 [2024-11-16 17:06:07.556647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.873 [2024-11-16 17:06:07.566015] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.873 [2024-11-16 17:06:07.566479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.566657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.566685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.873 [2024-11-16 17:06:07.566705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.873 [2024-11-16 17:06:07.566847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.873 [2024-11-16 17:06:07.567018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.873 [2024-11-16 17:06:07.567040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.873 [2024-11-16 17:06:07.567056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.873 [2024-11-16 17:06:07.569192] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.873 [2024-11-16 17:06:07.578331] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.873 [2024-11-16 17:06:07.578849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.579013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.579041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.873 [2024-11-16 17:06:07.579063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.873 [2024-11-16 17:06:07.579263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.873 [2024-11-16 17:06:07.579495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.873 [2024-11-16 17:06:07.579525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.873 [2024-11-16 17:06:07.579543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.873 [2024-11-16 17:06:07.581516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.873 [2024-11-16 17:06:07.590662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.873 [2024-11-16 17:06:07.591125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.873 [2024-11-16 17:06:07.591296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.874 [2024-11-16 17:06:07.591324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.874 [2024-11-16 17:06:07.591344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.874 [2024-11-16 17:06:07.591486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.874 [2024-11-16 17:06:07.591682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.874 [2024-11-16 17:06:07.591706] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.874 [2024-11-16 17:06:07.591725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.874 [2024-11-16 17:06:07.593577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.874 [2024-11-16 17:06:07.603108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.874 [2024-11-16 17:06:07.603436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.874 [2024-11-16 17:06:07.603537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.874 [2024-11-16 17:06:07.603563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.874 [2024-11-16 17:06:07.603580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.874 [2024-11-16 17:06:07.603763] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.874 [2024-11-16 17:06:07.603949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.874 [2024-11-16 17:06:07.603985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.874 [2024-11-16 17:06:07.604000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.874 [2024-11-16 17:06:07.605817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.874 [2024-11-16 17:06:07.615352] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.874 [2024-11-16 17:06:07.615634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.874 [2024-11-16 17:06:07.615760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.874 [2024-11-16 17:06:07.615795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:21.874 [2024-11-16 17:06:07.615813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:21.874 [2024-11-16 17:06:07.615979] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:21.874 [2024-11-16 17:06:07.616176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.874 [2024-11-16 17:06:07.616198] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.874 [2024-11-16 17:06:07.616213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.874 [2024-11-16 17:06:07.618414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.134 [2024-11-16 17:06:07.627665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.134 [2024-11-16 17:06:07.627964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.628109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.628136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.134 [2024-11-16 17:06:07.628153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.134 [2024-11-16 17:06:07.628303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.134 [2024-11-16 17:06:07.628480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.134 [2024-11-16 17:06:07.628501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.134 [2024-11-16 17:06:07.628515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.134 [2024-11-16 17:06:07.630698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.134 [2024-11-16 17:06:07.640053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.134 [2024-11-16 17:06:07.640351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.640452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.640479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.134 [2024-11-16 17:06:07.640496] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.134 [2024-11-16 17:06:07.640637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.134 [2024-11-16 17:06:07.640789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.134 [2024-11-16 17:06:07.640810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.134 [2024-11-16 17:06:07.640825] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.134 [2024-11-16 17:06:07.642873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.134 [2024-11-16 17:06:07.652571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.134 [2024-11-16 17:06:07.652943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.653060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.653087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.134 [2024-11-16 17:06:07.653109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.134 [2024-11-16 17:06:07.653307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.134 [2024-11-16 17:06:07.653468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.134 [2024-11-16 17:06:07.653489] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.134 [2024-11-16 17:06:07.653503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.134 [2024-11-16 17:06:07.655631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.134 [2024-11-16 17:06:07.664727] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.134 [2024-11-16 17:06:07.665038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.665163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.665190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.134 [2024-11-16 17:06:07.665207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.134 [2024-11-16 17:06:07.665356] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.134 [2024-11-16 17:06:07.665520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.134 [2024-11-16 17:06:07.665542] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.134 [2024-11-16 17:06:07.665556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.134 [2024-11-16 17:06:07.667752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.134 [2024-11-16 17:06:07.677186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.134 [2024-11-16 17:06:07.677489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.677607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.677642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.134 [2024-11-16 17:06:07.677659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.134 [2024-11-16 17:06:07.677809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.134 [2024-11-16 17:06:07.677988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.134 [2024-11-16 17:06:07.678009] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.134 [2024-11-16 17:06:07.678023] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.134 [2024-11-16 17:06:07.680105] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.134 [2024-11-16 17:06:07.689510] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.134 [2024-11-16 17:06:07.689766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.689891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.689917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.134 [2024-11-16 17:06:07.689934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.134 [2024-11-16 17:06:07.690065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.134 [2024-11-16 17:06:07.690202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.134 [2024-11-16 17:06:07.690238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.134 [2024-11-16 17:06:07.690252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.134 [2024-11-16 17:06:07.692406] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.134 [2024-11-16 17:06:07.701829] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.134 [2024-11-16 17:06:07.702149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.702260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.702287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.134 [2024-11-16 17:06:07.702304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.134 [2024-11-16 17:06:07.702453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.134 [2024-11-16 17:06:07.702589] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.134 [2024-11-16 17:06:07.702642] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.134 [2024-11-16 17:06:07.702673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.134 [2024-11-16 17:06:07.704649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.134 [2024-11-16 17:06:07.714192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.134 [2024-11-16 17:06:07.714475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.714600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.714638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.134 [2024-11-16 17:06:07.714656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.134 [2024-11-16 17:06:07.714822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.134 [2024-11-16 17:06:07.715001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.134 [2024-11-16 17:06:07.715022] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.134 [2024-11-16 17:06:07.715036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.134 [2024-11-16 17:06:07.717063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.134 [2024-11-16 17:06:07.726577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.134 [2024-11-16 17:06:07.726873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.134 [2024-11-16 17:06:07.727008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.727035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.135 [2024-11-16 17:06:07.727058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.135 [2024-11-16 17:06:07.727192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.135 [2024-11-16 17:06:07.727377] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.135 [2024-11-16 17:06:07.727398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.135 [2024-11-16 17:06:07.727413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.135 [2024-11-16 17:06:07.729372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.135 [2024-11-16 17:06:07.738880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.135 [2024-11-16 17:06:07.739180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.739295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.739322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.135 [2024-11-16 17:06:07.739351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.135 [2024-11-16 17:06:07.739468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.135 [2024-11-16 17:06:07.739674] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.135 [2024-11-16 17:06:07.739696] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.135 [2024-11-16 17:06:07.739711] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.135 [2024-11-16 17:06:07.741737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.135 [2024-11-16 17:06:07.751228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.135 [2024-11-16 17:06:07.751513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.751637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.751665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.135 [2024-11-16 17:06:07.751682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.135 [2024-11-16 17:06:07.751816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.135 [2024-11-16 17:06:07.751981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.135 [2024-11-16 17:06:07.752002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.135 [2024-11-16 17:06:07.752017] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.135 [2024-11-16 17:06:07.754073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.135 [2024-11-16 17:06:07.763483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.135 [2024-11-16 17:06:07.763767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.763886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.763914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.135 [2024-11-16 17:06:07.763937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.135 [2024-11-16 17:06:07.764071] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.135 [2024-11-16 17:06:07.764278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.135 [2024-11-16 17:06:07.764300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.135 [2024-11-16 17:06:07.764319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.135 [2024-11-16 17:06:07.766613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.135 [2024-11-16 17:06:07.775657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.135 [2024-11-16 17:06:07.775970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.776083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.776110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.135 [2024-11-16 17:06:07.776127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.135 [2024-11-16 17:06:07.776261] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.135 [2024-11-16 17:06:07.776456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.135 [2024-11-16 17:06:07.776477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.135 [2024-11-16 17:06:07.776491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.135 [2024-11-16 17:06:07.778488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.135 [2024-11-16 17:06:07.787914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.135 [2024-11-16 17:06:07.788248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.788340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.788368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.135 [2024-11-16 17:06:07.788385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.135 [2024-11-16 17:06:07.788502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.135 [2024-11-16 17:06:07.788677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.135 [2024-11-16 17:06:07.788699] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.135 [2024-11-16 17:06:07.788714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.135 [2024-11-16 17:06:07.790757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.135 [2024-11-16 17:06:07.800111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.135 [2024-11-16 17:06:07.800407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.800491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.800518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.135 [2024-11-16 17:06:07.800535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.135 [2024-11-16 17:06:07.800709] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.135 [2024-11-16 17:06:07.800875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.135 [2024-11-16 17:06:07.800911] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.135 [2024-11-16 17:06:07.800934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.135 [2024-11-16 17:06:07.803038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.135 [2024-11-16 17:06:07.812392] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.135 [2024-11-16 17:06:07.812645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.812788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.812815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.135 [2024-11-16 17:06:07.812833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.135 [2024-11-16 17:06:07.813029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.135 [2024-11-16 17:06:07.813176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.135 [2024-11-16 17:06:07.813197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.135 [2024-11-16 17:06:07.813211] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.135 [2024-11-16 17:06:07.815269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.135 [2024-11-16 17:06:07.824588] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.135 [2024-11-16 17:06:07.824853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.825002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.825028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.135 [2024-11-16 17:06:07.825045] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.135 [2024-11-16 17:06:07.825211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.135 [2024-11-16 17:06:07.825418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.135 [2024-11-16 17:06:07.825439] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.135 [2024-11-16 17:06:07.825454] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.135 [2024-11-16 17:06:07.827559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.135 [2024-11-16 17:06:07.836873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.135 [2024-11-16 17:06:07.837132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.837223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.135 [2024-11-16 17:06:07.837250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.135 [2024-11-16 17:06:07.837267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.135 [2024-11-16 17:06:07.837432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.136 [2024-11-16 17:06:07.837579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.136 [2024-11-16 17:06:07.837625] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.136 [2024-11-16 17:06:07.837642] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.136 [2024-11-16 17:06:07.839731] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.136 [2024-11-16 17:06:07.849048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.136 [2024-11-16 17:06:07.849401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-16 17:06:07.849516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-16 17:06:07.849543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.136 [2024-11-16 17:06:07.849560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.136 [2024-11-16 17:06:07.849750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.136 [2024-11-16 17:06:07.849946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.136 [2024-11-16 17:06:07.849967] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.136 [2024-11-16 17:06:07.849981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.136 [2024-11-16 17:06:07.852239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.136 [2024-11-16 17:06:07.861334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.136 [2024-11-16 17:06:07.861640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-16 17:06:07.861784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-16 17:06:07.861811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.136 [2024-11-16 17:06:07.861828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.136 [2024-11-16 17:06:07.861951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.136 [2024-11-16 17:06:07.862133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.136 [2024-11-16 17:06:07.862154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.136 [2024-11-16 17:06:07.862168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.136 [2024-11-16 17:06:07.864366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.136 [2024-11-16 17:06:07.873659] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.136 [2024-11-16 17:06:07.873940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-16 17:06:07.874053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.136 [2024-11-16 17:06:07.874080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.136 [2024-11-16 17:06:07.874097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.136 [2024-11-16 17:06:07.874230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.136 [2024-11-16 17:06:07.874366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.136 [2024-11-16 17:06:07.874402] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.136 [2024-11-16 17:06:07.874416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.136 [2024-11-16 17:06:07.876493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.396 [2024-11-16 17:06:07.886056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.396 [2024-11-16 17:06:07.886348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.396 [2024-11-16 17:06:07.886469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.396 [2024-11-16 17:06:07.886497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.396 [2024-11-16 17:06:07.886514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.396 [2024-11-16 17:06:07.886658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.396 [2024-11-16 17:06:07.886793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.396 [2024-11-16 17:06:07.886815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.396 [2024-11-16 17:06:07.886830] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.396 [2024-11-16 17:06:07.889234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.396 [2024-11-16 17:06:07.898239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.396 [2024-11-16 17:06:07.898571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.396 [2024-11-16 17:06:07.898697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.396 [2024-11-16 17:06:07.898724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.396 [2024-11-16 17:06:07.898741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.396 [2024-11-16 17:06:07.898922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.396 [2024-11-16 17:06:07.899084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.396 [2024-11-16 17:06:07.899105] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.396 [2024-11-16 17:06:07.899119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.396 [2024-11-16 17:06:07.901198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.396 [2024-11-16 17:06:07.910657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.396 [2024-11-16 17:06:07.910893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.396 [2024-11-16 17:06:07.911075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.396 [2024-11-16 17:06:07.911102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.396 [2024-11-16 17:06:07.911118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.396 [2024-11-16 17:06:07.911300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.396 [2024-11-16 17:06:07.911507] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.396 [2024-11-16 17:06:07.911527] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.396 [2024-11-16 17:06:07.911541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.396 [2024-11-16 17:06:07.913576] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.396 [2024-11-16 17:06:07.922817] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.396 [2024-11-16 17:06:07.923179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.396 [2024-11-16 17:06:07.923301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.396 [2024-11-16 17:06:07.923333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.396 [2024-11-16 17:06:07.923350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.396 [2024-11-16 17:06:07.923499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.396 [2024-11-16 17:06:07.923688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.396 [2024-11-16 17:06:07.923710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.396 [2024-11-16 17:06:07.923725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.396 [2024-11-16 17:06:07.925935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.396 [2024-11-16 17:06:07.934890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.396 [2024-11-16 17:06:07.935174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.396 [2024-11-16 17:06:07.935289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.396 [2024-11-16 17:06:07.935316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.396 [2024-11-16 17:06:07.935333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.396 [2024-11-16 17:06:07.935482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.397 [2024-11-16 17:06:07.935702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.397 [2024-11-16 17:06:07.935724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.397 [2024-11-16 17:06:07.935739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.397 [2024-11-16 17:06:07.937907] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.397 [2024-11-16 17:06:07.947277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.397 [2024-11-16 17:06:07.947691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:07.947807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:07.947833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.397 [2024-11-16 17:06:07.947850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.397 [2024-11-16 17:06:07.947983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.397 [2024-11-16 17:06:07.948131] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.397 [2024-11-16 17:06:07.948152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.397 [2024-11-16 17:06:07.948166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.397 [2024-11-16 17:06:07.950330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.397 [2024-11-16 17:06:07.959557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.397 [2024-11-16 17:06:07.959883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:07.960034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:07.960061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.397 [2024-11-16 17:06:07.960084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.397 [2024-11-16 17:06:07.960282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.397 [2024-11-16 17:06:07.960458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.397 [2024-11-16 17:06:07.960480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.397 [2024-11-16 17:06:07.960494] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.397 [2024-11-16 17:06:07.962527] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.397 [2024-11-16 17:06:07.971987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.397 [2024-11-16 17:06:07.972347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:07.972462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:07.972488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.397 [2024-11-16 17:06:07.972506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.397 [2024-11-16 17:06:07.972681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.397 [2024-11-16 17:06:07.972816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.397 [2024-11-16 17:06:07.972838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.397 [2024-11-16 17:06:07.972853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.397 [2024-11-16 17:06:07.974756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.397 [2024-11-16 17:06:07.984334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.397 [2024-11-16 17:06:07.984668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:07.984787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:07.984814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.397 [2024-11-16 17:06:07.984831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.397 [2024-11-16 17:06:07.984948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.397 [2024-11-16 17:06:07.985139] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.397 [2024-11-16 17:06:07.985165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.397 [2024-11-16 17:06:07.985179] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.397 [2024-11-16 17:06:07.987326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.397 [2024-11-16 17:06:07.996745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.397 [2024-11-16 17:06:07.997091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:07.997210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:07.997236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.397 [2024-11-16 17:06:07.997253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.397 [2024-11-16 17:06:07.997423] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.397 [2024-11-16 17:06:07.997570] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.397 [2024-11-16 17:06:07.997591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.397 [2024-11-16 17:06:07.997632] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.397 [2024-11-16 17:06:07.999608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.397 [2024-11-16 17:06:08.009068] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.397 [2024-11-16 17:06:08.009407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:08.009532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:08.009559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.397 [2024-11-16 17:06:08.009575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.397 [2024-11-16 17:06:08.009734] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.397 [2024-11-16 17:06:08.009887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.397 [2024-11-16 17:06:08.009910] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.397 [2024-11-16 17:06:08.009940] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.397 [2024-11-16 17:06:08.012052] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.397 [2024-11-16 17:06:08.021531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.397 [2024-11-16 17:06:08.021839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:08.021973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:08.022000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.397 [2024-11-16 17:06:08.022026] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.397 [2024-11-16 17:06:08.022159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.397 [2024-11-16 17:06:08.022316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.397 [2024-11-16 17:06:08.022337] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.397 [2024-11-16 17:06:08.022352] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.397 [2024-11-16 17:06:08.024476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.397 [2024-11-16 17:06:08.033705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.397 [2024-11-16 17:06:08.033912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:08.034062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:08.034089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.397 [2024-11-16 17:06:08.034106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.397 [2024-11-16 17:06:08.034239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.397 [2024-11-16 17:06:08.034426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.397 [2024-11-16 17:06:08.034448] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.397 [2024-11-16 17:06:08.034463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.397 [2024-11-16 17:06:08.036753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.397 [2024-11-16 17:06:08.046008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.397 [2024-11-16 17:06:08.046360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:08.046481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.397 [2024-11-16 17:06:08.046508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.397 [2024-11-16 17:06:08.046524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.397 [2024-11-16 17:06:08.046653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.397 [2024-11-16 17:06:08.046789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.397 [2024-11-16 17:06:08.046811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.397 [2024-11-16 17:06:08.046826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.398 [2024-11-16 17:06:08.049027] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.398 [2024-11-16 17:06:08.058361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.398 [2024-11-16 17:06:08.058613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.398 [2024-11-16 17:06:08.058734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.398 [2024-11-16 17:06:08.058761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.398 [2024-11-16 17:06:08.058777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.398 [2024-11-16 17:06:08.058943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.398 [2024-11-16 17:06:08.059108] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.398 [2024-11-16 17:06:08.059129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.398 [2024-11-16 17:06:08.059143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.398 [2024-11-16 17:06:08.061277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.398 [2024-11-16 17:06:08.070703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.398 [2024-11-16 17:06:08.070941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.398 [2024-11-16 17:06:08.071074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.398 [2024-11-16 17:06:08.071107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.398 [2024-11-16 17:06:08.071124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.398 [2024-11-16 17:06:08.071257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.398 [2024-11-16 17:06:08.071392] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.398 [2024-11-16 17:06:08.071418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.398 [2024-11-16 17:06:08.071433] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.398 [2024-11-16 17:06:08.073591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.398 [2024-11-16 17:06:08.083021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.398 [2024-11-16 17:06:08.083315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.398 [2024-11-16 17:06:08.083464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.398 [2024-11-16 17:06:08.083490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.398 [2024-11-16 17:06:08.083507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.398 [2024-11-16 17:06:08.083607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.398 [2024-11-16 17:06:08.083770] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.398 [2024-11-16 17:06:08.083791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.398 [2024-11-16 17:06:08.083805] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.398 [2024-11-16 17:06:08.086087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.398 [2024-11-16 17:06:08.095359] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.398 [2024-11-16 17:06:08.095648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.398 [2024-11-16 17:06:08.095757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.398 [2024-11-16 17:06:08.095784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.398 [2024-11-16 17:06:08.095801] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.398 [2024-11-16 17:06:08.095918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.398 [2024-11-16 17:06:08.096085] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.398 [2024-11-16 17:06:08.096106] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.398 [2024-11-16 17:06:08.096120] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.398 [2024-11-16 17:06:08.098220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.398 [2024-11-16 17:06:08.107784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.398 [2024-11-16 17:06:08.108044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.398 [2024-11-16 17:06:08.108164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.398 [2024-11-16 17:06:08.108190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.398 [2024-11-16 17:06:08.108205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.398 [2024-11-16 17:06:08.108337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.398 [2024-11-16 17:06:08.108527] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.398 [2024-11-16 17:06:08.108548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.398 [2024-11-16 17:06:08.108567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.398 [2024-11-16 17:06:08.110742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.398 [2024-11-16 17:06:08.120096] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.398 [2024-11-16 17:06:08.120395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.398 [2024-11-16 17:06:08.120486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.398 [2024-11-16 17:06:08.120511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.398 [2024-11-16 17:06:08.120527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.398 [2024-11-16 17:06:08.120702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.398 [2024-11-16 17:06:08.120871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.398 [2024-11-16 17:06:08.120892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.398 [2024-11-16 17:06:08.120906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.398 [2024-11-16 17:06:08.122970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.398 [2024-11-16 17:06:08.132459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.398 [2024-11-16 17:06:08.132790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.398 [2024-11-16 17:06:08.132882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.398 [2024-11-16 17:06:08.132907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.398 [2024-11-16 17:06:08.132923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.398 [2024-11-16 17:06:08.133056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.398 [2024-11-16 17:06:08.133207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.398 [2024-11-16 17:06:08.133227] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.398 [2024-11-16 17:06:08.133241] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.398 [2024-11-16 17:06:08.135523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.398 [2024-11-16 17:06:08.144914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.660 [2024-11-16 17:06:08.145176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.145277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.145303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.660 [2024-11-16 17:06:08.145319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.660 [2024-11-16 17:06:08.145483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.660 [2024-11-16 17:06:08.145658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.660 [2024-11-16 17:06:08.145680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.660 [2024-11-16 17:06:08.145695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.660 [2024-11-16 17:06:08.148006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.660 [2024-11-16 17:06:08.157211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.660 [2024-11-16 17:06:08.157504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.157625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.157652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.660 [2024-11-16 17:06:08.157668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.660 [2024-11-16 17:06:08.157816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.660 [2024-11-16 17:06:08.157966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.660 [2024-11-16 17:06:08.157986] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.660 [2024-11-16 17:06:08.158000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.660 [2024-11-16 17:06:08.160094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.660 [2024-11-16 17:06:08.169699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.660 [2024-11-16 17:06:08.169969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.170101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.170127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.660 [2024-11-16 17:06:08.170143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.660 [2024-11-16 17:06:08.170291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.660 [2024-11-16 17:06:08.170457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.660 [2024-11-16 17:06:08.170478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.660 [2024-11-16 17:06:08.170491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.660 [2024-11-16 17:06:08.172702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.660 [2024-11-16 17:06:08.181871] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.660 [2024-11-16 17:06:08.182230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.182346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.182372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.660 [2024-11-16 17:06:08.182389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.660 [2024-11-16 17:06:08.182505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.660 [2024-11-16 17:06:08.182682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.660 [2024-11-16 17:06:08.182705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.660 [2024-11-16 17:06:08.182719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.660 [2024-11-16 17:06:08.184809] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.660 [2024-11-16 17:06:08.194076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.660 [2024-11-16 17:06:08.194392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.194471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.194498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.660 [2024-11-16 17:06:08.194514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.660 [2024-11-16 17:06:08.194654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.660 [2024-11-16 17:06:08.194807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.660 [2024-11-16 17:06:08.194828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.660 [2024-11-16 17:06:08.194843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.660 [2024-11-16 17:06:08.196953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.660 [2024-11-16 17:06:08.206239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.660 [2024-11-16 17:06:08.206491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.206632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.206659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.660 [2024-11-16 17:06:08.206675] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.660 [2024-11-16 17:06:08.206808] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.660 [2024-11-16 17:06:08.206974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.660 [2024-11-16 17:06:08.206996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.660 [2024-11-16 17:06:08.207009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.660 [2024-11-16 17:06:08.209086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.660 [2024-11-16 17:06:08.218760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.660 [2024-11-16 17:06:08.219093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.219175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.219200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.660 [2024-11-16 17:06:08.219217] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.660 [2024-11-16 17:06:08.219348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.660 [2024-11-16 17:06:08.219482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.660 [2024-11-16 17:06:08.219503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.660 [2024-11-16 17:06:08.219517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.660 [2024-11-16 17:06:08.221487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.660 [2024-11-16 17:06:08.231001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.660 [2024-11-16 17:06:08.231275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.231418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.231444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.660 [2024-11-16 17:06:08.231460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.660 [2024-11-16 17:06:08.231652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.660 [2024-11-16 17:06:08.231806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.660 [2024-11-16 17:06:08.231838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.660 [2024-11-16 17:06:08.231852] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.660 [2024-11-16 17:06:08.233985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.660 [2024-11-16 17:06:08.243091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.660 [2024-11-16 17:06:08.243420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.660 [2024-11-16 17:06:08.243521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.243547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.661 [2024-11-16 17:06:08.243563] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.661 [2024-11-16 17:06:08.243744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.661 [2024-11-16 17:06:08.243897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.661 [2024-11-16 17:06:08.243933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.661 [2024-11-16 17:06:08.243948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.661 [2024-11-16 17:06:08.245946] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.661 [2024-11-16 17:06:08.255439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.661 [2024-11-16 17:06:08.255693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.255784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.255810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.661 [2024-11-16 17:06:08.255826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.661 [2024-11-16 17:06:08.256007] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.661 [2024-11-16 17:06:08.256141] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.661 [2024-11-16 17:06:08.256162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.661 [2024-11-16 17:06:08.256176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.661 [2024-11-16 17:06:08.258323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.661 [2024-11-16 17:06:08.267905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.661 [2024-11-16 17:06:08.268204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.268328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.268362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.661 [2024-11-16 17:06:08.268379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.661 [2024-11-16 17:06:08.268544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.661 [2024-11-16 17:06:08.268703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.661 [2024-11-16 17:06:08.268725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.661 [2024-11-16 17:06:08.268740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.661 [2024-11-16 17:06:08.270742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.661 [2024-11-16 17:06:08.280216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.661 [2024-11-16 17:06:08.280460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.280576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.280603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.661 [2024-11-16 17:06:08.280628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.661 [2024-11-16 17:06:08.280827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.661 [2024-11-16 17:06:08.280991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.661 [2024-11-16 17:06:08.281013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.661 [2024-11-16 17:06:08.281027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.661 [2024-11-16 17:06:08.283093] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.661 [2024-11-16 17:06:08.292489] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.661 [2024-11-16 17:06:08.292844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.292939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.292964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.661 [2024-11-16 17:06:08.292980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.661 [2024-11-16 17:06:08.293144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.661 [2024-11-16 17:06:08.293293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.661 [2024-11-16 17:06:08.293314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.661 [2024-11-16 17:06:08.293329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.661 [2024-11-16 17:06:08.295704] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.661 [2024-11-16 17:06:08.304692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.661 [2024-11-16 17:06:08.304934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.305022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.305048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.661 [2024-11-16 17:06:08.305069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.661 [2024-11-16 17:06:08.305187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.661 [2024-11-16 17:06:08.305338] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.661 [2024-11-16 17:06:08.305359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.661 [2024-11-16 17:06:08.305373] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.661 [2024-11-16 17:06:08.307305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.661 [2024-11-16 17:06:08.317095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.661 [2024-11-16 17:06:08.317381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.317495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.317520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.661 [2024-11-16 17:06:08.317536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.661 [2024-11-16 17:06:08.317693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.661 [2024-11-16 17:06:08.317830] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.661 [2024-11-16 17:06:08.317851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.661 [2024-11-16 17:06:08.317865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.661 [2024-11-16 17:06:08.319772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.661 [2024-11-16 17:06:08.329582] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.661 [2024-11-16 17:06:08.329840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.329937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.329963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.661 [2024-11-16 17:06:08.329979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.661 [2024-11-16 17:06:08.330176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.661 [2024-11-16 17:06:08.330340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.661 [2024-11-16 17:06:08.330362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.661 [2024-11-16 17:06:08.330376] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.661 [2024-11-16 17:06:08.332410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.661 [2024-11-16 17:06:08.342079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.661 [2024-11-16 17:06:08.342280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.342391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.342417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.661 [2024-11-16 17:06:08.342433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.661 [2024-11-16 17:06:08.342554] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.661 [2024-11-16 17:06:08.342684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.661 [2024-11-16 17:06:08.342705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.661 [2024-11-16 17:06:08.342719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.661 [2024-11-16 17:06:08.344782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.661 [2024-11-16 17:06:08.354465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.661 [2024-11-16 17:06:08.354734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.354847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.661 [2024-11-16 17:06:08.354873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.661 [2024-11-16 17:06:08.354890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.661 [2024-11-16 17:06:08.355055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.661 17:06:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:22.662 [2024-11-16 17:06:08.355224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.662 17:06:08 -- common/autotest_common.sh@862 -- # return 0 00:30:22.662 [2024-11-16 17:06:08.355245] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.662 [2024-11-16 17:06:08.355262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.662 17:06:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:22.662 17:06:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:22.662 17:06:08 -- common/autotest_common.sh@10 -- # set +x 00:30:22.662 [2024-11-16 17:06:08.357314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.662 [2024-11-16 17:06:08.366850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.662 [2024-11-16 17:06:08.367145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.662 [2024-11-16 17:06:08.367253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.662 [2024-11-16 17:06:08.367278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.662 [2024-11-16 17:06:08.367296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.662 [2024-11-16 17:06:08.367461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.662 [2024-11-16 17:06:08.367640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.662 [2024-11-16 17:06:08.367662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.662 [2024-11-16 17:06:08.367676] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.662 [2024-11-16 17:06:08.370017] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.662 17:06:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:22.662 17:06:08 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:22.662 17:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:22.662 17:06:08 -- common/autotest_common.sh@10 -- # set +x 00:30:22.662 [2024-11-16 17:06:08.379162] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.662 [2024-11-16 17:06:08.379470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.662 [2024-11-16 17:06:08.379588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.662 [2024-11-16 17:06:08.379621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.662 [2024-11-16 17:06:08.379640] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.662 [2024-11-16 17:06:08.379804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.662 [2024-11-16 17:06:08.379925] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.662 [2024-11-16 17:06:08.379971] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.662 [2024-11-16 17:06:08.379985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.662 [2024-11-16 17:06:08.382188] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.662 [2024-11-16 17:06:08.383008] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:22.662 17:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:22.662 17:06:08 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:22.662 17:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:22.662 17:06:08 -- common/autotest_common.sh@10 -- # set +x 00:30:22.662 [2024-11-16 17:06:08.391732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.662 [2024-11-16 17:06:08.392031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.662 [2024-11-16 17:06:08.392123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.662 [2024-11-16 17:06:08.392149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.662 [2024-11-16 17:06:08.392165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.662 [2024-11-16 17:06:08.392314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.662 [2024-11-16 17:06:08.392494] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.662 [2024-11-16 17:06:08.392515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.662 [2024-11-16 17:06:08.392529] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.662 [2024-11-16 17:06:08.394467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.662 [2024-11-16 17:06:08.404097] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.662 [2024-11-16 17:06:08.404350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.662 [2024-11-16 17:06:08.404466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.662 [2024-11-16 17:06:08.404492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.662 [2024-11-16 17:06:08.404509] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.662 [2024-11-16 17:06:08.404693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.662 [2024-11-16 17:06:08.404878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.662 [2024-11-16 17:06:08.404899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.662 [2024-11-16 17:06:08.404929] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.662 [2024-11-16 17:06:08.407010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.932 [2024-11-16 17:06:08.416644] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.932 [2024-11-16 17:06:08.417019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.933 [2024-11-16 17:06:08.417127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.933 [2024-11-16 17:06:08.417153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.933 [2024-11-16 17:06:08.417172] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.933 [2024-11-16 17:06:08.417359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.933 [2024-11-16 17:06:08.417575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.933 [2024-11-16 17:06:08.417597] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.933 [2024-11-16 17:06:08.417640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.933 [2024-11-16 17:06:08.419872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.933 [2024-11-16 17:06:08.429075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.933 Malloc0 00:30:22.933 [2024-11-16 17:06:08.429448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.933 17:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:22.933 [2024-11-16 17:06:08.429579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.933 [2024-11-16 17:06:08.429606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.933 [2024-11-16 17:06:08.429635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.933 17:06:08 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:22.933 17:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:22.933 [2024-11-16 17:06:08.429837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.933 17:06:08 -- common/autotest_common.sh@10 -- # set +x 00:30:22.933 [2024-11-16 17:06:08.429976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.933 [2024-11-16 17:06:08.429999] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.933 [2024-11-16 17:06:08.430016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.933 [2024-11-16 17:06:08.432149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.933 17:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:22.933 17:06:08 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:22.933 17:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:22.933 17:06:08 -- common/autotest_common.sh@10 -- # set +x 00:30:22.933 [2024-11-16 17:06:08.441302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.933 [2024-11-16 17:06:08.441576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.933 [2024-11-16 17:06:08.441675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.933 [2024-11-16 17:06:08.441702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7121d0 with addr=10.0.0.2, port=4420 00:30:22.933 [2024-11-16 17:06:08.441720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7121d0 is same with the state(5) to be set 00:30:22.933 [2024-11-16 17:06:08.441902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7121d0 (9): Bad file descriptor 00:30:22.933 [2024-11-16 17:06:08.442049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.933 [2024-11-16 17:06:08.442079] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.933 [2024-11-16 17:06:08.442094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.933 [2024-11-16 17:06:08.444199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.933 17:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:22.933 17:06:08 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:22.933 17:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:22.933 17:06:08 -- common/autotest_common.sh@10 -- # set +x 00:30:22.933 [2024-11-16 17:06:08.448983] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:22.933 17:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:22.933 17:06:08 -- host/bdevperf.sh@38 -- # wait 1327033 00:30:22.933 [2024-11-16 17:06:08.453629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.933 [2024-11-16 17:06:08.485584] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:31.051 00:30:31.051 Latency(us) 00:30:31.051 [2024-11-16T16:06:16.801Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:31.051 [2024-11-16T16:06:16.801Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:31.051 Verification LBA range: start 0x0 length 0x4000 00:30:31.051 Nvme1n1 : 15.01 9367.51 36.59 16035.31 0.00 5024.02 594.68 21845.33 00:30:31.051 [2024-11-16T16:06:16.801Z] =================================================================================================================== 00:30:31.051 [2024-11-16T16:06:16.801Z] Total : 9367.51 36.59 16035.31 0.00 5024.02 594.68 21845.33 00:30:31.310 17:06:16 -- host/bdevperf.sh@39 -- # sync 00:30:31.310 17:06:16 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:31.310 17:06:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.310 17:06:16 -- common/autotest_common.sh@10 -- # set +x 00:30:31.310 17:06:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.310 17:06:16 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:31.310 17:06:16 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:31.310 17:06:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:31.310 17:06:16 -- nvmf/common.sh@116 -- # sync 00:30:31.310 17:06:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:31.311 17:06:16 -- nvmf/common.sh@119 -- # set +e 00:30:31.311 17:06:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:31.311 17:06:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:31.311 rmmod nvme_tcp 00:30:31.311 rmmod nvme_fabrics 00:30:31.311 rmmod nvme_keyring 00:30:31.311 17:06:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:31.311 17:06:17 -- nvmf/common.sh@123 -- # set -e 00:30:31.311 17:06:17 -- nvmf/common.sh@124 -- # return 0 00:30:31.311 17:06:17 -- nvmf/common.sh@477 -- # '[' -n 1327799 ']' 00:30:31.311 17:06:17 -- nvmf/common.sh@478 -- # killprocess 1327799 00:30:31.311 17:06:17 -- common/autotest_common.sh@936 -- # '[' -z 1327799 ']' 00:30:31.311 17:06:17 -- common/autotest_common.sh@940 -- # kill -0 1327799 00:30:31.311 17:06:17 -- common/autotest_common.sh@941 -- # uname 00:30:31.311 17:06:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:31.311 17:06:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1327799 00:30:31.662 17:06:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:31.662 17:06:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:31.662 17:06:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1327799' 00:30:31.662 killing process with pid 1327799 00:30:31.662 17:06:17 -- common/autotest_common.sh@955 -- # kill 1327799 00:30:31.662 17:06:17 -- common/autotest_common.sh@960 -- # wait 1327799 00:30:31.662 17:06:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:31.662 17:06:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:31.662 17:06:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:31.662 17:06:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:31.662 17:06:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:31.662 17:06:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:31.662 17:06:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:31.662 17:06:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:34.215 17:06:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:34.215 00:30:34.215 real 0m23.073s 00:30:34.215 user 1m2.190s 00:30:34.215 sys 0m4.351s 00:30:34.215 17:06:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:34.215 17:06:19 -- common/autotest_common.sh@10 -- # set +x 00:30:34.215 ************************************ 00:30:34.215 END TEST nvmf_bdevperf 00:30:34.215 ************************************ 00:30:34.215 17:06:19 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:34.215 17:06:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:34.215 17:06:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:34.215 17:06:19 -- common/autotest_common.sh@10 -- # set +x 00:30:34.215 ************************************ 00:30:34.215 START TEST nvmf_target_disconnect 00:30:34.215 ************************************ 00:30:34.215 17:06:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:34.215 * Looking for test storage... 00:30:34.215 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:34.215 17:06:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:34.215 17:06:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:34.215 17:06:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:34.215 17:06:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:34.215 17:06:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:34.215 17:06:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:34.215 17:06:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:34.215 17:06:19 -- scripts/common.sh@335 -- # IFS=.-: 00:30:34.215 17:06:19 -- scripts/common.sh@335 -- # read -ra ver1 00:30:34.215 17:06:19 -- scripts/common.sh@336 -- # IFS=.-: 00:30:34.215 17:06:19 -- scripts/common.sh@336 -- # read -ra ver2 00:30:34.215 17:06:19 -- scripts/common.sh@337 -- # local 'op=<' 00:30:34.215 17:06:19 -- scripts/common.sh@339 -- # ver1_l=2 00:30:34.215 17:06:19 -- scripts/common.sh@340 -- # ver2_l=1 00:30:34.215 17:06:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:34.215 17:06:19 -- scripts/common.sh@343 -- # case "$op" in 00:30:34.215 17:06:19 -- scripts/common.sh@344 -- # : 1 00:30:34.215 17:06:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:34.215 17:06:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:34.215 17:06:19 -- scripts/common.sh@364 -- # decimal 1 00:30:34.215 17:06:19 -- scripts/common.sh@352 -- # local d=1 00:30:34.215 17:06:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:34.215 17:06:19 -- scripts/common.sh@354 -- # echo 1 00:30:34.215 17:06:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:34.215 17:06:19 -- scripts/common.sh@365 -- # decimal 2 00:30:34.215 17:06:19 -- scripts/common.sh@352 -- # local d=2 00:30:34.215 17:06:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:34.215 17:06:19 -- scripts/common.sh@354 -- # echo 2 00:30:34.215 17:06:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:34.215 17:06:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:34.215 17:06:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:34.215 17:06:19 -- scripts/common.sh@367 -- # return 0 00:30:34.215 17:06:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:34.215 17:06:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:34.215 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:34.215 --rc genhtml_branch_coverage=1 00:30:34.215 --rc genhtml_function_coverage=1 00:30:34.215 --rc genhtml_legend=1 00:30:34.215 --rc geninfo_all_blocks=1 00:30:34.215 --rc geninfo_unexecuted_blocks=1 00:30:34.215 00:30:34.215 ' 00:30:34.215 17:06:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:34.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:34.216 --rc genhtml_branch_coverage=1 00:30:34.216 --rc genhtml_function_coverage=1 00:30:34.216 --rc genhtml_legend=1 00:30:34.216 --rc geninfo_all_blocks=1 00:30:34.216 --rc geninfo_unexecuted_blocks=1 00:30:34.216 00:30:34.216 ' 00:30:34.216 17:06:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:34.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:34.216 --rc genhtml_branch_coverage=1 00:30:34.216 --rc genhtml_function_coverage=1 00:30:34.216 --rc genhtml_legend=1 00:30:34.216 --rc geninfo_all_blocks=1 00:30:34.216 --rc geninfo_unexecuted_blocks=1 00:30:34.216 00:30:34.216 ' 00:30:34.216 17:06:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:34.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:34.216 --rc genhtml_branch_coverage=1 00:30:34.216 --rc genhtml_function_coverage=1 00:30:34.216 --rc genhtml_legend=1 00:30:34.216 --rc geninfo_all_blocks=1 00:30:34.216 --rc geninfo_unexecuted_blocks=1 00:30:34.216 00:30:34.216 ' 00:30:34.216 17:06:19 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:34.216 17:06:19 -- nvmf/common.sh@7 -- # uname -s 00:30:34.216 17:06:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:34.216 17:06:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:34.216 17:06:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:34.216 17:06:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:34.216 17:06:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:34.216 17:06:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:34.216 17:06:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:34.216 17:06:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:34.216 17:06:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:34.216 17:06:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:34.216 17:06:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:34.216 17:06:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:34.216 17:06:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:34.216 17:06:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:34.216 17:06:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:34.216 17:06:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:34.216 17:06:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:34.216 17:06:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:34.216 17:06:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:34.216 17:06:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.216 17:06:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.216 17:06:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.216 17:06:19 -- paths/export.sh@5 -- # export PATH 00:30:34.216 17:06:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.216 17:06:19 -- nvmf/common.sh@46 -- # : 0 00:30:34.216 17:06:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:34.216 17:06:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:34.216 17:06:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:34.216 17:06:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:34.216 17:06:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:34.216 17:06:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:34.216 17:06:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:34.216 17:06:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:34.216 17:06:19 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:34.216 17:06:19 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:34.216 17:06:19 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:34.216 17:06:19 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:34.216 17:06:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:34.216 17:06:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:34.216 17:06:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:34.216 17:06:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:34.216 17:06:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:34.216 17:06:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:34.216 17:06:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:34.216 17:06:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:34.216 17:06:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:34.216 17:06:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:34.216 17:06:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:34.216 17:06:19 -- common/autotest_common.sh@10 -- # set +x 00:30:36.121 17:06:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:36.121 17:06:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:36.121 17:06:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:36.121 17:06:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:36.121 17:06:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:36.121 17:06:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:36.121 17:06:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:36.121 17:06:21 -- nvmf/common.sh@294 -- # net_devs=() 00:30:36.121 17:06:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:36.121 17:06:21 -- nvmf/common.sh@295 -- # e810=() 00:30:36.121 17:06:21 -- nvmf/common.sh@295 -- # local -ga e810 00:30:36.121 17:06:21 -- nvmf/common.sh@296 -- # x722=() 00:30:36.121 17:06:21 -- nvmf/common.sh@296 -- # local -ga x722 00:30:36.121 17:06:21 -- nvmf/common.sh@297 -- # mlx=() 00:30:36.121 17:06:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:36.121 17:06:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:36.121 17:06:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:36.121 17:06:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:36.121 17:06:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:36.121 17:06:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:36.121 17:06:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:36.121 17:06:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:36.121 17:06:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:36.121 17:06:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:36.121 17:06:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:36.121 17:06:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:36.121 17:06:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:36.121 17:06:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:36.121 17:06:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:36.121 17:06:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:36.121 17:06:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:36.121 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:36.121 17:06:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:36.121 17:06:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:36.121 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:36.121 17:06:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:36.121 17:06:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:36.121 17:06:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:36.121 17:06:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:36.121 17:06:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:36.121 17:06:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:36.121 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:36.121 17:06:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:36.121 17:06:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:36.121 17:06:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:36.121 17:06:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:36.121 17:06:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:36.121 17:06:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:36.121 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:36.121 17:06:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:36.121 17:06:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:36.121 17:06:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:36.121 17:06:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:36.121 17:06:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:36.121 17:06:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:36.121 17:06:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:36.121 17:06:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:36.121 17:06:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:36.121 17:06:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:36.121 17:06:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:36.121 17:06:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:36.121 17:06:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:36.121 17:06:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:36.121 17:06:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:36.121 17:06:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:36.121 17:06:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:36.121 17:06:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:36.121 17:06:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:36.122 17:06:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:36.122 17:06:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:36.122 17:06:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:36.122 17:06:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:36.122 17:06:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:36.122 17:06:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:36.122 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:36.122 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:30:36.122 00:30:36.122 --- 10.0.0.2 ping statistics --- 00:30:36.122 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:36.122 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:30:36.122 17:06:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:36.122 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:36.122 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:30:36.122 00:30:36.122 --- 10.0.0.1 ping statistics --- 00:30:36.122 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:36.122 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:30:36.122 17:06:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:36.122 17:06:21 -- nvmf/common.sh@410 -- # return 0 00:30:36.122 17:06:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:36.122 17:06:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:36.122 17:06:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:36.122 17:06:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:36.122 17:06:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:36.122 17:06:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:36.122 17:06:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:36.122 17:06:21 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:36.122 17:06:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:36.122 17:06:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:36.122 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:30:36.122 ************************************ 00:30:36.122 START TEST nvmf_target_disconnect_tc1 00:30:36.122 ************************************ 00:30:36.122 17:06:21 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:36.122 17:06:21 -- host/target_disconnect.sh@32 -- # set +e 00:30:36.122 17:06:21 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:36.122 EAL: No free 2048 kB hugepages reported on node 1 00:30:36.122 [2024-11-16 17:06:21.845788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.122 [2024-11-16 17:06:21.846018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.122 [2024-11-16 17:06:21.846046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x182b270 with addr=10.0.0.2, port=4420 00:30:36.122 [2024-11-16 17:06:21.846079] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:36.122 [2024-11-16 17:06:21.846100] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:36.122 [2024-11-16 17:06:21.846114] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:36.122 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:36.122 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:36.122 Initializing NVMe Controllers 00:30:36.122 17:06:21 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:36.122 17:06:21 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:36.122 17:06:21 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:36.122 17:06:21 -- common/autotest_common.sh@1142 -- # return 0 00:30:36.122 17:06:21 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:36.122 17:06:21 -- host/target_disconnect.sh@41 -- # set -e 00:30:36.122 00:30:36.122 real 0m0.095s 00:30:36.122 user 0m0.043s 00:30:36.122 sys 0m0.051s 00:30:36.122 17:06:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:36.122 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:30:36.122 ************************************ 00:30:36.122 END TEST nvmf_target_disconnect_tc1 00:30:36.122 ************************************ 00:30:36.380 17:06:21 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:36.380 17:06:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:36.380 17:06:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:36.380 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:30:36.380 ************************************ 00:30:36.380 START TEST nvmf_target_disconnect_tc2 00:30:36.380 ************************************ 00:30:36.380 17:06:21 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:36.380 17:06:21 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:36.380 17:06:21 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:36.380 17:06:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:36.380 17:06:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:36.380 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:30:36.380 17:06:21 -- nvmf/common.sh@469 -- # nvmfpid=1331505 00:30:36.380 17:06:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:36.380 17:06:21 -- nvmf/common.sh@470 -- # waitforlisten 1331505 00:30:36.380 17:06:21 -- common/autotest_common.sh@829 -- # '[' -z 1331505 ']' 00:30:36.380 17:06:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:36.380 17:06:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:36.380 17:06:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:36.380 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:36.380 17:06:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:36.380 17:06:21 -- common/autotest_common.sh@10 -- # set +x 00:30:36.380 [2024-11-16 17:06:21.934464] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:36.380 [2024-11-16 17:06:21.934541] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:36.380 EAL: No free 2048 kB hugepages reported on node 1 00:30:36.380 [2024-11-16 17:06:21.995366] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:36.380 [2024-11-16 17:06:22.075007] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:36.380 [2024-11-16 17:06:22.075162] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:36.380 [2024-11-16 17:06:22.075179] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:36.380 [2024-11-16 17:06:22.075191] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:36.380 [2024-11-16 17:06:22.075567] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:36.380 [2024-11-16 17:06:22.075648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:36.380 [2024-11-16 17:06:22.075715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:36.380 [2024-11-16 17:06:22.075718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:37.318 17:06:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:37.318 17:06:22 -- common/autotest_common.sh@862 -- # return 0 00:30:37.318 17:06:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:37.318 17:06:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:37.318 17:06:22 -- common/autotest_common.sh@10 -- # set +x 00:30:37.318 17:06:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:37.318 17:06:22 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:37.318 17:06:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.318 17:06:22 -- common/autotest_common.sh@10 -- # set +x 00:30:37.318 Malloc0 00:30:37.318 17:06:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.318 17:06:22 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:37.318 17:06:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.318 17:06:22 -- common/autotest_common.sh@10 -- # set +x 00:30:37.318 [2024-11-16 17:06:22.955363] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:37.318 17:06:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.318 17:06:22 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:37.318 17:06:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.318 17:06:22 -- common/autotest_common.sh@10 -- # set +x 00:30:37.318 17:06:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.318 17:06:22 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:37.318 17:06:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.318 17:06:22 -- common/autotest_common.sh@10 -- # set +x 00:30:37.318 17:06:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.318 17:06:22 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:37.318 17:06:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.318 17:06:22 -- common/autotest_common.sh@10 -- # set +x 00:30:37.318 [2024-11-16 17:06:22.983648] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:37.318 17:06:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.318 17:06:22 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:37.318 17:06:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.318 17:06:22 -- common/autotest_common.sh@10 -- # set +x 00:30:37.318 17:06:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.318 17:06:22 -- host/target_disconnect.sh@50 -- # reconnectpid=1331663 00:30:37.318 17:06:22 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:37.318 17:06:22 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:37.318 EAL: No free 2048 kB hugepages reported on node 1 00:30:39.881 17:06:24 -- host/target_disconnect.sh@53 -- # kill -9 1331505 00:30:39.881 17:06:24 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Write completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Write completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Write completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Write completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Write completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Write completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Write completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Write completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Write completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 [2024-11-16 17:06:25.009049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.881 Read completed with error (sct=0, sc=8) 00:30:39.881 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 [2024-11-16 17:06:25.009443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 [2024-11-16 17:06:25.009796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Write completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 Read completed with error (sct=0, sc=8) 00:30:39.882 starting I/O failed 00:30:39.882 [2024-11-16 17:06:25.010129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:39.882 [2024-11-16 17:06:25.010334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.882 [2024-11-16 17:06:25.010482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.882 [2024-11-16 17:06:25.010510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.882 qpair failed and we were unable to recover it. 00:30:39.882 [2024-11-16 17:06:25.010657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.882 [2024-11-16 17:06:25.010752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.882 [2024-11-16 17:06:25.010779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.882 qpair failed and we were unable to recover it. 00:30:39.882 [2024-11-16 17:06:25.010877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.882 [2024-11-16 17:06:25.011005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.882 [2024-11-16 17:06:25.011032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.882 qpair failed and we were unable to recover it. 00:30:39.882 [2024-11-16 17:06:25.011130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.882 [2024-11-16 17:06:25.011239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.882 [2024-11-16 17:06:25.011265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.882 qpair failed and we were unable to recover it. 00:30:39.882 [2024-11-16 17:06:25.011354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.882 [2024-11-16 17:06:25.011449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.011475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.011561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.011655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.011682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.011798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.011900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.011924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.012044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.012139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.012164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.012305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.012402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.012429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.012540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.012668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.012695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.012810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.012961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.012986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.013067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.013158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.013201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.013353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.013501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.013544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.013675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.013753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.013778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.013862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.013977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.014003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.014102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.014178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.014203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.014354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.014471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.014497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.014606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.014697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.014722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.014807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.014880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.014905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.015004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.015145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.015173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.015318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.015455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.015486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.015585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.015708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.015734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.015828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.015914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.015939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.016064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.016145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.016170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.016332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.016447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.016488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.016579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.016666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.016692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.016774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.016852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.016878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.016971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.017107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.017145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.017231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.017320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.017347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.017475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.017632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.017663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.017746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.017860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.017886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.017973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.018111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.018136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.883 [2024-11-16 17:06:25.018225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.018401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.883 [2024-11-16 17:06:25.018444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.883 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.018573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.018683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.018709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.018816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.018933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.018963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.019056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.019137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.019162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.019274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.019378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.019403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.019526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.019636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.019662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.019737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.019821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.019847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.019959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.020034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.020064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.020173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.020246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.020270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.020377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.020497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.020538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.020625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.020712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.020736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.020827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.020979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.021003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.021168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.021255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.021283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.021450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.021550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.021577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.021712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.021822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.021847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.021969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.022113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.022138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.022281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.022367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.022394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.022558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.022648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.022673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.022765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.022873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.022898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.023013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.023146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.023174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.023270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.023438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.023464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.023574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.023684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.023710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.023787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.023933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.023957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.024088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.024205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.024230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.024343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.024456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.024480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.024577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.024670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.024696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.024786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.024889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.024914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.025707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.026095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.026120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.026241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.026350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.026374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.884 [2024-11-16 17:06:25.026467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.026603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.884 [2024-11-16 17:06:25.026633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.884 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.026751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.026862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.026886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.026977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.027059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.027083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.027160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.027276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.027301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.027402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.027482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.027506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.027597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.027708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.027733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.027817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.027931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.027956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.028050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.028172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.028202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.028340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.028474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.028502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.028660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.028775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.028800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.028882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.028992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.029019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.029127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.029210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.029235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.029339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.029425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.029449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.029607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.029758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.029783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.029867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.029951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.029981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.030100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.030212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.030253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.030419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.030578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.030602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.030696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.030783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.030807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.030948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.031032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.031056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.031162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.031254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.031278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.031398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.031510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.031535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.031641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.031760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.031784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.031901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.031991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.032024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.032116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.032235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.032260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.032365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.032456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.032481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.032630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.032741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.032766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.032860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.032946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.032971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.033110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.033220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.033247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.033373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.033451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.885 [2024-11-16 17:06:25.033476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.885 qpair failed and we were unable to recover it. 00:30:39.885 [2024-11-16 17:06:25.033625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.033709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.033738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.033847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.033965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.033990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.034111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.034224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.034248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.034371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.034449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.034473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.034613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.034716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.034742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.034825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.034912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.034937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.035033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.035118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.035143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.035261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.035331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.035356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.035466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.035583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.035607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.035726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.035837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.035861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.035953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.036094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.036118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.036212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.036322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.036347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.036456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.036559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.036584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.036679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.036766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.036791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.036906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.037016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.037040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.037153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.037235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.037260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.037373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.037468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.037496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.037661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.037800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.037826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.037905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.038041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.038067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.038146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.038227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.038251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.038361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.038454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.038478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.038563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.038700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.038727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.038868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.038988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.039013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.039128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.039233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.039258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.039362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.039435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.039460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.886 qpair failed and we were unable to recover it. 00:30:39.886 [2024-11-16 17:06:25.039580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.886 [2024-11-16 17:06:25.039679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.039704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.039824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.039942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.039967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.040084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.040221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.040246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.040325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.040438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.040464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.040587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.040705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.040731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.040821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.040938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.040964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.041048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.041164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.041189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.041275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.041381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.041407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.041519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.041591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.041627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.041731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.041837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.041861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.041956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.042094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.042121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.042224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.042311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.042336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.042418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.042535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.042563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.042725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.042867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.042892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.043019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.043130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.043157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.043270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.043381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.043408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.043519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.043612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.043652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.043760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.043848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.043874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.043999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.044080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.044107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.044215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.044327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.044355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.044498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.044628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.044655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.044763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.044901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.044926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.045010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.045100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.045125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.045219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.045360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.045385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.045506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.045586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.045611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.045710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.045820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.045846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.045957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.046048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.046073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.046151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.046273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.046298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.046413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.046499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.887 [2024-11-16 17:06:25.046524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.887 qpair failed and we were unable to recover it. 00:30:39.887 [2024-11-16 17:06:25.046646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.046788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.046813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.046903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.046988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.047013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.047092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.047222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.047250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.047379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.047455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.047480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.047599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.047755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.047781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.047868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.048005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.048047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.048129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.048233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.048258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.048375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.048500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.048525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.048624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.048701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.048726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.048832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.048943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.048968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.049078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.049189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.049214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.049295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.049379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.049405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.049484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.049622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.049648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.049788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.049866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.049891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.049997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.050104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.050129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.050270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.050361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.050386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.050497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.050630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.050656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.050738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.050852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.050877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.050973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.051095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.051120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.051230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.051373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.051399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.051508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.051596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.051637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.051753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.051866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.051891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.051977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.052118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.052143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.052231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.052348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.052373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.052484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.052629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.052655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.052820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.052927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.052953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.053042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.053115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.053140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.053246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.053357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.053382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.888 [2024-11-16 17:06:25.053470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.053581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.888 [2024-11-16 17:06:25.053607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.888 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.053701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.053814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.053839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.053938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.054048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.054073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.054157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.054248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.054273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.054368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.054488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.054513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.054671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.054764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.054791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.054918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.055055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.055080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.055170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.055320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.055345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.055423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.055538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.055563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.055657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.055763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.055789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.055872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.055990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.056019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.056103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.056191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.056216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.056329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.056403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.056428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.056570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.056702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.056728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.056871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.057015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.057040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.057150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.057272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.057304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.057453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.057570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.057598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.057769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.057858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.057883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.057993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.058083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.058108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.058190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.058273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.058298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.058431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.058555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.058580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.058764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.058865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.058894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.059043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.059174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.059200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.059282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.059391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.059416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.059526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.059610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.059646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.059730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.059821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.059847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.059961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.060098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.060123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.060205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.060309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.060346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.060465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.060610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.060644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.889 qpair failed and we were unable to recover it. 00:30:39.889 [2024-11-16 17:06:25.060727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.889 [2024-11-16 17:06:25.060833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.060859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.060970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.061085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.061114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.061241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.061328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.061353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.061432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.061548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.061573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.061678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.061820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.061845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.061963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.062083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.062107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.062196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.062308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.062334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.062421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.062553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.062578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.062672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.062784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.062809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.062924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.063010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.063035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.063177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.063277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.063307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.063400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.063555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.063583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.063738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.063849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.063873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.063992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.064099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.064126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.064253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.064377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.064406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.064501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.064651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.064677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.064759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.064846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.064871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.064960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.065098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.065123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.065238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.065327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.065353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.065477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.065564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.065590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.065691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.065776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.065801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.065888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.065988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.066015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.066171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.066249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.066273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.066385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.066468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.066492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.066577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.066702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.066728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.890 [2024-11-16 17:06:25.066844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.066939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.890 [2024-11-16 17:06:25.066964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.890 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.067079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.067159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.067183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.067296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.067405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.067430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.067571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.067734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.067763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.067872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.068000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.068025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.068105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.068217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.068242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.068324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.068400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.068434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.068564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.068679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.068707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.068844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.068934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.068958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.069049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.069196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.069225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.069309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.069422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.069450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.069547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.069678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.069705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.069824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.069940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.069967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.070058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.070143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.070167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.070274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.070351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.070376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.070500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.070639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.070664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.070749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.070840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.070864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.071034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.071235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.071283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.071380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.071471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.071497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.071627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.071756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.071785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.071894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.071986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.072010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.072100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.072217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.072243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.072354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.072432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.072457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.072542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.072650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.072677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.072819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.072968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.072993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.073096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.073210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.073235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.073349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.073440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.073467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.073556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.073689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.073716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.073828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.073946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.073971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.891 qpair failed and we were unable to recover it. 00:30:39.891 [2024-11-16 17:06:25.074099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.891 [2024-11-16 17:06:25.074216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.074242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.074437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.074521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.074547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.074646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.074769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.074795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.074913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.075006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.075033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.075158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.075247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.075272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.075380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.075478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.075505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.075643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.075757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.075782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.075891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.076017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.076042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.076126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.076249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.076276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.076364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.076469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.076495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.076639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.076755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.076781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.076877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.076966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.077002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.077117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.077194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.077220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.077335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.077415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.077441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.077552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.077682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.077709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.077789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.077901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.077926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.078048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.078168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.078194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.078303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.078420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.078445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.078529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.078632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.078662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.078751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.078868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.078894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.079009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.079090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.079116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.079235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.079362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.079387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.079504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.079583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.079608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.079694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.079811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.079836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.079979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.080070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.080095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.080184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.080301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.080326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.080409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.080499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.080525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.080605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.080722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.080748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.892 [2024-11-16 17:06:25.080833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.080952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.892 [2024-11-16 17:06:25.080986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.892 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.081103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.081216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.081241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.081355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.081468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.081493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.081611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.081743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.081769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.081883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.082028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.082053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.082138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.082247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.082272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.082395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.082508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.082533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.082644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.082728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.082754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.082873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.082990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.083015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.083098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.083189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.083214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.083332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.083447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.083473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.083588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.083678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.083705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.083847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.083928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.083955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.084056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.084169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.084195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.084286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.084425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.084451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.084572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.084736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.084762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.084843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.084956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.084981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.085070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.085155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.085180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.085288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.085402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.085427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.085569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.085675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.085701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.085781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.085864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.085894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.085972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.086057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.086082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.086189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.086307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.086332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.086447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.086531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.086556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.086680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.086795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.086821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.086978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.087062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.087088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.087200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.087281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.087306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.087391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.087507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.087532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.087635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.087716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.087740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.893 qpair failed and we were unable to recover it. 00:30:39.893 [2024-11-16 17:06:25.087856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.893 [2024-11-16 17:06:25.087965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.087991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.088066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.088151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.088181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.088289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.088408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.088433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.088548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.088656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.088681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.088760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.088836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.088862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.088947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.089093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.089118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.089202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.089279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.089303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.089418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.089536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.089562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.089655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.089766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.089792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.089878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.090002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.090027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.090139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.090280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.090306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.090415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.090556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.090586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.090741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.090877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.090907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.091047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.091160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.091185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.091269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.091356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.091381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.091496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.091577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.091602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.091732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.091872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.091898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.091991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.092103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.092128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.092267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.092352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.092378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.092539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.092668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.092697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.092830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.092966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.092991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.093082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.093218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.093248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.093388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.093503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.093528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.093643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.093772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.093814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.093982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.094121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.094146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.094232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.094309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.094335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.094447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.094560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.094585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.094705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.094790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.094816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.894 qpair failed and we were unable to recover it. 00:30:39.894 [2024-11-16 17:06:25.094930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.095017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.894 [2024-11-16 17:06:25.095042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.095146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.095222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.095247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.095361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.095445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.095470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.095550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.095656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.095682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.095792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.095898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.095923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.096013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.096154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.096179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.096264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.096455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.096479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.096595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.096721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.096747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.096938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.097065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.097108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.097222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.097373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.097399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.097479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.097565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.097591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.097791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.097957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.098000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.098147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.098257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.098283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.098403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.098514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.098541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.098672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.098884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.098925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.099020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.099124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.099151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.099302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.099392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.099417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.099508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.099627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.099655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.099749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.099837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.099862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.099970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.100054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.100080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.100191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.100276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.100302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.100421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.100528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.100553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.100673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.100794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.100820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.100928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.101041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.101066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.101211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.101400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.101425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.895 [2024-11-16 17:06:25.101538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.101655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.895 [2024-11-16 17:06:25.101680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.895 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.101762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.101875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.101900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.102006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.102099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.102125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.102216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.102326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.102353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.102465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.102569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.102594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.102723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.102813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.102838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.102982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.103123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.103148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.103224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.103333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.103358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.103440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.103576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.103602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.103771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.103878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.103904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.104012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.104147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.104172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.104287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.104372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.104397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.104484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.104599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.104632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.104777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.104877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.104904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.105006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.105090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.105114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.105227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.105365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.105389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.105475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.105547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.105572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.105676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.105816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.105840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.105934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.106043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.106068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.106211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.106294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.106319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.106429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.106540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.106565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.106681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.106770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.106796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.106910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.107017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.107041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.107159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.107266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.107291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.107396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.107500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.107525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.107639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.107754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.107779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.107900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.107985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.108010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.108117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.108225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.108251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.108389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.108497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.896 [2024-11-16 17:06:25.108522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.896 qpair failed and we were unable to recover it. 00:30:39.896 [2024-11-16 17:06:25.108626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.108737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.108762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.108844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.108954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.108978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.109082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.109200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.109225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.109338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.109448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.109473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.109612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.109727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.109752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.109842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.109933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.109958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.110071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.110153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.110178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.110276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.110383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.110407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.110512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.110633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.110662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.110762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.110844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.110869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.110999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.111111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.111141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.111232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.111353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.111378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.111459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.111600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.111634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.111778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.111876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.111906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.112029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.112143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.112171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.112265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.112400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.112427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.112539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.112658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.112684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.112812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.112937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.112964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.113155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.113267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.113293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.113405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.113544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.113568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.113725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.113900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.113942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.114076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.114206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.114233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.114347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.114454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.114479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.114597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.114740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.114783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.114887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.115014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.115038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.115147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.115350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.115375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.115491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.115605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.115662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.115836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.115968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.115995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.897 qpair failed and we were unable to recover it. 00:30:39.897 [2024-11-16 17:06:25.116091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.897 [2024-11-16 17:06:25.116207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.116231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.116312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.116506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.116532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.116632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.116747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.116791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.116905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.116987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.117011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.117104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.117241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.117266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.117376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.117483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.117508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.117667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.117778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.117803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.117944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.118054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.118078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.118164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.118252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.118278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.118386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.118462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.118487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.118592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.118688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.118716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.118857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.118974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.118999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.119116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.119209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.119234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.119377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.119462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.119489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.119579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.119703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.119730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.119829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.119920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.119944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.120057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.120177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.120201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.120325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.120410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.120435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.120553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.120641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.120668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.120792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.120949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.120995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.121074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.121164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.121189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.121296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.121381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.121408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.121490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.121621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.121649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.121792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.121936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.121961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.122080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.122196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.122222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.122326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.122462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.122487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.122600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.122695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.122721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.122814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.122923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.122948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.898 [2024-11-16 17:06:25.123060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.123144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.898 [2024-11-16 17:06:25.123169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.898 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.123260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.123339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.123363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.123480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.123585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.123609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.123726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.123833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.123857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.123949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.124059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.124084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.124224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.124360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.124384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.124471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.124581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.124607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.124729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.124846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.124871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.124952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.125036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.125061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.125153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.125269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.125294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.125434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.125640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.125667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.125804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.125917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.125944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.126073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.126248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.126273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.126397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.126540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.126565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.126712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.126828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.126857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.126945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.127025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.127050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.127137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.127220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.127244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.127384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.127460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.127484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.127576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.127700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.127727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.127840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.127945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.127971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.128085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.128158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.128182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.128291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.128394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.128418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.128535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.128635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.128661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.128778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.128860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.128885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.128991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.129136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.129165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.129278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.129386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.129411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.129524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.129637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.129663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.129751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.129860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.129885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.130023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.130163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.130188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.899 qpair failed and we were unable to recover it. 00:30:39.899 [2024-11-16 17:06:25.130271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.899 [2024-11-16 17:06:25.130381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.130406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.130533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.130612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.130651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.130761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.130867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.130892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.130977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.131115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.131140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.131256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.131344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.131370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.131479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.131597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.131642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.131759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.131837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.131862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.131950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.132085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.132110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.132226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.132343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.132367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.132482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.132592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.132624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.132737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.132868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.132894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.133000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.133079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.133104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.133217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.133326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.133351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.133506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.133592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.133624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.133733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.133838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.133863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.133977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.134089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.134114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.134225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.134336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.134364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.134483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.134571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.134595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.134723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.134848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.134876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.134998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.135113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.135138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.135225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.135303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.135328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.135440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.135551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.135576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.135701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.135780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.135804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.135955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.136135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.136162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.136266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.136401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.136428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.136508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.136604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.900 [2024-11-16 17:06:25.136655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.900 qpair failed and we were unable to recover it. 00:30:39.900 [2024-11-16 17:06:25.136777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.136935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.136963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.137089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.137202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.137229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.137337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.137472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.137500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.137634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.137766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.137791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.137927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.138039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.138064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.138230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.138353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.138381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.138511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.138635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.138677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.138788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.138927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.138951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.139059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.139179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.139208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.139307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.139471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.139499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.139626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.139714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.139738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.139853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.139972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.140000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.140120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.140270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.140299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.140452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.140577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.140602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.140690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.140773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.140797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.140910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.141060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.141087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.141208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.141299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.141329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.141445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.141564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.141592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.141719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.141875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.141904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.142036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.142191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.142241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.142369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.142490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.142531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.142610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.142722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.142747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.142832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.142940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.142981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.143109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.143197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.143224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.143337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.143431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.143459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.143586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.143670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.143696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.143782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.143895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.143919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.144001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.144117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.144143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.901 qpair failed and we were unable to recover it. 00:30:39.901 [2024-11-16 17:06:25.144239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.901 [2024-11-16 17:06:25.144355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.144383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.144495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.144600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.144633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.144748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.144844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.144892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.145001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.145122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.145149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.145265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.145389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.145417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.145568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.145710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.145737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.145816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.145954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.145982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.146105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.146232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.146260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.146394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.146541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.146568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.146801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.146939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.146985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.147157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.147337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.147365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.147523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.147604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.147638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.147775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.147899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.147927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.148087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.148204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.148231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.148348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.148476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.148504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.148634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.148750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.148775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.148894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.149060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.149087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.149184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.149314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.149338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.149464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.149568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.149593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.149709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.149828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.149853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.149957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.150075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.150102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.150210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.150343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.150370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.150497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.150623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.150668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.150786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.150928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.150971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.151147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.151260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.151288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.151407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.151549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.151577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.151685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.151794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.151819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.151932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.152046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.152071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.902 [2024-11-16 17:06:25.152183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.152291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.902 [2024-11-16 17:06:25.152332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.902 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.152472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.152556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.152581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.152680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.152766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.152791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.152905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.153011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.153036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.153113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.153221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.153248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.153348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.153492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.153520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.153653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.153750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.153775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.153852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.154013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.154040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.154161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.154279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.154306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.154394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.154520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.154544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.154648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.154760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.154784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.154905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.155053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.155079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.155198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.155326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.155352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.155474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.155563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.155603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.155695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.155839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.155864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.156004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.156094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.156121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.156270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.156420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.156447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.156600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.156711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.156736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.156876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.157022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.157050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.157178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.157274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.157300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.157487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.157647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.157672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.157782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.157884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.157908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.158071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.158190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.158217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.158317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.158477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.158503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.158640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.158744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.158774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.158901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.159053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.159080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.159191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.159367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.159403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.159513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.159668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.159693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.159807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.159906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.159933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.903 qpair failed and we were unable to recover it. 00:30:39.903 [2024-11-16 17:06:25.160041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.903 [2024-11-16 17:06:25.160150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.160175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.160279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.160441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.160469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.160623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.160720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.160744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.160855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.160940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.160965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.161120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.161202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.161235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.161332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.161448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.161480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.161626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.161715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.161740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.161855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.161989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.162016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.162100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.162187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.162213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.162312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.162415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.162439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.162583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.162716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.162743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.162884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.163011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.163039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.163169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.163254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.163280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.163416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.163548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.163575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.163740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.163865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.163893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.164057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.164169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.164200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.164368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.164489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.164514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.164695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.164810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.164839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.164975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.165060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.165085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.165179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.165336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.165364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.165456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.165577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.165625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.165733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.165847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.165872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.166002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.166085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.166133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.166245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.166358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.166384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.166501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.166613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.166645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.166758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.166872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.166915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.904 qpair failed and we were unable to recover it. 00:30:39.904 [2024-11-16 17:06:25.167040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.904 [2024-11-16 17:06:25.167164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.167190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.167305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.167415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.167440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.167530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.167634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.167679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.167792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.167904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.167930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.168077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.168161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.168186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.168305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.168458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.168486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.168607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.168747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.168773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.168866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.169007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.169033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.169134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.169301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.169326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.169404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.169568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.169609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.169765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.169845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.169870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.169996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.170139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.170180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.170328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.170459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.170486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.170636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.170729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.170754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.170843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.171011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.171039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.171138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.171225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.171253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.171379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.171464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.171489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.171568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.171650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.171676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.171807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.171927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.171955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.172083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.172200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.172225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.172309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.172422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.172448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.172552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.172734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.172761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.172846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.172929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.172954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.173038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.173150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.173175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.173255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.173335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.173360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.173460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.173544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.173572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.173680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.173785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.173810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.173956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.174080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.174108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.174239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.174312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.905 [2024-11-16 17:06:25.174338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.905 qpair failed and we were unable to recover it. 00:30:39.905 [2024-11-16 17:06:25.174497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.174631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.174660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.174759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.174865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.174894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.175000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.175117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.175142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.175240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.175356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.175384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.175477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.175567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.175595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.175712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.175821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.175846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.175936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.176045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.176073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.176200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.176293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.176322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.176446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.176555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.176581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.176703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.176807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.176832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.176924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.177016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.177043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.177160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.177250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.177279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.177357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.177472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.177497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.177637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.177718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.177743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.177831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.178004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.178031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.178164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.178270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.178295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.178409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.178518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.178546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.178682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.178805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.178833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.178939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.179055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.179084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.179216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.179293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.179318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.179477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.179590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.179622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.179744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.179868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.179895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.180059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.180156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.180184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.180279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.180393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.180417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.180568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.180694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.180723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.180817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.180935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.180960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.181046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.181155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.181180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.181265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.181373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.181398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.906 qpair failed and we were unable to recover it. 00:30:39.906 [2024-11-16 17:06:25.181505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.906 [2024-11-16 17:06:25.181675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.181701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.181786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.181866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.181891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.182029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.182117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.182145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.182271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.182387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.182412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.182567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.182704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.182733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.182822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.182948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.182976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.183062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.183190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.183215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.183320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.183431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.183456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.183569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.183685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.183711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.183798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.183912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.183936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.184042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.184121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.184145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.184227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.184308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.184334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.184442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.184553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.184578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.184699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa89e00 is same with the state(5) to be set 00:30:39.907 [2024-11-16 17:06:25.184855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.185012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.185042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.185158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.185240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.185266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.185374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.185487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.185529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.185698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.185846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.185887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.186003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.186145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.186170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.186246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.186360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.186385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.186466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.186629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.186657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.186755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.186833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.186857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.186937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.187099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.187128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.187247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.187362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.187390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.187500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.187592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.187623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.187744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.187854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.187880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.188017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.188141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.188165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.188280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.188428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.188454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.188614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.188732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.188757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.907 qpair failed and we were unable to recover it. 00:30:39.907 [2024-11-16 17:06:25.188847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.907 [2024-11-16 17:06:25.188947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.188974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.189133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.189260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.189285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.189399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.189526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.189554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.189702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.189816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.189842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.189961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.190076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.190103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.190189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.190324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.190352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.190518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.190679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.190705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.190843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.190984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.191025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.191175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.191296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.191338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.191420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.191507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.191532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.191648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.191754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.191777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.191859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.192042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.192067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.192209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.192336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.192371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.192513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.192597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.192627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.192743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.192825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.192851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.192945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.193058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.193083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.193182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.193327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.193372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.193460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.193601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.193635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.193727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.193832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.193857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.194049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.194188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.194237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.194353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.194471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.194497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.194575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.194660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.194686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.194801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.194952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.194977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.195089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.195175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.195201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.195314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.195429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.195454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.195541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.195653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.195679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.195789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.195897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.195922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.196038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.196176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.196201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.908 [2024-11-16 17:06:25.196311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.196450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.908 [2024-11-16 17:06:25.196475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.908 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.196581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.196686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.196713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.196845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.197050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.197108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.197247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.197356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.197382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.197463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.197570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.197595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.197702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.197830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.197858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.197988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.198129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.198155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.198246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.198359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.198384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.198533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.198651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.198678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.198799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.198948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.198976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.199075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.199195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.199223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.199347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.199434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.199462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.199576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.199717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.199743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.199821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.199963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.199991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.200144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.200292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.200319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.200433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.200557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.200585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.200724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.200812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.200837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.200971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.201121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.201169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.201296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.201410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.201444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.201545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.201659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.201685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.201826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.201924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.201950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.202057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.202193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.202218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.202348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.202464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.202492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.202600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.202698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.202724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.202808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.202889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.202915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.202990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.203119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.203146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.909 qpair failed and we were unable to recover it. 00:30:39.909 [2024-11-16 17:06:25.203300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.203427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.909 [2024-11-16 17:06:25.203454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.203569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.203681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.203707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.203835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.203983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.204010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.204114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.204224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.204252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.204401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.204492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.204520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.204635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.204730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.204755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.204886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.204974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.205001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.205090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.205209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.205237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.205331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.205455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.205483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.205633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.205732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.205761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.205895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.206046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.206095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.206234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.206339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.206364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.206502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.206612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.206650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.206794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.206937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.206966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.207108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.207266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.207291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.207429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.207514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.207538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.207624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.207714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.207739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.207844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.207978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.208004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.208118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.208224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.208249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.208364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.208472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.208496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.208607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.208739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.208764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.208876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.208964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.208990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.209084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.209171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.209197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.209342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.209488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.209514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.209606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.209759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.209784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.209869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.209949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.209974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.210063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.210148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.210172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.210281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.210397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.210423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.210502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.210649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.210676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.910 qpair failed and we were unable to recover it. 00:30:39.910 [2024-11-16 17:06:25.210759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.910 [2024-11-16 17:06:25.210866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.210891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.210976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.211056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.211082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.211195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.211300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.211324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.211469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.211562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.211587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.211721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.211863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.211889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.211992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.212104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.212129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.212270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.212384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.212411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.212493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.212579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.212604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.212730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.212836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.212860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.213007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.213083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.213109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.213238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.213317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.213342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.213454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.213540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.213565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.213668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.213784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.213809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.213896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.214041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.214067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.214213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.214354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.214378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.214490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.214603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.214635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.214716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.214874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.214900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.215000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.215105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.215129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.215216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.215324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.215349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.215440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.215551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.215576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.215733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.215845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.215869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.215975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.216086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.216112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.216219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.216341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.216366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.216450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.216531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.216557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.216678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.216759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.216785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.216900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.216983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.217008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.217123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.217215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.217239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.217355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.217499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.217523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.911 [2024-11-16 17:06:25.217641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.217724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.911 [2024-11-16 17:06:25.217749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.911 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.217832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.217921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.217946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.218024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.218133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.218158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.218243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.218345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.218370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.218479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.218626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.218653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.218772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.218919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.218944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.219097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.219215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.219240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.219349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.219456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.219481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.219590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.219714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.219739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.219831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.219943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.219967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.220070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.220182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.220207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.220349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.220428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.220454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.220543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.220639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.220668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.220772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.220884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.220910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.221045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.221183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.221209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.221290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.221374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.221401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.221550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.221672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.221699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.221812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.221985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.222028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.222119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.222203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.222229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.222342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.222478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.222504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.222628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.222730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.222759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.222893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.222984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.223009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.223125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.223236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.223261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.223370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.223493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.223519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.223635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.223719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.223746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.223888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.224024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.224050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.224143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.224229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.224256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.224398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.224516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.224542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.224670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.224819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.224846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.912 qpair failed and we were unable to recover it. 00:30:39.912 [2024-11-16 17:06:25.224980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.912 [2024-11-16 17:06:25.225067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.225093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.225177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.225296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.225322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.225408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.225515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.225541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.225654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.225769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.225794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.225886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.225966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.225991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.226082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.226197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.226222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.226331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.226480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.226505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.226623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.226739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.226765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.226884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.226990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.227015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.227162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.227271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.227297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.227438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.227520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.227546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.227670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.227775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.227801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.227885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.227968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.227995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.228104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.228225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.228249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.228370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.228477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.228502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.228586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.228714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.228740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.228823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.228949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.228974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.229117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.229210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.229239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.229334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.229451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.229476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.229558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.229705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.229732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.229838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.229928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.229953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.230044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.230151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.230176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.230326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.230403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.230429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.230538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.230681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.230707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.230813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.230931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.230957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.231048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.231154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.913 [2024-11-16 17:06:25.231180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.913 qpair failed and we were unable to recover it. 00:30:39.913 [2024-11-16 17:06:25.231297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.231414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.231439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.231543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.231686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.231716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.231856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.231985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.232011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.232163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.232310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.232335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.232422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.232508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.232533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.232637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.232772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.232815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.232903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.233017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.233042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.233183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.233266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.233291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.233404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.233493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.233519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.233604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.233710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.233735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.233977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.234101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.234128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.234217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.234327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.234357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.234472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.234613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.234647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.234729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.234840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.234865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.234957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.235083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.235109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.235254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.235345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.235370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.235471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.235562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.235589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.235718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.235825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.235851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.235977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.236059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.236084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.236173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.236282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.236308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.236448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.236529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.236556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.236665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.236778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.236813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.236907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.237017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.237041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.237155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.237272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.237296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.237383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.237471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.237496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.237611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.237753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.237778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.237895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.238014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.238039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.238181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.238260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.238286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.914 qpair failed and we were unable to recover it. 00:30:39.914 [2024-11-16 17:06:25.238395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.238504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.914 [2024-11-16 17:06:25.238528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.238623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.238761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.238786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.238903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.238995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.239019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.239103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.239240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.239266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.239361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.239445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.239470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.239549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.239689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.239715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.239805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.239897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.239932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.240016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.240099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.240125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.240236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.240325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.240351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.240459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.240565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.240589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.240689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.240770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.240796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.240931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.241046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.241071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.241153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.241234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.241259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.241368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.241473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.241498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.241631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.241714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.241740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.241825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.241949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.241975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.242088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.242202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.242228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.242338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.242418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.242444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.242585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.242670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.242695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.242828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.242953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.242980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.243118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.243254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.243279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.243395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.243500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.243526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.243612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.243752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.243795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.243882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.243992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.244016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.244104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.244214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.244239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.244321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.244427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.244451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.244569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.244688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.244716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.244832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.244975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.245000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.245123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.245240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.915 [2024-11-16 17:06:25.245265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.915 qpair failed and we were unable to recover it. 00:30:39.915 [2024-11-16 17:06:25.245351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.245460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.245487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.245604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.245763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.245789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.245873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.245983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.246008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.246120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.246225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.246249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.246370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.246476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.246500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.246629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.246750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.246775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.246883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.246967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.246995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.247085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.247198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.247223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.247370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.247481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.247505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.247629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.247728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.247755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.247882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.247977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.248002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.248116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.248196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.248220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.248358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.248493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.248517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.248633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.248746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.248771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.248886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.249025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.249050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.249168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.249280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.249305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.249415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.249527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.249552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.249678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.249764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.249790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.249880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.249983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.250007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.250124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.250231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.250257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.250373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.250488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.250513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.250596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.250711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.250736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.250813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.250894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.250928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.251018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.251156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.251181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.251294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.251373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.251399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.251518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.251603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.251661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.251745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.251881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.251905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.252027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.252137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.252161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.916 qpair failed and we were unable to recover it. 00:30:39.916 [2024-11-16 17:06:25.252273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.252366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.916 [2024-11-16 17:06:25.252392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.252531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.252614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.252646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.252724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.252862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.252887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.252972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.253091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.253116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.253228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.253340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.253367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.253477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.253592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.253627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.253714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.253792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.253816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.253931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.254008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.254033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.254118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.254253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.254278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.254413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.254496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.254520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.254610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.254735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.254761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.254853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.254935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.254959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.255077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.255162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.255186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.255292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.255405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.255430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.255538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.255660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.255687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.255778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.255864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.255890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.256000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.256107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.256133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.256266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.256395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.256423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.256541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.256695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.256723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.256840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.256991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.257018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.257138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.257287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.257315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.257435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.257584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.257612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.257727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.257866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.257895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.258016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.258166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.258193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.258278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.258377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.258404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.258507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.258621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.258646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.258755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.258892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.258916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.259024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.259163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.259205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.259340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.259447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.917 [2024-11-16 17:06:25.259487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.917 qpair failed and we were unable to recover it. 00:30:39.917 [2024-11-16 17:06:25.259595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.259718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.259744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.259859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.259995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.260022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.260115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.260231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.260259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.260360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.260481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.260506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.260655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.260739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.260763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.260856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.260947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.260973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.261125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.261210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.261238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.261356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.261476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.261506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.261599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.261716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.261743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.261826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.261919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.261943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.262059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.262144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.262168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.262277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.262387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.262413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.262524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.262601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.262635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.262744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.262857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.262882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.262990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.263104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.263129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.263300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.263423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.263450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.263576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.263681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.263706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.263818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.263900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.263944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.264032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.264155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.264183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.264308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.264401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.264428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.264553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.264649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.264675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.264768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.264877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.264901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.265010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.265157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.265185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.265312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.265443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.265470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.265571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.265659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.265685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.918 qpair failed and we were unable to recover it. 00:30:39.918 [2024-11-16 17:06:25.265768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.918 [2024-11-16 17:06:25.265903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.265927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.266031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.266121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.266148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.266298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.266446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.266473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.266559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.266702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.266728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.266823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.266932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.266957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.267056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.267149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.267175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.267290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.267409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.267437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.267561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.267700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.267725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.267806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.267952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.267977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.268140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.268230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.268259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.268348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.268473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.268501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.268640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.268751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.268776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.268893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.268975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.269000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.269081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.269173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.269203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.269308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.269455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.269483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.269574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.269685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.269710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.269849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.269992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.270020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.270143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.270241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.270268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.270354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.270474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.270515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.270588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.270705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.270730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.270810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.270926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.270950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.271031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.271139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.271164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.271252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.271388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.271415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.271583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.271676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.271708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.271826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.271915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.271940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.272055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.272165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.272189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.272295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.272412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.272440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.272590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.272721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.272747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.272858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.272941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.272966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.273071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.273231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.273258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.919 qpair failed and we were unable to recover it. 00:30:39.919 [2024-11-16 17:06:25.273386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.919 [2024-11-16 17:06:25.273500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.273527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.273665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.273778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.273802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.273889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.273995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.274019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.274101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.274174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.274222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.274321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.274443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.274484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.274681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.274791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.274815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.274902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.274978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.275020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.275114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.275214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.275242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.275363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.275447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.275475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.275591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.275741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.275767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.275849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.275977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.276020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.276108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.276248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.276272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.276356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.276492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.276521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.276612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.276745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.276775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.276870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.276948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.276972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.277085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.277175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.277200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.277295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.277403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.277428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.277508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.277623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.277648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.277760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.277840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.277864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.277974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.278088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.278115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.278227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.278366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.278390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.278478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.278587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.278611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.278709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.278799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.278822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.278943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.279015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.279039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.279159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.279236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.279261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.279364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.279487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.279515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.279688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.279836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.279862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.279953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.280054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.280079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.280175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.280261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.280287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.280407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.280517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.280542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.920 qpair failed and we were unable to recover it. 00:30:39.920 [2024-11-16 17:06:25.280629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.280713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.920 [2024-11-16 17:06:25.280739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.280823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.280904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.280929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.281011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.281123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.281148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.281232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.281364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.281392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.281496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.281630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.281673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.281757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.281870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.281894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.281982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.282146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.282174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.282305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.282394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.282420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.282525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.282645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.282672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.282781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.282899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.282927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.283025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.283158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.283183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.283301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.283410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.283436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.283547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.283632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.283659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.283743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.283849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.283874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.284033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.284123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.284148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.284226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.284315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.284340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.284452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.284563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.284588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.284708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.284795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.284820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.284916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.284990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.285015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.285108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.285191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.285217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.285354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.285470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.285495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.285581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.285677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.285703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.285818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.285934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.285976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.286103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.286181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.286206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.286292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.286370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.286395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.286477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.286601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.286634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.286718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.286797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.286823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.286993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.287093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.287118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.287199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.287294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.287318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.287402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.287483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.287507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.287628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.287716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.287742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.921 [2024-11-16 17:06:25.287820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.287900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.921 [2024-11-16 17:06:25.287925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.921 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.288007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.288083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.288109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.288201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.288305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.288330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.288444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.288528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.288558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.288685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.288803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.288828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.288919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.289000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.289026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.289122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.289257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.289282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.289360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.289441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.289465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.289559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.289643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.289668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.289781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.289861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.289887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.290012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.290093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.290118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.290224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.290332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.290357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.290435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.290514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.290539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.290637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.290751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.290776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.290893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.290976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.291000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.291075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.291214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.291256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.291393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.291526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.291550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.291643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.291731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.291756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.291859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.291948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.291973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.292093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.292165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.292190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.292303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.292381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.292405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.292505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.292645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.292671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.292807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.292896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.292926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.293011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.293114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.293143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.293268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.293393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.293421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.293529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.293647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.293698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.293791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.293874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.293899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.293988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.294101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.294126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.294213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.294322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.294348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.294459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.294571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.294596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.294703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.294795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.922 [2024-11-16 17:06:25.294820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.922 qpair failed and we were unable to recover it. 00:30:39.922 [2024-11-16 17:06:25.294931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.295045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.295069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.295152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.295233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.295259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.295384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.295474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.295498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.295605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.295698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.295723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.295829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.295916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.295941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.296030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.296122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.296147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.296283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.296366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.296390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.296482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.296561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.296586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.296671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.296782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.296807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.296912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.297021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.297047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.297124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.297209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.297235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.297349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.297422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.297465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.297584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.297728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.297754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.297840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.297934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.297959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.298073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.298183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.298208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.298284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.298392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.298416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.298494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.298580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.298605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.298710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.298820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.298844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.298986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.299095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.299120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.299200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.299281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.299306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.299385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.299456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.299481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.299628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.299742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.299767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.299917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.300034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.300061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.300185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.300278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.300325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.300442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.300518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.300543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.300627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.300750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.300775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.300862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.300951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.300976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.301086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.301165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.301190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.301295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.301404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.301429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.301533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.301602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.301632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.301752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.301830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.301857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.301971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.302119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.302147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.302239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.302352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.302376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.923 qpair failed and we were unable to recover it. 00:30:39.923 [2024-11-16 17:06:25.302485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.923 [2024-11-16 17:06:25.302594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.302624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.302741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.302831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.302856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.302941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.303089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.303114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.303223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.303298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.303323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.303411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.303491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.303516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.303600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.303746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.303771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.303885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.303998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.304023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.304106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.304186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.304211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.304298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.304405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.304430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.304507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.304581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.304605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.304704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.304790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.304814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.304902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.305042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.305067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.305147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.305228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.305253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.305343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.305450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.305475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.305582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.305670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.305696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.305778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.305885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.305910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.306017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.306095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.306121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.306233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.306304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.306329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.306433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.306577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.306605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.306755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.306838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.306863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.306944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.307019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.307044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.307155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.307265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.307290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.307404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.307486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.307511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.307585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.307700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.307725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.307811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.307916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.307940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.308046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.308133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.308158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.308236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.308319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.308343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.308426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.308502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.308527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.308645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.308760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.308785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.308899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.309044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.309071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.309212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.309321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.309346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.309459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.309563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.309592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.309714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.309830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.309854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.309954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.310037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.924 [2024-11-16 17:06:25.310061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.924 qpair failed and we were unable to recover it. 00:30:39.924 [2024-11-16 17:06:25.310166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.310247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.310272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.310351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.310464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.310489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.310629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.310727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.310752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.310841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.310946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.310971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.311051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.311133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.311160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.311273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.311383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.311407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.311502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.311599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.311633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.311761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.311848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.311877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.311988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.312138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.312163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.312269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.312382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.312409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.312490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.312584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.312612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.312773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.312885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.312910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.313044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.313179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.313204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.313339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.313422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.313447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.313533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.313642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.313668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.313739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.313846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.313871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.313953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.314082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.314110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.314253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.314361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.314386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.314505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.314622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.314657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.314760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.314842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.314867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.314977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.315090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.315115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.315192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.315277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.315302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.315383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.315491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.315515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.315643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.315730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.315756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.315853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.315968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.315993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.316142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.316221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.316245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.316323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.316475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.316503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.316587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.316690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.316715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.316793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.316874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.316899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.317044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.317155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.317181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.317285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.317377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.317404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.317529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.317638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.317666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.317772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.317885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.317910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.925 qpair failed and we were unable to recover it. 00:30:39.925 [2024-11-16 17:06:25.318012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.318136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.925 [2024-11-16 17:06:25.318164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.318316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.318451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.318479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.318590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.318682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.318708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.318824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.318926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.318950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.319056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.319140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.319164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.319249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.319337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.319364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.319490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.319575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.319603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.319717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.319853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.319878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.319970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.320081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.320106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.320214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.320373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.320400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.320495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.320650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.320676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.320767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.320846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.320871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.320988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.321094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.321122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.321252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.321373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.321400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.321501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.321571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.321596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.321719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.321803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.321832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.321920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.322014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.322054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.322152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.322269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.322294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.322406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.322498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.322523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.322613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.322708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.322733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.322843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.322935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.322960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.323078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.323204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.323232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.323319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.323427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.323453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.323570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.323678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.323704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.323813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.323901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.323926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.324031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.324164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.324190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.324310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.324416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.324441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.324570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.324695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.324724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.324816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.324940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.324976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.325074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.325154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.325180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.926 qpair failed and we were unable to recover it. 00:30:39.926 [2024-11-16 17:06:25.325265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.926 [2024-11-16 17:06:25.325402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.325427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.325544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.325666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.325694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.325800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.325877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.325902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.326014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.326099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.326125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.326241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.326327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.326352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.326481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.326566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.326591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.326699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.326812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.326837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.326914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.327044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.327072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.327207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.327289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.327314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.327426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.327527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.327554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.327648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.327759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.327784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.327862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.327966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.327991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.328087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.328164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.328189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.328269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.328345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.328370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.328472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.328583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.328610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.328756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.328836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.328861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.328950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.329064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.329089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.329225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.329335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.329360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.329475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.329549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.329574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.329666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.329750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.329775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.329885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.329989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.330015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.330095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.330177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.330202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.330299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.330407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.330433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.330536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.330623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.330649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.330760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.330837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.330862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.927 qpair failed and we were unable to recover it. 00:30:39.927 [2024-11-16 17:06:25.330941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.331023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.927 [2024-11-16 17:06:25.331050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.331156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.331264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.331290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.331409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.331520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.331545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.331681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.331768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.331795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.331899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.331981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.332007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.332120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.332241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.332266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.332348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.332460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.332486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.332627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.332722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.332748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.332863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.332950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.332975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.333063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.333175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.333215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.333342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.333418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.333442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.333527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.333680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.333710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.333791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.333904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.333935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.334012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.334102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.334127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.334220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.334329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.334354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.334439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.334547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.334572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.334660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.334768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.334794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.334906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.335030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.335059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.335194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.335334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.335358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.335470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.335610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.335642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.335731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.335811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.335835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.335941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.336021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.336046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.336135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.336244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.336269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.336354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.336438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.336463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.336548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.336658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.336685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.336797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.336878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.336903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.336983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.337086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.337114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.337252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.337362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.337387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.337521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.337640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.337684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.928 qpair failed and we were unable to recover it. 00:30:39.928 [2024-11-16 17:06:25.337772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.928 [2024-11-16 17:06:25.337857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.337881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.337957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.338064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.338089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.338174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.338247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.338271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.338400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.338493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.338518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.338628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.338708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.338732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.338816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.338897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.338922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.339036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.339120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.339145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.339230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.339337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.339361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.339483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.339597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.339628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.339708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.339815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.339840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.339934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.340021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.340046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.340130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.340243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.340268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.340372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.340458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.340482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.340563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.340652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.340677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.340768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.340878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.340903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.341006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.341088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.341113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.341197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.341303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.341328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.341419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.341546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.341574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.341683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.341816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.341841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.341923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.342001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.342026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.342133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.342209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.342234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.342311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.342424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.342451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.342543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.342641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.342684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.342794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.342868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.342897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.343032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.343139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.343164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.343271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.343378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.343406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.343545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.343661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.343687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.343776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.343897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.343922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.344029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.344158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.929 [2024-11-16 17:06:25.344186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.929 qpair failed and we were unable to recover it. 00:30:39.929 [2024-11-16 17:06:25.344288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.344367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.344392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.344470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.344558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.344583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.344699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.344776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.344801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.344898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.345006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.345030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.345125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.345209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.345235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.345319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.345411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.345436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.345522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.345610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.345641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.345755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.345862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.345887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.346026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.346138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.346163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.346267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.346378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.346403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.346524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.346628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.346653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.346751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.346889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.346913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.347048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.347153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.347178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.347275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.347366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.347395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.347512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.347672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.347698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.347813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.347896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.347921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.348047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.348169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.348197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.348293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.348403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.348429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.348535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.348680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.348705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.348810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.348907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.348935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.349032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.349115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.349142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.349241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.349348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.349372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.349489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.349602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.349655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.349748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.349847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.349875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.350003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.350113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.350137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.350236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.350316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.350342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.350422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.350535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.350560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.350651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.350734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.350761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.930 [2024-11-16 17:06:25.350907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.350990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.930 [2024-11-16 17:06:25.351015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.930 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.351111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.351199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.351224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.351312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.351391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.351416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.351522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.351640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.351666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.351778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.351855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.351879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.351961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.352034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.352058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.352187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.352294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.352319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.352430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.352572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.352597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.352704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.352780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.352804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.352914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.352994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.353019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.353106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.353199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.353225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.353303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.353383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.353408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.353489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.353570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.353595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.353714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.353798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.353822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.353932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.354043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.354069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.354174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.354267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.354294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.354381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.354462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.354487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.354568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.354727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.354756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.354866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.354945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.354970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.355049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.355154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.355179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.355315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.355387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.355413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.355496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.355576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.355601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.355718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.355807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.355831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.355914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.356004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.356029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.356113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.356219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.356244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.931 qpair failed and we were unable to recover it. 00:30:39.931 [2024-11-16 17:06:25.356351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.931 [2024-11-16 17:06:25.356432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.356458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.356548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.356656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.356683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.356805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.356893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.356918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.357018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.357128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.357154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.357269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.357339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.357364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.357479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.357562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.357587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.357731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.357825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.357850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.357938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.358050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.358076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.358161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.358246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.358271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.358356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.358464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.358488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.358572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.358650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.358675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.358786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.358870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.358895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.359006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.359084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.359110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.359197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.359307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.359333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.359442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.359523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.359548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.359630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.359720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.359746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.359824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.359913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.359938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.360016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.360093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.360118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.360228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.360334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.360359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.360439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.360549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.360574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.360672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.360756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.360780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.360863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.360979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.361004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.361089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.361196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.361221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.361347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.361503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.361529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.361641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.361750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.361775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.361885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.361971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.361996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.362071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.362183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.362208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.362356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.362445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.362472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.362642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.362744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.362769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.932 qpair failed and we were unable to recover it. 00:30:39.932 [2024-11-16 17:06:25.362877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.932 [2024-11-16 17:06:25.362954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.362980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.363075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.363192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.363217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.363326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.363431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.363456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.363569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.363683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.363709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.363792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.363887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.363912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.363994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.364097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.364122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.364244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.364397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.364422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.364535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.364646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.364672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.364757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.364848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.364873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.364960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.365096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.365124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.365247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.365338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.365365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.365478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.365589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.365625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.365750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.365833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.365858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.365938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.366017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.366042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.366127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.366206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.366235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.366323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.366431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.366472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.366568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.366663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.366692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.366790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.366896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.366921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.367007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.367111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.367139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.367256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.367386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.367414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.367514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.367590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.367623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.367741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.367813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.367838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.367952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.368029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.368054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.368140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.368252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.368277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.368361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.368445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.368469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.368580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.368675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.368700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.368811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.368891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.368915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.369027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.369108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.369143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.369231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.369367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.933 [2024-11-16 17:06:25.369392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.933 qpair failed and we were unable to recover it. 00:30:39.933 [2024-11-16 17:06:25.369513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.369628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.369654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.369738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.369831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.369857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.369970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.370057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.370101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.370210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.370294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.370319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.370457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.370536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.370560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.370646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.370782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.370806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.370919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.370999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.371024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.371162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.371250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.371276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.371362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.371491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.371519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.371631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.371715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.371740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.371822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.371906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.371931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.372042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.372130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.372156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.372236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.372349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.372374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.372477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.372564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.372588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.372704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.372778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.372803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.372913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.373016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.373040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.373120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.373200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.373225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.373330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.373437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.373462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.373551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.373648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.373692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.373772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.373885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.373909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.374018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.374122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.374147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.374233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.374315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.374340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.374453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.374526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.374551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.374636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.374740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.374765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.374845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.374922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.374947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.375025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.375129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.375154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.375234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.375372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.375401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.375491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.375626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.375652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.934 [2024-11-16 17:06:25.375763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.375885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.934 [2024-11-16 17:06:25.375910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.934 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.375999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.376110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.376136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.376243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.376325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.376351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.376425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.376533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.376558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.376666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.376776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.376801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.376890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.376965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.376990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.377099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.377239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.377263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.377368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.377442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.377467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.377551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.377690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.377716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.377835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.377920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.377949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.378076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.378182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.378207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.378318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.378417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.378445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.378562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.378663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.378690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.378785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.378894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.378936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.379050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.379139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.379163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.379270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.379351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.379376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.379469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.379576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.379601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.379684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.379763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.379787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.379900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.380009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.380034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.380119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.380194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.380219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.380296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.380371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.380396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.380482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.380593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.380623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.380722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.380834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.380859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.380973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.381089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.381114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.381202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.381311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.381336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.381419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.381527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.381551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.935 qpair failed and we were unable to recover it. 00:30:39.935 [2024-11-16 17:06:25.381638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.381748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.935 [2024-11-16 17:06:25.381774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.381858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.381934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.381958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.382040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.382180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.382206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.382361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.382469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.382497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.382581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.382676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.382702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.382790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.382935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.382960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.383072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.383157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.383182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.383297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.383420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.383446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.383535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.383674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.383701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.383851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.383946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.383971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.384063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.384197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.384223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.384331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.384421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.384446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.384535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.384645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.384671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.384757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.384874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.384900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.384978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.385089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.385113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.385210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.385364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.385392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.385526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.385610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.385662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.385780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.385897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.385922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.386054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.386176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.386203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.386325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.386417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.386444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.386533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.386637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.386680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.386792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.386872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.386898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.387050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.387140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.387167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.387266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.387387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.387420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.387521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.387628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.387654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.387767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.387851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.387876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.387970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.388085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.388110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.388203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.388317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.388344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.388454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.388602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.388635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.936 qpair failed and we were unable to recover it. 00:30:39.936 [2024-11-16 17:06:25.388766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.936 [2024-11-16 17:06:25.388847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.388872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.388957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.389120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.389148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.389242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.389357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.389385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.389506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.389599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.389641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.389736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.389845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.389875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.390002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.390094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.390122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.390220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.390366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.390393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.390499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.390610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.390643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.390733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.390809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.390834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.390918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.391003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.391028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.391142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.391232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.391259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.391374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.391491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.391519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.391663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.391776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.391802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.391918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.391995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.392020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.392110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.392190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.392214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.392333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.392412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.392439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.392601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.392714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.392740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.392856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.392968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.392992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.393132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.393213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.393256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.393346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.393431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.393458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.393607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.393703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.393728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.393838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.393929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.393957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.394045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.394201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.394227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.394309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.394393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.394421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.394543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.394636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.394678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.394786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.394905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.394936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.395095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.395239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.395268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.395394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.395503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.395529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.937 [2024-11-16 17:06:25.395643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.395729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.937 [2024-11-16 17:06:25.395755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.937 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.395846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.396011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.396035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.396117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.396225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.396251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.396393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.396513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.396539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.396654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.396766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.396791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.396901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.396986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.397012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.397124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.397238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.397266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.397382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.397460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.397485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.397574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.397702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.397728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.397812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.397896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.397922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.398030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.398147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.398173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.398257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.398367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.398392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.398481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.398590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.398623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.398724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.398844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.398869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.398960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.399061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.399086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.399174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.399260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.399286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.399378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.399488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.399515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.399660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.399756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.399781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.399925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.400013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.400037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.400164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.400313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.400339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.400427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.400568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.400592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.400739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.400859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.400889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.401017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.401175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.401200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.401286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.401394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.401419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.401493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.401598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.401632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.401727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.401840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.401865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.401963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.402047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.402072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.402192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.402280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.402305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.402425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.402549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.402574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.938 qpair failed and we were unable to recover it. 00:30:39.938 [2024-11-16 17:06:25.402684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.938 [2024-11-16 17:06:25.402802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.402828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.402908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.402997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.403024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.403141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.403234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.403262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.403373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.403461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.403487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.403598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.403733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.403761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.403868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.404009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.404035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.404155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.404247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.404272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.404383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.404474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.404501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.404637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.404758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.404785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.404901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.404998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.405025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.405110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.405247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.405273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.405366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.405479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.405505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.405603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.405764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.405792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.405909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.405997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.406024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.406121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.406208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.406233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.406373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.406454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.406479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.406562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.406653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.406680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.406761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.406894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.406920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.407003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.407122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.407151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.407289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.407377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.407404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.407492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.407582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.407607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.407735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.407817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.407843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.407930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.408038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.408063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.408150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.408231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.408259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.408370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.408485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.408513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.408599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.408690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.408718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.408837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.408914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.408939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.409054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.409164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.409189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.939 [2024-11-16 17:06:25.409274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.409414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.939 [2024-11-16 17:06:25.409445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.939 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.409523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.409672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.409697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.409806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.409886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.409912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.410006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.410142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.410168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.410257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.410340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.410366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.410477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.410562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.410588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.410711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.410821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.410846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.410966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.411077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.411102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.411224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.411308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.411334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.411420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.411506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.411532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.411649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.411735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.411768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.411881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.411998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.412023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.412138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.412258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.412285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.412398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.412483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.412508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.412596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.412696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.412721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.412806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.412916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.412942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.413064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.413142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.413167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.413251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.413336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.413360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.413478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.413594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.413628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.413744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.413830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.413855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.413963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.414075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.414106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.414217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.414302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.414329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.414426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.414539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.414565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.414693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.414781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.414807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.414920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.415030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.415056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.415200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.415286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.415311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.940 qpair failed and we were unable to recover it. 00:30:39.940 [2024-11-16 17:06:25.415432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.940 [2024-11-16 17:06:25.415520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.415544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.415657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.415774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.415800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.415937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.416025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.416054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.416174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.416253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.416279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.416361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.416464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.416489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.416622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.416739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.416767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.416907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.416998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.417024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.417149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.417252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.417277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.417417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.417492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.417516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.417638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.417726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.417753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.417868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.418012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.418038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.418154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.418249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.418274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.418418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.418510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.418535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.418626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.418718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.418743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.418829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.418961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.418989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.419111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.419203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.419230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.419317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.419456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.419481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.419598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.419710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.419739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.419852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.419948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.419976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.420064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.420146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.420172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.420288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.420402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.420428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.420511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.420602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.420636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.420750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.420838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.420863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.420949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.421065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.421093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.421207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.421296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.421321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.421415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.421494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.421520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.421638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.421724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.421750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.941 [2024-11-16 17:06:25.421838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.421974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.941 [2024-11-16 17:06:25.421999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.941 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.422079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.422161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.422186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.422278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.422391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.422417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.422500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.422586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.422612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.422733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.422819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.422844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.422927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.423013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.423039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.423182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.423288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.423316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.423442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.423525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.423551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.423678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.423759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.423800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.423957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.424109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.424136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.424251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.424393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.424420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.424543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.424634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.424677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.424769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.424849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.424874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.424988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.425098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.425123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.425240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.425356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.425382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.425519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.425630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.425659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.425779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.425883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.425923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.426025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.426137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.426162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.426268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.426367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.426394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.426508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.426587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.426636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.426752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.426831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.426855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.426973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.427057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.427082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.427194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.427276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.427302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.427444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.427522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.427547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.427681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.427770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.427795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.427940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.428018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.428044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.428160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.428295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.428336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.428471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.428585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.428611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-16 17:06:25.428729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.428803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-16 17:06:25.428828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.428912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.428996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.429037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.429134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.429247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.429272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.429384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.429502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.429527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.429621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.429730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.429756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.429837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.429949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.429974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.430053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.430166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.430190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.430302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.430381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.430406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.430493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.430607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.430638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.430763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.430843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.430867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.430959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.431069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.431094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.431212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.431294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.431319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.431433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.431518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.431544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.431644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.431733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.431758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.431888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.432000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.432027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.432109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.432187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.432211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.432303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.432385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.432409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.432522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.432612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.432643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.432724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.432812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.432837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.432921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.433004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.433028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.433130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.433232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.433262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.433380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.433465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.433490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.433646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.433764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.433791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.433877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.433992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.434018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.434164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.434267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.434292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.434404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.434482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.434506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.434586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.434701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.434727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.434844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.434953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.434979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.435060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.435145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-16 17:06:25.435171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-16 17:06:25.435277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.435360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.435388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.435497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.435591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.435623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.435743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.435857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.435882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.435963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.436077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.436101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.436194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.436287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.436313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.436427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.436503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.436529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.436613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.436710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.436735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.436849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.436933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.436957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.437072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.437161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.437187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.437304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.437382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.437409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.437519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.437644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.437671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.437768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.437850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.437876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.437953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.438031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.438056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.438132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.438247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.438273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.438361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.438473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.438502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.438611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.438729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.438755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.438837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.438948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.438973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.439068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.439145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.439170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.439281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.439391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.439418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.439558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.439650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.439676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.439757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.439876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.439901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.439985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.440074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.440100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.440192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.440277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.440303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.440391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.440474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.440499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.440611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.440761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.440786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.440871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.440982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.441007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.441092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.441176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.441201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.441285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.441403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.441428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-16 17:06:25.441564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-16 17:06:25.441651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.441677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.441757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.441869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.441895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.442004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.442110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.442135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.442215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.442305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.442332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.442417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.442504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.442533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.442621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.442737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.442763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.442849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.442965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.442989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.443076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.443159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.443185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.443321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.443460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.443487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.443605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.443700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.443726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.443838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.443948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.443974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.444058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.444170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.444196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.444282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.444368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.444393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.444482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.444597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.444638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.444760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.444848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.444872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.444978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.445056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.445081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.445189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.445291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.445320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.445432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.445521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.445547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.445663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.445750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.445777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.445887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.445967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.445994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.446102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.446181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.446209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.446296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.446412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.446436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.446575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.446667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.446694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.446780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.446862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.446891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.446978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.447113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.447138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-16 17:06:25.447221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.447331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-16 17:06:25.447356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.447468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.447554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.447581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.447730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.447845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.447871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.447956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.448035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.448060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.448178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.448291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.448319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.448404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.448481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.448510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.448601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.448691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.448720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.448840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.448923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.448950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.449061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.449139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.449170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.449251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.449396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.449421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.449529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.449647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.449673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.449789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.449900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.449926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.450018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.450135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.450160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.450272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.450380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.450405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.450495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.450581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.450607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.450701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.450784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.450810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.450919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.451030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.451055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.451145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.451237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.451262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.451340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.451453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.451486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.451639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.451731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.451758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.451872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.451963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.451988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.452130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.452241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.452266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.452346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.452424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.452449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.452552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.452664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.452690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.452775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.452883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.452909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.452998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.453112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.453139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.453221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.453298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.453323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.453413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.453523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.453548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.453640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.453733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.453758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-16 17:06:25.453859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-16 17:06:25.453972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.453997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.454108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.454186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.454210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.454322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.454457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.454482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.454595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.454691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.454717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.454856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.454952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.454977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.455090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.455178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.455205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.455320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.455403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.455429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.455520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.455650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.455677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.455819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.455906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.455931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.456049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.456167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.456193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.456335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.456419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.456445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.456532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.456621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.456648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.456759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.456871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.456897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.457040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.457144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.457170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.457261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.457345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.457373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.457463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.457548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.457572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.457687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.457768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.457793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.457906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.457989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.458018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.458102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.458222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.458252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.458334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.458443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.458469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.458561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.458678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.458704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.458788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.458876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.458902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.458990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.459102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.459127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.459238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.459326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.459352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.459463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.459577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.459602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.459721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.459809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.459834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.459940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.460052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.460078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.460195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.460278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.460305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-16 17:06:25.460395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.460531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-16 17:06:25.460556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.460645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.460735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.460760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.460878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.460995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.461020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.461112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.461226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.461252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.461345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.461457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.461482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.461567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.461653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.461679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.461773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.461883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.461909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.462021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.462134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.462159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.462283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.462363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.462390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.462480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.462591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.462624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.462753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.462861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.462886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.463002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.463116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.463145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.463266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.463343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.463368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.463479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.463586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.463611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.463718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.463797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.463823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.463916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.464031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.464056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.464168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.464257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.464282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.464393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.464483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.464509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.464595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.464743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.464769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.464852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.464967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.464992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.465106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.465184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.465209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.465297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.465378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.465402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.465547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.465686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.465712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.465823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.465911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.465936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.466012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.466090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.466115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.466228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.466311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.466336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.466452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.466536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.466560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.466673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.466762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.466787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.466899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.467004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.467029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-16 17:06:25.467115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-16 17:06:25.467204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.467229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.467348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.467433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.467458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.467573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.467652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.467677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.467800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.467877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.467903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.467992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.468100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.468125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.468265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.468381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.468406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.468496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.468636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.468662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.468782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.468919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.468944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.469088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.469197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.469222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.469335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.469423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.469449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.469561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.469680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.469708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.469837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.469985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.470010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.470130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.470216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.470241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.470356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.470439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.470464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.470576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.470672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.470698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.470804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.470933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.470959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.471043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.471177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.471202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.471284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.471395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.471420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.471537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.471641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.471667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.471756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.471841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.471866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.472004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.472115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.472140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.472229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.472319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.472346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.472426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.472539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.472564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.472679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.472791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.472817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.472932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.473019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.473045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-16 17:06:25.473127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.473219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-16 17:06:25.473244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.473334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.473414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.473439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.473546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.473656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.473682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.473794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.473905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.473929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.474021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.474157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.474182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.474296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.474449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.474473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.474557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.474668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.474694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.474780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.474894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.474920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.475034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.475128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.475154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.475230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.475319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.475343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.475451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.475585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.475610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.475730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.475834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.475859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.475976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.476091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.476115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.476256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.476331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.476356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.476439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.476525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.476549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.476666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.476773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.476797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.476902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.477010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.477035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.477124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.477237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.477263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.477373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.477483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.477509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.477628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.477739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.477764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.477844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.477961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.477986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.478093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.478180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.478205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.478286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.478356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.478380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.478463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.478538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.478562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.478654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.478736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.478761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.478870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.478983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.479008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.479098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.479215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.479241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.479332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.479447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.479473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-16 17:06:25.479589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.479712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-16 17:06:25.479738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.479830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.479906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.479930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.480044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.480153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.480178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.480257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.480367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.480393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.480531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.480646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.480671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.480779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.480859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.480885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.480992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.481131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.481156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.481300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.481385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.481410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.481490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.481583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.481608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.481704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.481814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.481840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.481952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.482067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.482098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.482192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.482282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.482308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.482415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.482495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.482520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.482635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.482781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.482807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.482922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.483004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.483031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.483147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.483286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.483311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.483438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.483551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.483576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.483673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.483762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.483788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.483902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.483986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.484012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.484122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.484200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.484225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.484299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.484435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.484464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.484547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.484637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.484662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.484805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.484916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.484941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.485080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.485194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.485219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.485327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.485442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.485468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.485548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.485625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.485650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.485727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.485808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.485835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.485948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.486038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.486063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.486173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.486253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.486279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-16 17:06:25.486393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-16 17:06:25.486511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.486537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.486630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.486746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.486777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.486860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.486969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.486994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.487085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.487221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.487246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.487332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.487445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.487471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.487562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.487704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.487730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.487847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.487962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.487987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.488079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.488178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.488202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.488317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.488431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.488456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.488537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.488622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.488648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.488758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.488838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.488863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.488968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.489077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.489106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.489216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.489319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.489344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.489428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.489533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.489558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.489638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.489722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.489747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.489858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.489964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.489989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.490130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.490236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.490262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.490374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.490484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.490509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.490589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.490681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.490708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.490826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.490938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.490965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.491050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.491126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.491152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.491235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.491321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.491346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.491446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.491552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.491581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.491687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.491832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.491858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.491975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.492090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.492115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.492229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.492305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.492330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.492441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.492521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.492548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.492655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.492740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.492766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-16 17:06:25.492873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-16 17:06:25.492984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.493009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.493149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.493260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.493284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.493366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.493463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.493490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.493596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.493751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.493777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.493892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.493973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.494014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.494183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.494293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.494318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.494406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.494546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.494571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.494687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.494834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.494859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.494973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.495123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.495150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.495308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.495426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.495455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.495581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.495722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.495748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.495828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.495903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.495928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.496031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.496117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.496143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.496260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.496374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.496397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.496487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.496589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.496614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.496733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.496869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.496893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.497031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.497154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.497180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.497286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.497373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.497400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.497532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.497612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.497644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.497730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.497834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.497858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.497967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.498098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.498127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.498246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.498335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.498362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.498476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.498564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.498606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.498754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.498891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.498916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.499031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.499105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.499130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.499247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.499335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.499359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.499476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.499584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.499608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.499701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.499809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.499834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-16 17:06:25.499915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.499992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-16 17:06:25.500017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.500108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.500196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.500220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.500330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.500468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.500492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.500607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.500723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.500747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.500863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.500941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.500965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.501069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.501179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.501204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.501288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.501399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.501424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.501499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.501576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.501600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.501724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.501798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.501822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.501962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.502087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.502114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.502258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.502368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.502394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.502510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.502598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.502629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.502747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.502885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.502909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.503014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.503118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.503142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.503229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.503311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.503335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.503410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.503493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.503517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.503604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.503723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.503748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.503835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.503905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.503929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.504014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.504091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.504115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.504227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.504298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.504322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.504463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.504637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.504663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.504803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.504883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.504909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.504994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.505106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.505132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.505245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.505356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.505380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.505525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.505661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.505687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-16 17:06:25.505761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-16 17:06:25.505896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.505921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.506021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.506131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.506157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.506269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.506379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.506403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.506483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.506588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.506613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.506736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.506850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.506875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.507016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.507118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.507143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.507231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.507383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.507408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.507489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.507573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.507597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.507698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.507776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.507801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.507906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.507991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.508017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.508103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.508206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.508230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.508369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.508561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.508590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.508725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.508847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.508876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.508955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.509074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.509099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.509180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.509288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.509312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.509428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.509510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.509535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.509648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.509754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.509780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.509864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.509979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.510006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.510090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.510176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.510200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.510306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.510420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.510447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.510559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.510675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.510701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.510815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.510915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.510940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.511055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.511164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.511189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.511271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.511345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.511369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.511477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.511586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.511612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.511701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.511779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.511805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.511915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.512051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.512078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.512168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.512286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.512314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.512441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.512558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-16 17:06:25.512582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-16 17:06:25.512720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.512826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.512851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.512965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.513047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.513072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.513179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.513295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.513321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.513427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.513537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.513564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.513683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.513762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.513787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.513897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.514014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.514039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.514125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.514202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.514227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.514339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.514440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.514465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.514551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.514663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.514689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.514764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.514840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.514865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.515000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.515087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.515114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.515247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.515357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.515382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.515468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.515558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.515583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.515703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.515790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.515815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.515898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.516009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.516035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.516156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.516240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.516266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.516383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.516459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.516484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.516575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.516665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.516691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.516770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.516909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.516934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.517046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.517156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.517182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.517323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.517426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.517451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.517601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.517721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.517746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.517864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.517996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.518028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.518153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.518267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.518292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.518377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.518486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.518529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.518644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.518791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.518820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.518920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.519004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.519029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.519108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.519220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.519245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-16 17:06:25.519359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-16 17:06:25.519458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.519485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.519589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.519680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.519706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.519787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.519897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.519922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.520038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.520116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.520141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.520222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.520309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.520342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.520455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.520536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.520562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.520669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.520751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.520776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.520854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.520934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.520959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.521067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.521156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.521182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.521262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.521381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.521405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.521490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.521571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.521596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.521716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.521796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.521820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.521899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.522096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.522120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.522205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.522293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.522318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.522458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.522561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.522590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.522712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.522824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.522849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.522932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.523013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.523037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.523142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.523217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.523241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.523352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.523454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.523479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.523561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.523672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.523698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.523805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.523888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.523913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.524024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.524149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.524176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.524327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.524409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.524434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.524517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.524589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.524614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.524700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.524817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.524842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.524936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.525015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.525041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.525152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.525262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.525287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.525418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.525506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.525534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.525668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.525760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-16 17:06:25.525785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-16 17:06:25.525864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.525969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.525993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.526105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.526205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.526232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.526337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.526447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.526471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.526555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.526637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.526663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.526750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.526859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.526885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.526974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.527054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.527079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.527161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.527238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.527263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.527380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.527485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.527509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.527587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.527700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.527725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.527806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.527888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.527912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.527987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.528090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.528115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.528194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.528312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.528336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.528419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.528525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.528550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.528629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.528745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.528770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.528843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.528928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.528953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.529038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.529148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.529172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.529255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.529343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.529368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.529482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.529564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.529589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.529676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.529793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.529817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.529956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.530042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.530066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.530139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.530256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.530281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.530365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.530468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.530495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.530631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.530762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.530787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.530898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.530983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.531008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.531116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.531196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.531220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.531319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.531457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-16 17:06:25.531481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-16 17:06:25.531589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.531712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.531741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.531849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.531935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.531959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.532068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.532149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.532174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.532277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.532363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.532392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.532485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.532609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.532660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.532744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.532823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.532848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.532930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.533036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.533061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.533170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.533246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.533271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.533382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.533460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.533484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.533562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.533669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.533695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.533831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.533904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.533929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.534012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.534146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.534171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.534286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.534391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.534416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.534494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.534579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.534603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.534698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.534784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.534808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.534922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.535035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.535060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.535149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.535223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.535248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.535328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.535438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.535463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.535573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.535687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.535713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.535799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.535906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.535931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.536041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.536121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.536146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.536265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.536377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.536402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.536481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.536621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.536646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.536726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.536840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.536864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.536945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.537029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.537053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.537162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.537274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.537299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.537426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.537509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.537537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.537662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.537745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.537769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-16 17:06:25.537853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.537934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-16 17:06:25.537959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.538039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.538113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.538137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.538240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.538332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.538357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.538459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.538580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.538631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.538720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.538835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.538859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.538996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.539074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.539099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.539189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.539300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.539325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.539412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.539547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.539571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.539699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.539783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.539808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.539888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.539997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.540022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.540127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.540246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.540273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.540379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.540485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.540509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.540594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.540683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.540708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.540821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.540947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.540979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.541081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.541170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.541197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.541278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.541358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.541384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.541475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.541556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.541581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.541675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.541788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.541813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.541932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.542009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.542033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.542113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.542192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.542217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.542325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.542413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.542437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.542519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.542645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.542671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.542756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.542871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.542915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.543037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.543176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.543205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.543285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.543364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.543389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.543480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.543564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.543589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.543673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.543781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.543807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.543946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.544057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.544083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.544195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.544306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-16 17:06:25.544331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-16 17:06:25.544423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.544498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.544523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.544627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.544731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.544756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.544841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.544923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.544948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.545085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.545165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.545190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.545302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.545415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.545439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.545523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.545633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.545658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.545748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.545854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.545878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.545962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.546070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.546096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.546176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.546259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.546284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.546399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.546535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.546560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.546669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.546754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.546779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.546863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.546939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.546964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.547048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.547208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.547233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.547351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.547464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.547505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.547593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.547676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.547701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.547882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.547969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.547994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.548107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.548183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.548209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.548288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.548393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.548417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.548505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.548612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.548644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.548722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.548801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.548826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.548963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.549048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.549076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.549211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.549348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.549372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.549485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.549572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.549598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.549722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.549826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.549851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.549932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.550012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.550037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.550127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.550220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.550247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.550356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.550440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.550465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.550550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.550659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.550685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.550823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.550908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-16 17:06:25.550934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-16 17:06:25.551045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.551152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.551177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.551291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.551402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.551426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.551513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.551640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.551667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.551740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.551821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.551846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.551953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.552065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.552090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.552169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.552253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.552277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.552381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.552463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.552492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.552589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.552731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.552757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.552839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.552917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.552942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.553055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.553160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.553184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.553288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.553371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.553396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.553478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.553565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.553590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.553706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.553795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.553820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.553930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.554034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.554059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.554146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.554216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.554241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.554345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.554426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.554451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.554554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.554663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.554689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.554778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.554859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.554884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.554990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.555072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.555098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.555212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.555324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.555350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.555431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.555534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.555559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.555643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.555723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.555747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.555857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.555995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.556020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.556094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.556203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.556227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.556311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.556401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.556427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.556545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.556652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.556693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.556836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.556961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.556988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.557165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.557281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.557324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-16 17:06:25.557440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.557522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-16 17:06:25.557547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.557632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.557743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.557768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.557839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.557947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.557989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.558123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.558205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.558230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.558349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.558431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.558456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.558532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.558687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.558715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.558811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.558917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.558942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.559056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.559132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.559157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.559234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.559372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.559398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.559489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.559598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.559630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.559717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.559859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.559884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.560004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.560151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.560177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.560270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.560401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.560426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.560502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.560581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.560606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.560754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.560832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.560857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.560964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.561073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.561098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.561269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.561411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.561437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.561575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.561712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.561739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.561891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.561979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.562004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.562140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.562221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.562246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.562386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.562536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.562563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.562648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.562776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.562803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.562920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.563070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.563098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.563222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.563322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.563350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.563538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.563666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.563691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-16 17:06:25.563775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.563891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-16 17:06:25.563916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.564021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.564106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.564148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.564306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.564440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.564465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.564572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.564692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.564720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.564841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.564976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.565007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.565172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.565275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.565300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.565461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.565590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.565621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.565709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.565809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.565834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.565950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.566084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.566108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.566219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.566340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.566369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.566517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.566632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.566660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.566766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.566844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.566868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.566956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.567083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.567110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.567205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.567321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.567348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.567452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.567589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.567614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.567739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.567847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.567872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.567974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.568134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.568159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.568307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.568421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.568446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.568545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.568657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.568686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.568784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.568904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.568931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.569092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.569208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.569233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.569345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.569498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.569526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.569644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.569733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.569761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.569867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.570001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.570026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.570207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.570321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.570346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.570439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.570583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.570607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.570755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.570865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.570890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.570995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.571121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.571149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.571280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.571403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-16 17:06:25.571431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-16 17:06:25.571532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.571653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.571679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.571764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.571870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.571895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.572030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.572151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.572179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.572341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.572475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.572500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.572664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.572758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.572786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.572877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.573008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.573033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.573111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.573218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.573243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.573324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.573440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.573465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.573594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.573729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.573755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.573837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.573984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.574008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.574158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.574277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.574304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.574434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.574545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.574587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.574704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.574796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.574820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.574926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.575003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.575029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.575140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.575312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.575337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.575422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.575505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.575530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.575622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.575711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.575740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.575851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.575939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.575966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.576064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.576170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.576195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.576284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.576386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.576413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.576491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.576628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.576654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.576763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.576843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.576868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.576978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.577113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.577138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.577214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.577317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.577344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.577485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.577566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.577590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.577781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.577901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.577929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.578032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.578188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.578217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.578301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.578403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.578428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-16 17:06:25.578552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-16 17:06:25.578648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.578677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.578776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.578867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.578895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.579018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.579126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.579151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.579232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.579375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.579400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.579487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.579567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.579593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.579709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.579822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.579847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.579935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.580022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.580050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.580152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.580282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.580306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.580426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.580512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.580537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.580621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.580708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.580732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.580872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.580976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.581004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.581161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.581239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.581264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.581350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.581481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.581509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.581683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.581822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.581847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.581960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.582034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.582059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.582167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.582272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.582297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.582412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.582497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.582538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.582653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.582761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.582786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.582899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.582977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.583001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.583089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.583203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.583228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.583331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.583442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.583467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.583602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.583728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.583755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.583872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.583951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.583976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.584100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.584210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.584235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.584347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.584463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.584490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.584647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.584768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.584796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.584928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.585040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.585065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.585162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.585267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.585291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-16 17:06:25.585375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.585483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-16 17:06:25.585511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.585627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.585772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.585797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.585956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.586077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.586104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.586243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.586327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.586351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.586459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.586597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.586628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.586714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.586853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.586877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.586961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.587120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.587161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.587294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.587376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.587401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.587486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.587589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.587614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.587716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.587821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.587846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.587987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.588099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.588124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.588234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.588352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.588384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.588476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.588600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.588659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.588816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.588895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.588920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.589048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.589159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.589186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.589284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.589397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.589424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.589588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.589675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.589700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.589802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.589907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.589931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.590046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.590154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.590196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.590294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.590432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.590457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.590586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.590679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.590708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.590796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.590918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.590943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.591089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.591198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.591222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.591334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.591411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.591452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.591565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.591682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.591707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.591822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.591936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.591960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.592092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.592220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.592244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.592325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.592460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.592487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.592609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.592732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.592757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-16 17:06:25.592887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-16 17:06:25.592977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.593006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.593120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.593221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.593245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.593383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.593491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.593516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.593629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.593755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.593797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.593906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.594017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.594042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.594178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.594290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.594315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.594475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.594563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.594590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.594738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.594855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.594880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.594993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.595096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.595121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.595228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.595308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.595336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.595471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.595581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.595606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.595755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.595868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.595893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.595995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.596113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.596140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.596277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.596417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.596441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.596600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.596724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.596750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.596838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.596957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.596985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.597162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.597297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.597322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.597427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.597532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.597557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.597643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.597789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.597814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.597955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.598075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.598102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.598207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.598296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.598321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.598461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.598635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.598663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.598783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.598906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.598933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.599036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.599181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.599206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.599338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.599466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.599491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-16 17:06:25.599600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.599750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-16 17:06:25.599776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.599852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.599967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.599993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.600131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.600250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.600291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.600402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.600506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.600531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.600680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.600774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.600799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.600910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.600991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.601017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.601146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.601240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.601267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.601364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.601473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.601497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.601582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.601675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.601705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.601813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.601911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.601939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.602054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.602165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.602189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.602301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.602408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.602436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.602549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.602638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.602667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.602802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.602914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.602939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.603053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.603132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.603158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.603265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.603343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.603367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.603482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.603577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.603602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.603687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.603801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.603827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.603934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.604063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.604090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.604224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.604324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-16 17:06:25.604349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-16 17:06:25.604480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.604662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.604690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.268 qpair failed and we were unable to recover it. 00:30:40.268 [2024-11-16 17:06:25.604830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.604956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.604984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.268 qpair failed and we were unable to recover it. 00:30:40.268 [2024-11-16 17:06:25.605159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.605264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.605289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.268 qpair failed and we were unable to recover it. 00:30:40.268 [2024-11-16 17:06:25.605376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.605468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.605496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.268 qpair failed and we were unable to recover it. 00:30:40.268 [2024-11-16 17:06:25.605599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.605747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.605773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.268 qpair failed and we were unable to recover it. 00:30:40.268 [2024-11-16 17:06:25.605884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.605989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.606013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.268 qpair failed and we were unable to recover it. 00:30:40.268 [2024-11-16 17:06:25.606145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.606237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.606265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.268 qpair failed and we were unable to recover it. 00:30:40.268 [2024-11-16 17:06:25.606378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.606489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.606516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.268 qpair failed and we were unable to recover it. 00:30:40.268 [2024-11-16 17:06:25.606657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.606767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.606792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.268 qpair failed and we were unable to recover it. 00:30:40.268 [2024-11-16 17:06:25.606929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.607031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.607059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.268 qpair failed and we were unable to recover it. 00:30:40.268 [2024-11-16 17:06:25.607190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.607301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.607326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.268 qpair failed and we were unable to recover it. 00:30:40.268 [2024-11-16 17:06:25.607409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.607496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.607521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.268 qpair failed and we were unable to recover it. 00:30:40.268 [2024-11-16 17:06:25.607661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.607766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.607791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.268 qpair failed and we were unable to recover it. 00:30:40.268 [2024-11-16 17:06:25.607881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.608005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.608032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.268 qpair failed and we were unable to recover it. 00:30:40.268 [2024-11-16 17:06:25.608132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.268 [2024-11-16 17:06:25.608245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.608270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.608397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.608479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.608506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.608648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.608728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.608756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.608858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.608995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.609019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.609146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.609271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.609296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.609404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.609523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.609547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.609631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.609765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.609789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.609908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.610027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.610056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.610136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.610226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.610254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.610352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.610440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.610465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.610576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.610718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.610747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.610831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.610956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.610981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.611086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.611167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.611192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.611277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.611358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.611382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.611497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.611593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.611631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.611729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.611805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.611833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.611971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.612049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.612092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.612184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.612301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.612329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.612427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.612531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.612559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.612693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.612773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.612799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.612909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.613003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.613031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.613136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.613218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.613243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.613320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.613428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.613453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.613593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.613721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.613745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.613862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.613937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.613963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.614045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.614151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.614180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.614272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.614387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.614412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.269 qpair failed and we were unable to recover it. 00:30:40.269 [2024-11-16 17:06:25.614549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.269 [2024-11-16 17:06:25.614633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.270 [2024-11-16 17:06:25.614659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.270 qpair failed and we were unable to recover it. 00:30:40.270 [2024-11-16 17:06:25.614740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.270 [2024-11-16 17:06:25.614827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.270 [2024-11-16 17:06:25.614852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.270 qpair failed and we were unable to recover it. 00:30:40.270 [2024-11-16 17:06:25.614928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.270 [2024-11-16 17:06:25.615005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.270 [2024-11-16 17:06:25.615031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.270 qpair failed and we were unable to recover it. 00:30:40.270 [2024-11-16 17:06:25.615140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.270 [2024-11-16 17:06:25.615213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.270 [2024-11-16 17:06:25.615238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.270 qpair failed and we were unable to recover it. 00:30:40.270 [2024-11-16 17:06:25.615348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.270 [2024-11-16 17:06:25.615481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.270 [2024-11-16 17:06:25.615508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.270 qpair failed and we were unable to recover it. 00:30:40.270 [2024-11-16 17:06:25.615659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.270 [2024-11-16 17:06:25.615749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.270 [2024-11-16 17:06:25.615792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.271 qpair failed and we were unable to recover it. 00:30:40.271 [2024-11-16 17:06:25.615903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.271 [2024-11-16 17:06:25.615989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.271 [2024-11-16 17:06:25.616016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.271 qpair failed and we were unable to recover it. 00:30:40.271 [2024-11-16 17:06:25.616109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.271 [2024-11-16 17:06:25.616218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.271 [2024-11-16 17:06:25.616243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.271 qpair failed and we were unable to recover it. 00:30:40.271 [2024-11-16 17:06:25.616366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.271 [2024-11-16 17:06:25.616486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.271 [2024-11-16 17:06:25.616513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.271 qpair failed and we were unable to recover it. 00:30:40.271 [2024-11-16 17:06:25.616630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.271 [2024-11-16 17:06:25.616711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.271 [2024-11-16 17:06:25.616736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.271 qpair failed and we were unable to recover it. 00:30:40.271 [2024-11-16 17:06:25.616846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.272 [2024-11-16 17:06:25.616985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.272 [2024-11-16 17:06:25.617012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.272 qpair failed and we were unable to recover it. 00:30:40.272 [2024-11-16 17:06:25.617157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.272 [2024-11-16 17:06:25.617272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.272 [2024-11-16 17:06:25.617297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.272 qpair failed and we were unable to recover it. 00:30:40.272 [2024-11-16 17:06:25.617404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.272 [2024-11-16 17:06:25.617484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.272 [2024-11-16 17:06:25.617509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.272 qpair failed and we were unable to recover it. 00:30:40.272 [2024-11-16 17:06:25.617659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.272 [2024-11-16 17:06:25.617761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.272 [2024-11-16 17:06:25.617786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.272 qpair failed and we were unable to recover it. 00:30:40.272 [2024-11-16 17:06:25.617872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.272 [2024-11-16 17:06:25.617973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.272 [2024-11-16 17:06:25.617998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.272 qpair failed and we were unable to recover it. 00:30:40.272 [2024-11-16 17:06:25.618080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.272 [2024-11-16 17:06:25.618160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.272 [2024-11-16 17:06:25.618184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.272 qpair failed and we were unable to recover it. 00:30:40.272 [2024-11-16 17:06:25.618264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.272 [2024-11-16 17:06:25.618423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.273 [2024-11-16 17:06:25.618451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.273 qpair failed and we were unable to recover it. 00:30:40.273 [2024-11-16 17:06:25.618610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.273 [2024-11-16 17:06:25.618695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.273 [2024-11-16 17:06:25.618719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.273 qpair failed and we were unable to recover it. 00:30:40.273 [2024-11-16 17:06:25.618826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.273 [2024-11-16 17:06:25.618898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.273 [2024-11-16 17:06:25.618923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.273 qpair failed and we were unable to recover it. 00:30:40.273 [2024-11-16 17:06:25.619065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.273 [2024-11-16 17:06:25.619144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.273 [2024-11-16 17:06:25.619170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.273 qpair failed and we were unable to recover it. 00:30:40.273 [2024-11-16 17:06:25.619277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.273 [2024-11-16 17:06:25.619387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.273 [2024-11-16 17:06:25.619412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.273 qpair failed and we were unable to recover it. 00:30:40.273 [2024-11-16 17:06:25.619532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.273 [2024-11-16 17:06:25.619689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.273 [2024-11-16 17:06:25.619714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.273 qpair failed and we were unable to recover it. 00:30:40.273 [2024-11-16 17:06:25.619805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.619885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.619910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.274 qpair failed and we were unable to recover it. 00:30:40.274 [2024-11-16 17:06:25.620018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.620113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.620141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.274 qpair failed and we were unable to recover it. 00:30:40.274 [2024-11-16 17:06:25.620304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.620414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.620439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.274 qpair failed and we were unable to recover it. 00:30:40.274 [2024-11-16 17:06:25.620538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.620675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.620702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.274 qpair failed and we were unable to recover it. 00:30:40.274 [2024-11-16 17:06:25.620811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.620900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.620943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.274 qpair failed and we were unable to recover it. 00:30:40.274 [2024-11-16 17:06:25.621037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.621125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.621149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.274 qpair failed and we were unable to recover it. 00:30:40.274 [2024-11-16 17:06:25.621258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.621363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.621403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.274 qpair failed and we were unable to recover it. 00:30:40.274 [2024-11-16 17:06:25.621522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.621668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.274 [2024-11-16 17:06:25.621694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.274 qpair failed and we were unable to recover it. 00:30:40.274 [2024-11-16 17:06:25.621806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.621925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.621950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.275 qpair failed and we were unable to recover it. 00:30:40.275 [2024-11-16 17:06:25.622083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.622201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.622242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.275 qpair failed and we were unable to recover it. 00:30:40.275 [2024-11-16 17:06:25.622322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.622423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.622448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.275 qpair failed and we were unable to recover it. 00:30:40.275 [2024-11-16 17:06:25.622652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.622756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.622781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.275 qpair failed and we were unable to recover it. 00:30:40.275 [2024-11-16 17:06:25.622885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.622981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.623008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.275 qpair failed and we were unable to recover it. 00:30:40.275 [2024-11-16 17:06:25.623107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.623229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.623257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.275 qpair failed and we were unable to recover it. 00:30:40.275 [2024-11-16 17:06:25.623387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.623480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.623505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.275 qpair failed and we were unable to recover it. 00:30:40.275 [2024-11-16 17:06:25.623591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.623721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.623747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.275 qpair failed and we were unable to recover it. 00:30:40.275 [2024-11-16 17:06:25.623864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.623998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.275 [2024-11-16 17:06:25.624025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.276 qpair failed and we were unable to recover it. 00:30:40.276 [2024-11-16 17:06:25.624188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.276 [2024-11-16 17:06:25.624300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.276 [2024-11-16 17:06:25.624328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.276 qpair failed and we were unable to recover it. 00:30:40.276 [2024-11-16 17:06:25.624422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.276 [2024-11-16 17:06:25.624541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.276 [2024-11-16 17:06:25.624568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.276 qpair failed and we were unable to recover it. 00:30:40.276 [2024-11-16 17:06:25.624724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.276 [2024-11-16 17:06:25.624829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.276 [2024-11-16 17:06:25.624854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.276 qpair failed and we were unable to recover it. 00:30:40.276 [2024-11-16 17:06:25.624959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.276 [2024-11-16 17:06:25.625037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.276 [2024-11-16 17:06:25.625062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.276 qpair failed and we were unable to recover it. 00:30:40.276 [2024-11-16 17:06:25.625170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.276 [2024-11-16 17:06:25.625257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.276 [2024-11-16 17:06:25.625284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.276 qpair failed and we were unable to recover it. 00:30:40.276 [2024-11-16 17:06:25.625371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.276 [2024-11-16 17:06:25.625489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.276 [2024-11-16 17:06:25.625517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.276 qpair failed and we were unable to recover it. 00:30:40.276 [2024-11-16 17:06:25.625629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.276 [2024-11-16 17:06:25.625707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.276 [2024-11-16 17:06:25.625732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.276 qpair failed and we were unable to recover it. 00:30:40.277 [2024-11-16 17:06:25.625838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.625933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.625960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.277 qpair failed and we were unable to recover it. 00:30:40.277 [2024-11-16 17:06:25.626109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.626199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.626226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.277 qpair failed and we were unable to recover it. 00:30:40.277 [2024-11-16 17:06:25.626354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.626461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.626486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.277 qpair failed and we were unable to recover it. 00:30:40.277 [2024-11-16 17:06:25.626650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.626783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.626807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.277 qpair failed and we were unable to recover it. 00:30:40.277 [2024-11-16 17:06:25.626932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.627027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.627054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.277 qpair failed and we were unable to recover it. 00:30:40.277 [2024-11-16 17:06:25.627183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.627293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.627317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.277 qpair failed and we were unable to recover it. 00:30:40.277 [2024-11-16 17:06:25.627452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.627568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.627595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.277 qpair failed and we were unable to recover it. 00:30:40.277 [2024-11-16 17:06:25.627724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.627807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.627834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.277 qpair failed and we were unable to recover it. 00:30:40.277 [2024-11-16 17:06:25.627944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.628025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.628050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.277 qpair failed and we were unable to recover it. 00:30:40.277 [2024-11-16 17:06:25.628165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.277 [2024-11-16 17:06:25.628246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.628271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.278 qpair failed and we were unable to recover it. 00:30:40.278 [2024-11-16 17:06:25.628358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.628462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.628491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.278 qpair failed and we were unable to recover it. 00:30:40.278 [2024-11-16 17:06:25.628638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.628754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.628778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.278 qpair failed and we were unable to recover it. 00:30:40.278 [2024-11-16 17:06:25.628861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.628974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.629000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.278 qpair failed and we were unable to recover it. 00:30:40.278 [2024-11-16 17:06:25.629084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.629202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.629229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.278 qpair failed and we were unable to recover it. 00:30:40.278 [2024-11-16 17:06:25.629338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.629446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.629471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.278 qpair failed and we were unable to recover it. 00:30:40.278 [2024-11-16 17:06:25.629560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.629731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.629760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.278 qpair failed and we were unable to recover it. 00:30:40.278 [2024-11-16 17:06:25.629876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.629995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.630022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.278 qpair failed and we were unable to recover it. 00:30:40.278 [2024-11-16 17:06:25.630158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.278 [2024-11-16 17:06:25.630269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.279 [2024-11-16 17:06:25.630294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.279 qpair failed and we were unable to recover it. 00:30:40.279 [2024-11-16 17:06:25.630416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.279 [2024-11-16 17:06:25.630542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.279 [2024-11-16 17:06:25.630570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.279 qpair failed and we were unable to recover it. 00:30:40.279 [2024-11-16 17:06:25.630702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.279 [2024-11-16 17:06:25.630836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.279 [2024-11-16 17:06:25.630861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.279 qpair failed and we were unable to recover it. 00:30:40.279 [2024-11-16 17:06:25.630975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.279 [2024-11-16 17:06:25.631090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.279 [2024-11-16 17:06:25.631115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.279 qpair failed and we were unable to recover it. 00:30:40.279 [2024-11-16 17:06:25.631220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.279 [2024-11-16 17:06:25.631331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.279 [2024-11-16 17:06:25.631358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.279 qpair failed and we were unable to recover it. 00:30:40.279 [2024-11-16 17:06:25.631454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.279 [2024-11-16 17:06:25.631576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.279 [2024-11-16 17:06:25.631603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.280 qpair failed and we were unable to recover it. 00:30:40.280 [2024-11-16 17:06:25.631719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.631857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.631882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.280 qpair failed and we were unable to recover it. 00:30:40.280 [2024-11-16 17:06:25.631971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.632109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.632137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.280 qpair failed and we were unable to recover it. 00:30:40.280 [2024-11-16 17:06:25.632228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.632313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.632341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.280 qpair failed and we were unable to recover it. 00:30:40.280 [2024-11-16 17:06:25.632465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.632540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.632565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.280 qpair failed and we were unable to recover it. 00:30:40.280 [2024-11-16 17:06:25.632678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.632849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.632874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.280 qpair failed and we were unable to recover it. 00:30:40.280 [2024-11-16 17:06:25.632991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.633070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.633113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.280 qpair failed and we were unable to recover it. 00:30:40.280 [2024-11-16 17:06:25.633251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.633327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.633351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.280 qpair failed and we were unable to recover it. 00:30:40.280 [2024-11-16 17:06:25.633503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.633585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.633612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.280 qpair failed and we were unable to recover it. 00:30:40.280 [2024-11-16 17:06:25.633780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.280 [2024-11-16 17:06:25.633894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.281 [2024-11-16 17:06:25.633921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.281 qpair failed and we were unable to recover it. 00:30:40.281 [2024-11-16 17:06:25.634030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.281 [2024-11-16 17:06:25.634108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.281 [2024-11-16 17:06:25.634134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.281 qpair failed and we were unable to recover it. 00:30:40.281 [2024-11-16 17:06:25.634273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.281 [2024-11-16 17:06:25.634408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.281 [2024-11-16 17:06:25.634436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.281 qpair failed and we were unable to recover it. 00:30:40.281 [2024-11-16 17:06:25.634589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.281 [2024-11-16 17:06:25.634734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.281 [2024-11-16 17:06:25.634760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.281 qpair failed and we were unable to recover it. 00:30:40.281 [2024-11-16 17:06:25.634854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.281 [2024-11-16 17:06:25.634988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.281 [2024-11-16 17:06:25.635013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.281 qpair failed and we were unable to recover it. 00:30:40.281 [2024-11-16 17:06:25.635121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.281 [2024-11-16 17:06:25.635195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.281 [2024-11-16 17:06:25.635220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.281 qpair failed and we were unable to recover it. 00:30:40.281 [2024-11-16 17:06:25.635335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.281 [2024-11-16 17:06:25.635447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.281 [2024-11-16 17:06:25.635472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.281 qpair failed and we were unable to recover it. 00:30:40.281 [2024-11-16 17:06:25.635623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.281 [2024-11-16 17:06:25.635780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.282 [2024-11-16 17:06:25.635805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.282 qpair failed and we were unable to recover it. 00:30:40.282 [2024-11-16 17:06:25.635945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.282 [2024-11-16 17:06:25.636061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.282 [2024-11-16 17:06:25.636089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.282 qpair failed and we were unable to recover it. 00:30:40.282 [2024-11-16 17:06:25.636252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.282 [2024-11-16 17:06:25.636378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.282 [2024-11-16 17:06:25.636405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.282 qpair failed and we were unable to recover it. 00:30:40.282 [2024-11-16 17:06:25.636511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.282 [2024-11-16 17:06:25.636589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.282 [2024-11-16 17:06:25.636623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.282 qpair failed and we were unable to recover it. 00:30:40.282 [2024-11-16 17:06:25.636715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.283 [2024-11-16 17:06:25.636888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.283 [2024-11-16 17:06:25.636916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.283 qpair failed and we were unable to recover it. 00:30:40.283 [2024-11-16 17:06:25.637042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.283 [2024-11-16 17:06:25.637127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.283 [2024-11-16 17:06:25.637156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.283 qpair failed and we were unable to recover it. 00:30:40.283 [2024-11-16 17:06:25.637293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.283 [2024-11-16 17:06:25.637403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.283 [2024-11-16 17:06:25.637431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.283 qpair failed and we were unable to recover it. 00:30:40.283 [2024-11-16 17:06:25.637536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.283 [2024-11-16 17:06:25.637656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.283 [2024-11-16 17:06:25.637682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.283 qpair failed and we were unable to recover it. 00:30:40.284 [2024-11-16 17:06:25.637759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.284 [2024-11-16 17:06:25.637892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.284 [2024-11-16 17:06:25.637920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.284 qpair failed and we were unable to recover it. 00:30:40.284 [2024-11-16 17:06:25.638029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.284 [2024-11-16 17:06:25.638165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.284 [2024-11-16 17:06:25.638190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.284 qpair failed and we were unable to recover it. 00:30:40.284 [2024-11-16 17:06:25.638312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.284 [2024-11-16 17:06:25.638431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.284 [2024-11-16 17:06:25.638458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.284 qpair failed and we were unable to recover it. 00:30:40.284 [2024-11-16 17:06:25.638544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.284 [2024-11-16 17:06:25.638705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.284 [2024-11-16 17:06:25.638733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.284 qpair failed and we were unable to recover it. 00:30:40.284 [2024-11-16 17:06:25.638838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.284 [2024-11-16 17:06:25.638954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.284 [2024-11-16 17:06:25.638979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.284 qpair failed and we were unable to recover it. 00:30:40.284 [2024-11-16 17:06:25.639133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.284 [2024-11-16 17:06:25.639257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.284 [2024-11-16 17:06:25.639282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.284 qpair failed and we were unable to recover it. 00:30:40.284 [2024-11-16 17:06:25.639389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.284 [2024-11-16 17:06:25.639501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.284 [2024-11-16 17:06:25.639526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.284 qpair failed and we were unable to recover it. 00:30:40.284 [2024-11-16 17:06:25.639636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.639750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.639775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-16 17:06:25.639854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.639944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.639984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-16 17:06:25.640144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.640294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.640321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-16 17:06:25.640429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.640507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.640532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-16 17:06:25.640644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.640721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.640746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-16 17:06:25.640857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.640965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.640990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-16 17:06:25.641062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.641202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.641227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-16 17:06:25.641373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.641485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-16 17:06:25.641512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-16 17:06:25.641657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.641740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.641765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-16 17:06:25.641880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.641988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.642013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-16 17:06:25.642138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.642225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.642253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-16 17:06:25.642375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.642476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.642518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-16 17:06:25.642658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.642794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.642819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-16 17:06:25.642986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.643107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.643134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-16 17:06:25.643260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.643347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.643374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-16 17:06:25.643499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.643574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-16 17:06:25.643599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-16 17:06:25.643722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.643861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.643885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-16 17:06:25.644014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.644172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.644196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-16 17:06:25.644282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.644426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.644451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-16 17:06:25.644584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.644723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.644749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-16 17:06:25.644824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.644904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.644928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-16 17:06:25.645009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.645113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.645138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-16 17:06:25.645246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.645326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.645351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-16 17:06:25.645434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.645505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.645529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-16 17:06:25.645633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.645779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-16 17:06:25.645803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-16 17:06:25.645875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.645961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.645986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-16 17:06:25.646124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.646282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.646309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-16 17:06:25.646478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.646561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.646586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-16 17:06:25.646680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.646786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.646810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-16 17:06:25.646919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.647000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.647024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-16 17:06:25.647173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.647288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.647312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-16 17:06:25.647425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.647505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.647529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-16 17:06:25.647662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.647750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.647782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-16 17:06:25.647913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.648024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-16 17:06:25.648049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-16 17:06:25.648199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.648307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.648335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-16 17:06:25.648484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.648636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.648664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-16 17:06:25.648791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.648895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.648920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-16 17:06:25.649032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.649138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.649163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-16 17:06:25.649270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.649359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.649383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-16 17:06:25.649501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.649592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.649623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-16 17:06:25.649709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.649846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.649870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-16 17:06:25.649967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.650116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-16 17:06:25.650143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-16 17:06:25.650248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.650360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.650388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-16 17:06:25.650531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.650654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.650683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-16 17:06:25.650820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.650927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.650952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-16 17:06:25.651035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.651144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.651169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-16 17:06:25.651251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.651326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.651352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-16 17:06:25.651493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.651608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.651639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-16 17:06:25.651750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.651868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.651892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-16 17:06:25.651998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.652113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.652140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-16 17:06:25.652239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-16 17:06:25.652335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.652363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.652496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.652576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.652600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.652681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.652815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.652842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.652946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.653033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.653060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.653186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.653264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.653289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.653410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.653521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.653563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.653672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.653787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.653812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.653915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.654028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.654053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.654206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.654327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.654351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.654481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.654607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.654643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.654744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.654894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.654919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.655051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.655216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.655240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.655358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.655467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.655491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.655653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.655770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.655796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.655884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.656017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.656044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.656141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.656264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.656291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.656390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.656495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.656520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.656599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.656718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.656760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.656871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.656953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.656978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.657130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.657271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.657296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.657425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.657552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.657579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.657722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.657812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.657836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.657941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.658054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.658079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.658235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.658337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.658362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.658476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.658639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.658667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.658793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.658929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.658954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.659121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.659217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.659244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.659329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.659413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.659440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.659550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.659643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.659669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.659775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.659880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.659906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.660029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.660148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.660172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.660277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.660353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.660378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.660517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.660629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.660656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-16 17:06:25.660772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-16 17:06:25.660884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.660916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.661045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.661150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.661175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.661288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.661399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.661424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.661526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.661639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.661667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.661773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.661884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.661908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.662013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.662168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.662192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.662308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.662437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.662464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.662585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.662724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.662750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.662863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.662959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.662987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.663140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.663252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.663279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.663407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.663528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.663553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.663716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.663840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.663867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.664029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.664180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.664207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.664336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.664413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.664437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.664526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.664598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.664630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.664714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.664816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.664840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.664955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.665067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.665091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.665206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.665330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.665357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.665476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.665566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.665593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.665724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.665804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.665828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.665909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.666015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.666042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.666161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.666293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.666318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.666457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.666576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.666601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.666716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.666837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.666865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.666967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.667090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.667118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.667224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.667340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.667365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.667526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.667648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.667674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.667815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.667903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.667927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.668071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.668152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.668176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.668259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.668338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.668381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.668463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.668557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.668584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.668742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.668897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.668925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.669064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.669175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.669205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.669338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.669456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.669483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.669597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.669692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.669719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.669832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.669917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.669944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.670081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.670166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.670194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.670275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.670352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.670377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.670461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.670566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.670591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-16 17:06:25.670723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.670818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-16 17:06:25.670847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.670940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.671052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.671079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.671203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.671333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.671361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.671447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.671522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.671564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.671696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.671818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.671845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.671964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.672050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.672078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.672159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.672276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.672304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.672397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.672527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.672551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.672635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.672712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.672737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.672849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.672979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.673008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.673135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.673221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.673249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.673397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.673495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.673522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.673606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.673739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.673768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.673878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.673981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.674005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.674135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.674250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.674278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.674374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.674483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.674511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.674665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.674805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.674829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.674926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.675078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.675105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.675234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.675348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.675375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.675500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.675655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.675681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.675766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.675849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.675874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.675974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.676070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.676098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.676247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.676362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.676389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.676492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.676614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.676649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.676779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.676870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.676894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.677016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.677118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.677145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.677282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.677410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.677437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.677533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.677624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.677668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.677774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.677854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.677879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.678011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.678102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.678129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.678219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.678309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.678337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.678428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.678541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.678568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.678685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.678762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.678787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.678901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.679009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.679039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.679141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.679273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.679301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.679423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.679507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.679534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.679654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.679789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.679814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.679897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.680000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.680028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.680142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.680255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.680283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.680377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.680466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.680493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.680625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.680715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.680744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.680901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.681012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.681040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.681189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.681312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.681340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.681444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.681581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.681609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.681751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.681857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.681882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.681956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.682088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.682116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.682267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.682415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.682443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.682578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.682673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.682699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-16 17:06:25.682784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.682864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-16 17:06:25.682889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.682986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.683065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.683092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.683212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.683299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.683327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.683456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.683579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.683606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.683740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.683863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.683892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.684002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.684123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.684150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.684264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.684404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.684429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.684522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.684640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.684666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.684782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.684922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.684948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.685034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.685149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.685175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.685264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.685350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.685375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.685458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.685532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.685557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.685718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.685841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.685868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.686015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.686139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.686166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.686294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.686381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.686409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.686497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.686632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.686662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.686775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.686883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.686926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.687047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.687166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.687193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.687291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.687439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.687467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.687568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.687650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.687676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.687787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.687944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.687972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.688118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.688268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.688295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.688389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.688478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.688505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.688592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.688758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.688783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.688861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.689020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.689047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.689147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.689272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.689300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.689405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.689512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.689536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.689610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.689729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.689754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.689838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.689924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.689949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.690072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.690192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.690220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.690305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.690452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.690479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.690653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.690805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.690830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.690966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.691057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.691086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.691178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.691301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.691329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.691481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.691600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.691653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.691790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.691920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.691948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.692104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.692199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.692228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.692420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.692560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.692586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.692673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.692749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.692775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.692887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.693048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.693075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.693167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.693285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.693313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.693461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.693587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.693633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.693771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.693847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.693872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.693986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.694078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.694104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.694214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.694307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.694332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-16 17:06:25.694473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.694607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-16 17:06:25.694640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.694758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.694833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.694858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.694987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.695114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.695142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.695277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.695406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.695434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.695559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.695671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.695697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.695815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.695920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.695962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.696086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.696172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.696200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.696414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.696505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.696532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.696628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.696729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.696754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.696864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.696989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.697017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.697120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.697279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.697306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.697456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.697576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.697604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.697774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.697883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.697909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.698008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.698132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.698160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.698275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.698393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.698421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.698536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.698650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.698693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.698807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.698918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.698943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.699026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.699124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.699151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.699238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.699386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.699413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.699511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.699592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.699624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.699742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.699880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.699923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.700045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.700124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.700156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.700279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.700402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.700430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.700522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.700656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.700682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.700824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.700946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.700973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.701094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.701252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.701280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.701401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.701550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.701577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.701722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.701825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.701850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.701966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.702081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.702122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.702247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.702347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.702375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.702470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.702587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-16 17:06:25.702620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-16 17:06:25.702722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-16 17:06:25.702834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-16 17:06:25.702859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-16 17:06:25.702981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-16 17:06:25.703120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-16 17:06:25.703148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-16 17:06:25.703235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-16 17:06:25.703351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-16 17:06:25.703380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-16 17:06:25.703481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-16 17:06:25.703645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-16 17:06:25.703671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-16 17:06:25.703779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-16 17:06:25.703862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-16 17:06:25.703887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-16 17:06:25.704020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-16 17:06:25.704110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-16 17:06:25.704137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-16 17:06:25.704233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-16 17:06:25.704337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-16 17:06:25.704362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-16 17:06:25.704455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-16 17:06:25.704593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-16 17:06:25.704625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-16 17:06:25.704759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-16 17:06:25.704880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-16 17:06:25.704908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-16 17:06:25.705011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.705148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.705173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-16 17:06:25.705254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.705391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.705416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-16 17:06:25.705550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.705668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.705697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-16 17:06:25.705825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.705940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.705966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-16 17:06:25.706081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.706212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.706241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-16 17:06:25.706368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.706524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.706552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-16 17:06:25.706688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.706799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.706824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-16 17:06:25.706959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-16 17:06:25.707056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-16 17:06:25.707083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-16 17:06:25.707207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-16 17:06:25.707304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-16 17:06:25.707331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-16 17:06:25.707475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-16 17:06:25.707592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-16 17:06:25.707622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-16 17:06:25.707753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-16 17:06:25.707837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-16 17:06:25.707865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-16 17:06:25.707987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-16 17:06:25.708119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-16 17:06:25.708144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-16 17:06:25.708288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-16 17:06:25.708401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-16 17:06:25.708426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-16 17:06:25.708556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-16 17:06:25.708662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-16 17:06:25.708690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-16 17:06:25.708816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-16 17:06:25.708940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-16 17:06:25.708967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-16 17:06:25.709069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-16 17:06:25.709153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-16 17:06:25.709178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-16 17:06:25.709284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-16 17:06:25.709361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-16 17:06:25.709385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-16 17:06:25.709498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-16 17:06:25.709604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-16 17:06:25.709655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-16 17:06:25.709784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-16 17:06:25.709891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-16 17:06:25.709916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-16 17:06:25.710072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-16 17:06:25.710156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-16 17:06:25.710186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-16 17:06:25.710314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-16 17:06:25.710468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-16 17:06:25.710493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-16 17:06:25.710581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-16 17:06:25.710725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-16 17:06:25.710751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-16 17:06:25.710841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-16 17:06:25.710952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-16 17:06:25.710977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-16 17:06:25.711065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-16 17:06:25.711194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-16 17:06:25.711236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-16 17:06:25.711348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-16 17:06:25.711508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-16 17:06:25.711535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-16 17:06:25.711672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-16 17:06:25.711753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-16 17:06:25.711778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-16 17:06:25.711864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.711972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.711996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-16 17:06:25.712110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.712216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.712240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-16 17:06:25.712360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.712495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.712520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-16 17:06:25.712671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.712789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.712814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-16 17:06:25.712885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.712991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.713016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-16 17:06:25.713095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.713227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.713255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-16 17:06:25.713407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.713492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.713523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-16 17:06:25.713601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.713696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-16 17:06:25.713722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-16 17:06:25.713828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-16 17:06:25.713933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-16 17:06:25.713958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-16 17:06:25.714051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-16 17:06:25.714140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-16 17:06:25.714165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-16 17:06:25.714304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-16 17:06:25.714379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-16 17:06:25.714424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-16 17:06:25.714586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-16 17:06:25.714698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-16 17:06:25.714725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-16 17:06:25.714865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-16 17:06:25.715007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-16 17:06:25.715034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-16 17:06:25.715191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-16 17:06:25.715276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-16 17:06:25.715300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-16 17:06:25.715420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-16 17:06:25.715533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-16 17:06:25.715560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-16 17:06:25.715667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-16 17:06:25.715763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-16 17:06:25.715787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-16 17:06:25.715894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-16 17:06:25.715977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-16 17:06:25.716001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-16 17:06:25.716134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-16 17:06:25.716290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-16 17:06:25.716314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-16 17:06:25.716433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-16 17:06:25.716538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-16 17:06:25.716580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-16 17:06:25.716698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-16 17:06:25.716847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-16 17:06:25.716871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-16 17:06:25.716962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-16 17:06:25.717069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-16 17:06:25.717094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-16 17:06:25.717225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-16 17:06:25.717349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-16 17:06:25.717377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-16 17:06:25.717474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-16 17:06:25.717625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-16 17:06:25.717653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-16 17:06:25.717781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-16 17:06:25.717899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-16 17:06:25.717924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-16 17:06:25.718034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-16 17:06:25.718160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-16 17:06:25.718187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-16 17:06:25.718287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-16 17:06:25.718416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-16 17:06:25.718458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-16 17:06:25.718621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-16 17:06:25.718762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-16 17:06:25.718786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-16 17:06:25.718879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-16 17:06:25.719012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-16 17:06:25.719040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-16 17:06:25.719176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-16 17:06:25.719289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-16 17:06:25.719314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-16 17:06:25.719429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-16 17:06:25.719555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-16 17:06:25.719582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-16 17:06:25.719746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.719828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.719853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.719964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.720035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.720060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.720142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.720280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.720308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.720433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.720549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.720577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.720712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.720821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.720846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.720935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.721029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.721056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.721205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.721324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.721352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.721484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.721575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.721600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.721749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.721843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.721871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.721996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.722153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.722178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.722294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.722432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.722458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.722556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.722677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.722705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.722786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.722880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.722908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.723048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.723159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.723184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.723301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.723417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.723443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.723574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.723696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.723725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.723851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.723966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.723991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.724109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.724187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.724215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.724320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.724424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.724449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.724562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.724663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.724688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.724796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.724902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.724927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.725010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.725091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.725116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.725204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.725313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.725338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.725445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.725528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.725554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.725703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.725810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.725852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.725960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.726064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.726089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.726207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.726359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.726386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.726500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.726642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.726671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.726775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.726858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.726883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.727022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.727146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.727173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.727297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.727408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.727436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.727600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.727755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.727799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.727929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.728046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.728072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.728185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.728291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.728316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.728423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.728506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.728534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.728651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.728787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.728812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.728915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.729013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.729041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.729145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.729232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.729256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.729372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.729459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.729483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.729611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.729751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.729778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.729888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.730003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.730028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.730103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.730181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.730206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.730311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.730416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.730440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.730516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.730653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.730678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-16 17:06:25.730787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.730925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-16 17:06:25.730950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.731039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.731204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.731231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.731364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.731444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.731468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.731582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.731696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.731724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.731812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.731892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.731919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.732049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.732157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.732182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.732277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.732387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.732413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.732529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.732655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.732684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.732813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.732954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.732979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.733073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.733200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.733227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.733315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.733461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.733488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.733664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.733792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.733817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.733951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.734117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.734141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.734261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.734347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.734371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.734454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.734540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.734566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.734648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.734737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.734762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.734867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.734970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.734995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.735103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.735247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.735271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.735370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.735449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.735477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.735612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.735747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.735775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.735914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.735996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.736021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.736128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.736257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.736286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.736385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.736500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.736527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.736649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.736723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.736747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.736825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.736988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.737020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.737142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.737274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.737299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.737409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.737516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.737540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.737695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.737800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.737826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.737984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.738069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.738098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.738238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.738349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.738374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.738480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.738625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.738654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.738769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.738845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.738871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.738984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.739100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.739124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.739218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.739336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.739363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.739519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.739608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.739677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.739824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.739967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.740008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.740130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.740252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.740280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.740402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.740497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.740525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.740659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.740773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.740798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.740933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.741046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-16 17:06:25.741073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-16 17:06:25.741158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.741308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.741335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.741447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.741566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.741591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.741672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.741803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.741829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.741935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.742050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.742077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.742169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.742271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.742296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.742418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.742520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.742546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.742685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.742779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.742823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.742934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.743071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.743097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.743241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.743366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.743395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.743517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.743640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.743682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.743771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.743851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.743877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.744041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.744172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.744198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.744338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.744472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.744498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.744648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.744740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.744766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.744898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.745063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.745089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.745201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.745324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.745368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.745495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.745580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.745609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.745754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.745842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.745868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.745983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.746095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.746139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.746305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.746445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.746471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.746612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.746729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.746755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.746872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.747026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.747054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.747180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.747262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.747288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.747447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.747599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.747656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.747812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.747934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.747963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.748060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.748177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.748207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.748350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.748474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.748502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.748594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.748722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.748751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.748853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.748941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.748967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.749075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.749185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.749229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.749369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.749487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.749513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.749602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.749712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.749739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.749834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.749970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.750014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.750124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.750207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.750250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.750414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.750525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.750551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.750688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.750815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.750846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.751006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.751157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-16 17:06:25.751198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-16 17:06:25.751340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.751450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.751477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.751659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.751775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.751801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.751911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.752017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.752043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.752133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.752205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.752231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.752313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.752394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.752421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.752565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.752701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.752743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.752866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.752980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.753007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.753173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.753328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.753357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.753457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.753578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.753607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.753792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.753904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.753931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.754043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.754185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.754211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.754344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.754481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.754510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.754647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.754786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.754812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.754937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.755061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.755091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.755213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.755329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.755357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.755467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.755573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.755599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.755693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.755788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.755817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.755944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.756091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.756119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.756244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.756362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.756388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.756537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.756639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.756668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.756750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.756901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.756930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.757053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.757169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.757195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-16 17:06:25.757283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-16 17:06:25.757425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.757454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.757576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.757733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.757763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.757864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.757941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.757967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.758051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.758177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.758205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.758333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.758427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.758456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.758594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.758720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.758746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.758891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.759034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.759060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.759207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.759328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.759354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.759484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.759572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.759601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.759739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.759859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.759885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.759995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.760112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.760140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.760306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.760392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.760419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.760510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.760629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.760656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.760770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.760881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.760907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.760985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.761059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.761086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.761195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.761304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.761349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.761465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.761598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.761635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.761745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.761858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.761888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.761963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.762036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.762062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.762149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.762230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.762256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.762364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.762503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.762532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.762652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.762762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.762788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.762902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.763010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.763053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.763159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.763266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.763291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.763400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.763527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.763571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.763692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.763830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.763856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.763967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.764054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.764082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.764175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.764279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.764309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.764410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.764533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.764561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.764663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.764750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.764778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.764875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.764989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.765015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.765129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.765244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.765270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.765386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.765525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.765551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.765665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.765773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.765799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.765877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.765986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.766012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.766090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.766168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.766194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.766286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.766411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.766440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.766564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.766671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.766698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.766806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.766943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.766969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.767090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.767227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.767269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.767393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.767508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.767537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.767652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.767726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.767752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.767838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.767939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-16 17:06:25.767964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-16 17:06:25.768055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.768160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.768186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.768268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.768374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.768400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.768486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.768594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.768631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.768757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.768853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.768883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.769030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.769144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.769170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.769287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.769402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.769446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.769529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.769694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.769722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.769812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.769901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.769927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.770041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.770182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.770208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.770294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.770395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.770422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.770529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.770613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.770651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.770759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.770838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.770864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.770973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.771077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.771103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.771236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.771328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.771354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.771432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.771557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.771582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.771714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.771833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.771859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.771942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.772019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.772045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.772133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.772247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.772272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.772353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.772432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.772458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.772590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.772741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.772768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.772879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.772995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.773024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.773110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.773207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.773236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.773341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.773478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.773506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-16 17:06:25.773658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.773789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-16 17:06:25.773815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-16 17:06:25.773918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.774001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.774029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-16 17:06:25.774173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.774287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.774317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-16 17:06:25.774431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.774516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.774542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-16 17:06:25.774690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.774767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.774793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-16 17:06:25.774869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.774985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.775011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-16 17:06:25.775120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.775264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.775290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-16 17:06:25.775393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.775508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.775534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-16 17:06:25.775627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.775734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.775760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-16 17:06:25.775873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.775981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.776007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-16 17:06:25.776094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.776173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.776199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-16 17:06:25.776309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.776414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.776441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-16 17:06:25.776518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.776602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.776636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-16 17:06:25.776750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.776858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-16 17:06:25.776884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-16 17:06:25.776996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-16 17:06:25.777086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-16 17:06:25.777112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-16 17:06:25.777222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-16 17:06:25.777304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-16 17:06:25.777330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-16 17:06:25.777468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-16 17:06:25.777601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-16 17:06:25.777640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-16 17:06:25.777745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-16 17:06:25.777850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-16 17:06:25.777875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.777994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.778074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.778101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.778219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.778308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.778334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.778481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.778602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.778637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.778719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.778832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.778858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.778938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.779020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.779063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.779215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.779295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.779321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.779431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.779545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.779571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.779670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.779783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.779809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.779884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.779962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.779987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.780107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.780188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.780214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.780305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.780420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.780445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.780559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.780654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.780681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.780793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.780902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.780945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.781040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.781134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.781160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.781242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.781379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.781405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.781492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.781568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.781594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.781701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.781832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.781863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.781959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.782096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.782122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.782216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.782295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.782323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.782463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.782576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.782601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.782701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.782813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.782839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.782955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.783038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.783064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.783148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.783284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.783310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.783388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.783497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.783524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.783643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.783757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.783783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.783901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.783982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.784008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.784098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.784180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.784206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.784325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.784407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.784433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.784553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.784645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.784672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.784785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.784895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.784921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.785004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.785077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.785103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.785192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.785271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.785298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.785408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.785523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.785551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.785642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.785723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.785749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.785828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.785941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.785968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.786076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.786185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.786215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.786331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.786433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-16 17:06:25.786462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-16 17:06:25.786608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.786738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.786765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.786908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.787001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.787026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.787108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.787244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.787271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.787356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.787437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.787463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.787546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.787627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.787654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.787726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.787838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.787864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.787946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.788020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.788046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.788124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.788228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.788254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.788334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.788407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.788433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.788512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.788603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.788639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.788721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.788857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.788883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.789020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.789146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.789176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.789303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.789391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.789420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.789593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.789706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.789733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.789812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.789893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.789919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.790002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.790083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.790109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.790248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.790354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.790380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.790484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.790594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.790640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.790783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.790909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.790934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.791054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.791170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.791195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.791325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.791484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.791513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.791607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.791714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.791741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.791833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.791912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.791938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.792046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.792144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.792173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.792285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.792371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.792400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.792503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.792583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.792609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.792727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.792818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.792844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.792920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.792993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.793019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.793163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.793246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.793272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.793424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.793504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.793531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.793625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.793698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.793722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.793803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.793878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.793904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.793988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.794074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.794120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.794217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.794337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.794366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.794472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.794582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.794609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-16 17:06:25.794752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-16 17:06:25.794857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.794884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.795013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.795113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.795142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.795277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.795363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.795389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.795474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.795562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.795588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.795729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.795871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.795897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.796011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.796120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.796146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.796273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.796373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.796399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.796523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.796638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.796665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.796776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.796859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.796885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.796961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.797096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.797138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.797299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.797417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.797443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.797578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.797667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.797693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.797811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.797890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.797915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.798008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.798109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.798134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.798279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.798364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.798394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.798511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.798591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.798624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.798741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.798818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.798844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.798931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.799041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.799067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.799149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.799317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.799345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.799502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.799623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.799650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.799766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.799911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.799937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.800067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.800161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.800189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.800286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.800374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.800404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.800507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.800630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.800657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.800772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.800854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.800880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.801022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.801154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.801180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-16 17:06:25.801288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.801399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-16 17:06:25.801427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.801537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.801632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.801660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.801737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.801852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.801877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.801957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.802062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.802088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.802205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.802318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.802343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.802421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.802510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.802536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.802643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.802760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.802786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.802874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.803005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.803048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.803159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.803273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.803300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.803380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.803489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.803515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.803597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.803707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.803734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.803819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.803936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.803979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.804117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.804196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.804222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.804310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.804420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.804446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.804560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.804671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.804698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.804789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.804875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.804901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.804980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.805098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.805124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.805232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.805341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.805370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.805476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.805554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.805581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.805712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.805812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.805857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.805978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.806115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.806141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.806279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.806366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.806392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.806505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.806626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.806653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.806768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.806843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.806868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.806953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.807039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.807066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-16 17:06:25.807183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.807295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-16 17:06:25.807322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-16 17:06:25.807402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.807512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.807560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-16 17:06:25.807705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.807815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.807841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-16 17:06:25.808003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.808122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.808152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-16 17:06:25.808276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.808402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.808432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-16 17:06:25.808562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.808699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.808726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-16 17:06:25.808808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.808943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.808972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-16 17:06:25.809060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.809150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.809178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-16 17:06:25.809341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.809456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.809481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-16 17:06:25.809567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.809678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.809705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-16 17:06:25.809842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.809938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.809968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-16 17:06:25.810078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.810215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.810241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-16 17:06:25.810358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-16 17:06:25.810437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-16 17:06:25.810463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-16 17:06:25.810552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-16 17:06:25.810662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-16 17:06:25.810689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-16 17:06:25.810776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-16 17:06:25.810864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-16 17:06:25.810894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-16 17:06:25.811013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-16 17:06:25.811094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-16 17:06:25.811121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-16 17:06:25.811197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-16 17:06:25.811336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-16 17:06:25.811362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-16 17:06:25.811471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-16 17:06:25.811574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-16 17:06:25.811600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-16 17:06:25.811722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-16 17:06:25.811834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.811860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.811972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.812080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.812105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.812179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.812258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.812284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.812413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.812516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.812545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.812668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.812756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.812784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.812912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.813054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.813080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.813253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.813378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.813421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.813564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.813647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.813673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.813761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.813840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.813867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.814004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.814098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.814122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.814208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.814291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.814317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.814429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.814504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.814529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.814614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.814704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.814729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.814818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.814925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.814950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.815035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.815119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.815146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.815257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.815401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.815429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.815517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.815640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.815670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.815796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.815882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.815908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.815998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.816112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.816138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.816251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.816397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.816426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.816567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.816694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.816721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.816810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.816922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-16 17:06:25.816948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-16 17:06:25.817031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.817169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.817195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.817336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.817443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.817468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.817549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.817630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.817657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.817776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.817913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.817939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.818021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.818097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.818123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.818210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.818326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.818352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.818442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.818556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.818582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.818668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.818777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.818803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.818879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.818958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.818983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.819099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.819190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.819216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.819297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.819371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.819397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.819487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.819627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.819654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.819760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.819864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.819890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.819995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.820107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.820138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.820214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.820293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.820320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.820442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.820518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.820547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.820634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.820746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.820774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.820885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.821067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.821092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.821236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.821323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.821349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.821462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.821597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.821651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.821771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.821858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.821884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.821998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.822072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.822098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.822173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.822249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.822275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.822382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.822462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.822488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.822610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.822690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.822717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.822804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.822882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.822908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.823071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.823230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.823256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.823404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.823518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.823544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.823684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.823770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.823796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.823877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.823953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.823978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.824060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.824194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.824219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.824330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.824410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.824437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.824549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.824641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.824668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.824753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.824857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.824883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.824999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.825101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.825127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.825220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.825333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.825359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.825448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.825549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.825575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.825699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.825806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.825833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.825912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.826015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.826041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.826123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.826234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.826260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.826343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.826457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.826483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.826559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.826681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.826711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.826834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.826949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.826977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.827075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.827213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.827239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.827319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.827413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.827442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.827587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.827682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.827711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.827848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.827923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.827949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.828037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.828126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.828152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.828285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.828437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.828466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.828608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.828755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.828780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.828897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.829003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.829028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.829110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.829214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.829240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.829378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.829520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.829563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.829688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.829787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.829817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-16 17:06:25.829938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.830059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-16 17:06:25.830088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.830236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.830355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.830382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.830522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.830651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.830681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.830805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.830924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.830954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.831080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.831163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.831189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.831288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.831413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.831455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.831549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.831626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.831653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.831795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.831878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.831906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.831984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.832087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.832113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.832219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.832296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.832322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.832402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.832541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.832567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.832652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.832763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.832789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.832934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.833010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.833040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.833149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.833290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.833315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.833432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.833537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.833563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.833678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.833794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.833820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.833927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.834000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.834026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.834112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.834221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.834247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.834328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.834432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.834458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.834567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.834658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.834684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.834794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.834881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.834907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.835000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.835108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.835133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.835227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.835339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.835365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.835531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.835644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.835671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.835789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.835902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.835928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.836007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.836111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.836137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.836218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.836323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.836349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.836454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.836533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.836559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.836672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.836755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.836781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.836862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.836945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.836970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.837054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.837189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.837215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.837292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.837399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.837425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.837504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.837608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.837643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.837723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.837794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.837820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.837946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.838018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.838043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.838127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.838238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.838264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.838351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.838454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.838479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.838563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.838677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.838703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.838790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.838894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.838919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.839029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.839119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.839146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.839257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.839334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.839361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.839471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.839554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.839580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.839709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.839819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.839845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.839962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.840111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.840137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.840221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.840301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.840328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.840468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.840575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.840603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.840743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.840884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.840910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.841019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.841099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.841126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.841269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.841350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.841376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.841453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.841536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.841561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-16 17:06:25.841670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.841761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-16 17:06:25.841788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.841876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.841960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.841986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.842062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.842179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.842204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.842279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.842431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.842459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.842549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.842686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.842716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.842826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.842942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.842968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.843087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.843204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.843230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.843338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.843418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.843444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.843586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.843679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.843706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.843820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.843949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.843980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.844129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.844219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.844248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.844374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.844487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.844512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.844639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.844765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.844793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.844894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.845013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.845046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.845174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.845286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.845312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.845415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.845536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.845565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.845711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.845827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.845853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.845944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.846026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.846052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.846143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.846296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.846322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.846437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.846549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.846575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.846666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.846742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.846768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.846858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.846966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.846992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.847079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.847238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.847279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.847358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.847444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.847469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.847582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.847702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.847728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.847814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.847942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.847971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.848077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.848166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.848193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.848309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.848396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.848422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.848537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.848610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.848667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.848751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.848825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.848850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.848923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.849007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.849035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.849138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.849241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.849282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.849421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.849528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.849554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.849660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.849769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.849795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.849879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.849967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.849993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.850102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.850206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.850232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.850315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.850395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.850423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.850509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.850622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.850648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.850732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.850821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.850846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.850937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.851062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.851091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.851183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.851326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.851351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.851493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.851607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.851641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.851754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.851832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.851858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.851960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.852075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.852104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.852238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.852355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.852381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.852488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.852608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.852651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.852733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.852804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.852830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.852946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.853031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.853057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.853173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.853251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.853278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.853437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.853556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.853584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.853727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.853819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.853845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.853939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.854022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.854048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.854122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.854230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.854256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.854341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.854443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.854468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.854587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.854682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.854713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-16 17:06:25.854805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-16 17:06:25.854884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.854910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.854993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.855098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.855124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.855205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.855315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.855341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.855492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.855603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.855639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.855750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.855864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.855889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.855995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.856099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.856125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.856242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.856327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.856352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.856428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.856544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.856570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.856650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.856741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.856766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.856880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.856995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.857021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.857140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.857218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.857245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.857399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.857521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.857550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.857634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.857768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.857794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.857884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.857998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.858024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.858164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.858250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.858276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.858399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.858486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.858511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.858600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.858723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.858749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.858867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.858953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.858980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.859119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.859247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.859276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.859387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.859502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.859528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.859643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.859756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.859782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.859854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.859935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.859961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.860080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.860195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.860221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.860298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.860437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.860465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.860560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.860681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.860710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.860843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.860978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.861004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.861108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.861267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.861293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.861408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.861487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.861513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.861641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.861757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.861783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.861859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.861970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.861996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.862171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.862322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.862352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.862473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.862590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.862626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.862772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.862888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.862932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.863023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.863115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.863145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.863302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.863413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.863440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.863561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.863653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.863680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.863791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.863930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.863956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.864069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.864151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.864178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.864296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.864389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.864415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.864534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.864676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.864704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.864792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.864902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.864928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.865053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.865141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.865167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.865253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.865366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.865391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.865500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.865608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.865641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.865724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.865808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.865836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.865919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.866004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.866032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.866149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.866225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.866251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.866356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.866463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.866488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.866640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.866756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.866783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.866919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.867042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.867067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-16 17:06:25.867157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.867294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-16 17:06:25.867323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.867452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.867545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.867588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.867714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.867796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.867821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.867901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.867994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.868020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.868128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.868204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.868231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.868322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.868395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.868422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.868533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.868646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.868693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.868807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.868891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.868917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.869013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.869090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.869116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.869202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.869283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.869309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.869423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.869554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.869589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.869709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.869818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.869844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.869954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.870032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.870059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.870176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.870278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.870304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.870447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.870532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.870559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.870676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.870761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.870787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.870871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.870981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.871007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.871119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.871207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.871233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.871322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.871437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.871463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.871623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.871750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.871776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.871889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.871977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.872005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.872124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.872238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.872263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.872379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.872460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.872486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.872595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.872684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.872711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.872793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.872877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.872902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.872984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.873097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.873123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.873235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.873312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.873338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.873484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.873560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.873586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.873726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.873863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.873889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.874000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.874085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.874111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.874198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.874307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.874333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.874448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.874598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.874650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.874765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.874905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.874931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.875042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.875161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.875187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.875289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.875403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.875431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.875584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.875711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.875738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.875854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.875931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.875957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.876041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.876138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.876167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.876306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.876384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.876410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.876552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.876656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.876686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.876835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.876946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.876972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.877063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.877143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.877169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.877258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.877363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.877392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.877478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.877569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.877598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.877714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.877803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.877830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.877909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.878018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.878044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.878140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.878225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.878254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.878379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.878485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.878511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.878628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.878769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.878796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.878878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.878953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.878979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.879086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.879194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.879220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.879361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.879490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.879521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.879611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.879785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.879814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.879956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.880044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.880070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-16 17:06:25.880152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-16 17:06:25.880261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.880287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.880401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.880507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.880533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.880679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.880758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.880784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.880865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.881025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.881053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.881176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.881279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.881321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.881463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.881550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.881577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.881699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.881815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.881841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.881924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.882002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.882028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.882180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.882287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.882312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.882429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.882536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.882562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.882642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.882769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.882797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.882902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.882982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.883009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.883086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.883175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.883201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.883339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.883456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.883482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.883559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.883676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.883704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.883818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.883925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.883951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.884065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.884153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.884180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.884269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.884355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.884381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.884521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.884631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.884660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.884804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.884881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.884908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.885018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.885101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.885129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.885241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.885354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.885380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.885489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.885629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.885672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.885791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.885911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.885937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.886044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.886151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.886195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.886279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.886404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.886433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.886536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.886653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.886680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.886752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.886832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.886858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.886942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.887026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.887054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.887170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.887250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.887276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.887389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.887477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.887503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.887641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.887761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.887787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.887876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.887989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.888015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.888127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.888253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.888282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.888375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.888522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.888551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.888664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.888807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.888833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.888915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.889001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.889027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.889114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.889222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.889247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.889389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.889501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.889528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.889650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.889766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.889792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.889876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.889986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.890011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.890123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.890209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.890237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.890316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.890408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.890434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.890519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.890632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.890659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.890737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.890816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.890842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.890956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.891041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.891068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.891176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.891331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.891359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.891489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.891574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.891600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.891713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.891803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.891833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.891979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.892102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.892130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.892287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.892400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.892426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.892512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.892628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.892671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.892763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.892901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.892928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-16 17:06:25.893007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.893083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-16 17:06:25.893109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.893270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.893417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.893446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.893591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.893692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.893734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.893848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.893937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.893963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.894050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.894158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.894195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.894303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.894383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.894414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.894525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.894636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.894668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.894750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.894826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.894852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.895000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.895124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.895150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.895266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.895378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.895405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.895529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.895666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.895693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.895807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.895918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.895961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.896095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.896216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.896242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.896334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.896410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.896452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.896553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.896651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.896681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.896788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.896859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.896885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.897004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.897089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.897114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.897195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.897312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.897338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.897421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.897561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.897588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.897714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.897789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.897815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.897924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.898030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.898055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.898172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.898281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.898307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.898424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.898560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.898586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.898718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.898802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.898828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.898911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.899020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.899046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.899175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.899300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.899331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.899452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.899584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.899610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.899729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.899846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.899872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.900006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.900134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.900162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.900286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.900410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.900438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.900580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.900697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.900724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.900836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.900947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.900973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.901084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.901222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.901248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.901374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.901461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.901487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.901665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.901785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.901812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.901932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.902017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.902043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.902123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.902243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.902269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.902343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.902474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.902500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.902582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.902699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.902726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.902824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.902936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.902963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.903078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.903161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.903187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.903299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.903382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.903408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.903484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.903570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.903596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.903700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.903803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.903829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.903942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.904045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.904071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.904166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.904247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.904274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.904353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.904473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.904505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.904613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.904708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.904734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.904841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.904930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.904956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.905097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.905235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.905261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.905371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.905477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.905503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.905634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.905777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.905803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.905905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.906048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-16 17:06:25.906085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-16 17:06:25.906204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.906296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.906324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.906456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.906537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.906563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.906686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.906829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.906855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.906980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.907095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.907120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.907243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.907326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.907352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.907440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.907614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.907648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.907788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.907897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.907926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.908070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.908194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.908220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.908316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.908395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.908421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.908556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.908688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.908717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.908853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.908971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.908997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.909107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.909218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.909246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.909338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.909461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.909489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.909631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.909730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.909756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.909882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.909988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.910015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.910128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.910202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.910227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.910340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.910463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.910490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.910603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.910714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.910740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.910831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.910910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.910938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.911033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.911173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.911199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.911272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.911380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.911408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.911500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.911586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.911626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.911751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.911856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.911892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.911977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.912060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.912086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.912175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.912315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.912341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.912420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.912527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.912556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.912704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.912818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.912844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.912926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.913014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.913040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.913121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.913233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.913260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.913339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.913420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.913447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.913525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.913640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.913677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.913791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.913872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.913898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.914003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.914108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.914134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.914249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.914366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.914392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.914486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.914604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.914642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.914795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.914878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.914904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.915012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.915150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.915179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.915319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.915430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.915456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.915544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.915657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.915688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.915767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.915894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.915920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.916001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.916112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.916137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.916244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.916359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.916384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.916458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.916567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.916592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.916700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.916778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.916805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.916926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.917008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.917033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.917144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.917231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.917257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.917341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.917452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.917478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.917558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.917704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.917734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.917824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.917949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.917977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.918095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.918182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.918208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.918325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.918427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.918451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.918588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.918704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.918730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.918875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.918987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.919013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.919086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.919189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.919215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-16 17:06:25.919354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.919443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-16 17:06:25.919469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.919585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.919710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.919736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.919854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.919956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.919983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.920061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.920146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.920172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.920257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.920338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.920363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.920481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.920605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.920640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.920736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.920812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.920838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.920942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.921023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.921049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.921165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.921240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.921265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.921339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.921449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.921476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.921590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.921697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.921724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.921832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.921965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.921994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.922114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.922199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.922226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.922303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.922410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.922435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.922540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.922650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.922685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.922802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.922882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.922907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.922994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.923082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.923109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.923224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.923308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.923334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.923450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.923561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.923586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.923708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.923793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.923818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.923959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.924056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.924084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.924200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.924323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.924352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.924478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.924562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.924588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.924737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.924888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.924917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.925057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.925147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.925175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.925316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.925427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.925453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.925588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.925703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.925734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.925824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.925927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.925955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.926059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.926168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.926193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.926282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.926433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.926461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.926610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.926745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.926774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.926877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.927015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.927045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.927152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.927266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.927292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.927410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.927525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.927551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.927654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.927750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.927776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.927865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.927981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.928006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.928121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.928202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.928228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.928336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.928409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.928435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.928561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.928670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.928699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.928821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.928920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.928949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.929053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.929163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.929189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.929297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.929401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.929430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-16 17:06:25.929527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.929651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-16 17:06:25.929692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.929804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.929888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.929913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.929994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.930103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.930130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.930213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.930302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.930339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.930443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.930526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.930552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.930640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.930753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.930778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.930896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.931005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.931031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.931104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.931188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.931215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.931355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.931446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.931474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.931555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.931664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.931691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.931800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.931898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.931923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.932020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.932132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.932175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.932256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.932337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.932363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.932478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.932560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.932587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.932706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.932815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.932844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.933000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.933131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.933157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.933279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.933369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.933395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.933534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.933623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.933650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.933747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.933851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.933880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.934016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.934135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.934161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.934250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.934364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.934390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.934471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.934584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.934611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.934703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.934822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.934848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.934951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.935116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.935145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.935270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.935381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.935411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.935521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.935646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.935682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.935770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.935849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.935886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.935963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.936076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.936101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.936242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.936374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.936400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.936483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.936568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.936594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.936735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.936823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.936849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.936961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.937064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.937090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.937174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.937309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.937334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.937415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.937497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.937522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.937634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.937719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.937745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.937823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.937946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.937972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.938078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.938155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.938181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.938294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.938403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.938429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.938520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.938609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.938645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.938728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.938842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.938880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.938968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.939082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.939112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.939225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.939310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.939336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.939447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.939563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-16 17:06:25.939589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-16 17:06:25.939738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.939825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.939851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.939944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.940077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.940103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.940192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.940267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.940292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.940403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.940476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.940502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.940642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.940756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.940781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.940862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.940955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.940981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.941102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.941220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.941246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.941333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.941448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.941474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.941591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.941680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.941706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.941819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.941907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.941934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.942016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.942120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.942146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.942233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.942345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.942372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.942486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.942599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.942632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.942779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.942903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.942929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.943067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.943144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.943171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.943296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.943403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.943429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.943519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.943635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.943670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.943800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.943936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.943962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.944083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.944198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.944223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.944320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.944432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.944458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.944567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.944674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.944701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.944815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.944897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.944923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.945076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.945182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.945208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.945291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.945403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.945429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.945533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.945638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.945672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.945783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.945874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.945900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.946008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.946117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.946142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.946257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.946359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.946385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.946491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.946610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.946644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.946784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.946860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.946891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.946967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.947054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.947080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.947220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.947329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.947354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.947440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.947545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.947570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.947673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.947753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.947779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.947866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.947981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.948006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.948162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.948260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.948288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.948421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.948559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.948585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.948723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.948839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.948866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.949007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.949096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.949125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.949235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.949307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.949333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.949444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.949551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.949593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.949708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.949797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.949826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.949994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.950131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.950157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.950266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.950376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.950403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.950563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.950693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.950722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.950831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.950917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.950943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.951027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.951096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.951123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.951283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.951406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.951434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.951544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.951666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.951697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.951829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.951916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.951945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.952037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.952161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.952189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.952291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.952367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.952394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.952477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.952611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.952647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.952769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.952851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.952886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.953000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.953079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.953105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.953195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.953272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.953298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.953378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.953458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.953484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.953602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.953722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.953749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.953836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.953986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.954012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.954125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.954206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.954231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.954354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.954429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.954455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.954533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.954644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.954676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.954785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.954871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.954897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-16 17:06:25.955008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.955095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-16 17:06:25.955121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.955256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.955375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.955418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.955533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.955646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.955684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.955761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.955839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.955877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.955999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.956118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.956146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.956331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.956438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.956464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.956561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.956665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.956691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.956778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.956869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.956902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.957014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.957087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.957114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.957222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.957328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.957354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.957465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.957570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.957596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.957694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.957804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.957831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.957984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.958124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.958167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.958300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.958440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.958465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.958582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.958700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.958731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.958816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.958909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.958935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.959029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.959120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.959146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.959235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.959321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.959347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.959454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.959564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.959590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.959683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.959818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.959844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.959931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.960042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.960067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.960179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.960292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.960318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.960390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.960493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.960519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.960597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.960691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.960718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.960835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.960941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.960967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.961075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.961190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.961216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.961338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.961416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.961450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.961548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.961688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.961715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.961833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.961978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.962004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.962119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.962254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.962283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.962443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.962596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.962654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.962748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.962836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.962862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.962945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.963054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.963080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.963217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.963329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.963355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.963467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.963579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.963606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.963726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.963841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.963868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.963981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.964072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.964097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.964229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.964365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.964395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.964500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.964638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.964665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.964745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.964853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.964879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.964963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.965043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.965068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.965149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.965227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.965253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.965336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.965450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.965476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.965570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.965652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.965679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.965787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.965897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.965923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.966040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.966120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.966147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.966291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.966396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.966422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.966542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.966629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.966656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.966770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.966890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.966916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.967003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.967108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.967134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.967277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.967366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.967391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.967466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.967542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.967567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.967679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.967810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.967838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-16 17:06:25.967924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-16 17:06:25.968038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.968067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.968197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.968324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.968350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.968466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.968550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.968576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.968661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.968772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.968798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.968931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.969065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.969097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.969275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.969418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.969465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.969651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.969763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.969790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.969868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.969967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.969998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.970098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.970246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.970273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.970388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.970471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.970498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.970588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.970684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.970712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.970800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.970942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.970970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.971086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.971224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.971250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.971375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.971488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.971515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.971639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.971728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.971755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.971843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.971986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.972014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.972122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.972231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.972258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.972347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.972431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.972456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.972535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.972645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.972673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.972792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.972872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.972899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.972978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.973072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.973099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.973212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.973328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.973354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.973466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.973603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.973639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.973759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.973844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.973871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.973982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.974096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.974122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.974203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.974353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.974380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.974461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.974542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.974568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.974709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.974860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.974887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.974979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.975056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.975082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.975201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.975345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.975372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.975456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.975578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.975606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.975706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.975817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.975844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.975957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.976070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.976097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.976242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.976318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.976348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.976466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.976554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.976582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.976715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.976826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.976853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.976963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.977073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.977099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.977189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.977264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.977291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.977368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.977476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.977503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.977628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.977719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.977746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-16 17:06:25.977841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.977956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-16 17:06:25.977982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.631 [2024-11-16 17:06:25.978094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.978214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.978241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.631 qpair failed and we were unable to recover it. 00:30:40.631 [2024-11-16 17:06:25.978357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.978474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.978499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.631 qpair failed and we were unable to recover it. 00:30:40.631 [2024-11-16 17:06:25.978584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.978707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.978735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.631 qpair failed and we were unable to recover it. 00:30:40.631 [2024-11-16 17:06:25.978857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.978976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.979005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.631 qpair failed and we were unable to recover it. 00:30:40.631 [2024-11-16 17:06:25.979155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.979245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.979271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.631 qpair failed and we were unable to recover it. 00:30:40.631 [2024-11-16 17:06:25.979349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.979432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.979459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.631 qpair failed and we were unable to recover it. 00:30:40.631 [2024-11-16 17:06:25.979558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.979650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.979679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.631 qpair failed and we were unable to recover it. 00:30:40.631 [2024-11-16 17:06:25.979763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.979914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.979942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.631 qpair failed and we were unable to recover it. 00:30:40.631 [2024-11-16 17:06:25.980026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.980137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.980163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.631 qpair failed and we were unable to recover it. 00:30:40.631 [2024-11-16 17:06:25.980252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.980337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.980364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.631 qpair failed and we were unable to recover it. 00:30:40.631 [2024-11-16 17:06:25.980483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.980568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.980595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.631 qpair failed and we were unable to recover it. 00:30:40.631 [2024-11-16 17:06:25.980707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.980803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.980832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.631 qpair failed and we were unable to recover it. 00:30:40.631 [2024-11-16 17:06:25.980922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.981037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.981063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.631 qpair failed and we were unable to recover it. 00:30:40.631 [2024-11-16 17:06:25.981170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.981280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.631 [2024-11-16 17:06:25.981312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.981429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.981516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.981544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.981650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.981788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.981814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.981924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.982041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.982070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.982175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.982303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.982329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.982473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.982588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.982639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.982748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.982876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.982903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.983013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.983141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.983170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.983294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.983414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.983457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.983603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.983698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.983725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.983841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.983922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.983951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.984054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.984201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.984230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.984323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.984433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.984460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.984577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.984738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.984766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.984861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.984949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.984993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.985094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.985190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.985218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.985311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.985398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.985427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.985525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.985661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.985689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.985805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.985919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.985945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.986049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.986145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.986173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.986268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.986384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.986413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.986539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.986627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.986671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.986753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.986825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.986851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.986943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.987051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.987077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.987163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.987300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.987326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.987414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.987528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.987556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.987649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.987777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.987804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.987977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.988066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.988095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.988242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.988352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.988378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.988486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.988600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.988638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.988770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.988889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.988915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.989061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.989269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.989320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.632 qpair failed and we were unable to recover it. 00:30:40.632 [2024-11-16 17:06:25.989444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.632 [2024-11-16 17:06:25.989572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.989599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.989724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.989807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.989834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.989954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.990070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.990098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.990186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.990299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.990325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.990408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.990520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.990547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.990662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.990801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.990828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.990951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.991033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.991059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.991140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.991217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.991243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.991332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.991411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.991437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.991546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.991675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.991705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.991800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.991884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.991913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.992026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.992148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.992179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.992299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.992388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.992417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.992504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.992633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.992677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.992785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.992868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.992897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.993047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.993146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.993174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.993260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.993377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.993406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.993572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.993695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.993723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.993836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.993944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.993975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.994081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.994221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.994267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.994384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.994502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.994532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.994641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.994755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.994783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.994870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.994985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.995012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.995149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.995273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.995299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.995413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.995487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.995513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.995592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.995710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.995738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.995831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.995924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.995953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.996076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.996166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.996194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.996280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.996419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.996446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.996536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.996624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.996656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.996746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.996836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.996880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.996973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.997058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.997087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.997178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.997300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.997329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.997455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.997537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.997565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.997739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.997830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.997855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.997984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.998064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.998093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.998189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.998270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.998300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.633 qpair failed and we were unable to recover it. 00:30:40.633 [2024-11-16 17:06:25.998389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.998505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.633 [2024-11-16 17:06:25.998549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:25.998633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:25.998748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:25.998774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:25.998935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:25.999022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:25.999051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:25.999182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:25.999275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:25.999317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:25.999455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:25.999577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:25.999611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:25.999730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:25.999810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:25.999837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:25.999917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.000035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.000061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.000198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.000287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.000316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.000443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.000538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.000564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.000679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.000755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.000781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.000889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.001017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.001046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.001141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.001262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.001291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.001396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.001521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.001550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.001714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.001799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.001826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.001939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.002099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.002128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.002256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.002347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.002376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.002496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.002626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.002656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.002758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.002841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.002867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.002948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.003040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.003070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.003190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.003339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.003368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.003475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.003557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.003586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.003696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.003808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.003835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.003994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.004118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.004147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.004275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.004389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.004418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.004509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.004606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.004660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.004802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.004883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.004926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.005033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.005156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.005185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.005314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.005411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.005439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.005532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.005650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.005678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.005795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.005901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.005931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.006047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.006196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.006224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.006392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.006508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.006537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.006674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.006789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.006816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.006957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.007046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.007074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.007236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.007339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.007369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.007464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.007552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.007582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.007692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.007837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.007863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.007972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.008046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.008072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.634 qpair failed and we were unable to recover it. 00:30:40.634 [2024-11-16 17:06:26.008186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.008268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.634 [2024-11-16 17:06:26.008294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.008402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.008519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.008563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.008649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.008732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.008758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.008872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.008952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.008994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.009083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.009210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.009239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.009362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.009471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.009501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.009638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.009749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.009774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.009854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.009925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.009966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.010071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.010191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.010220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.010334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.010487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.010516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.010667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.010792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.010822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.010957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.011055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.011085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.011175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.011302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.011333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.011453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.011580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.011629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.011732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.011853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.011879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.012016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.012143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.012171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.012263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.012419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.012448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.012587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.012680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.012719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.012814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.012917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.012946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.013100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.013233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.013261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.013356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.013519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.013548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.013706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.013835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.013873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.014035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.014155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.014184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.014338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.014420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.014447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.014527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.014676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.014703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.014845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.014981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.015010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.015157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.015246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.015272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.015399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.015552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.015581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.015689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.015784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.015817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.015963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.016066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.016094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.016234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.016392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.016421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.635 [2024-11-16 17:06:26.016552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.016681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.635 [2024-11-16 17:06:26.016709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.635 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.016819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.016926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.016952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.017057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.017146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.017176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.017310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.017437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.017466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.017575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.017731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.017758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.017847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.017929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.017955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.018075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.018160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.018187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.018298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.018376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.018402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.018520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.018629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.018674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.018809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.018948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.018974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.019088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.019176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.019202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.019321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.019459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.019486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.019603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.019722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.019749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.019834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.019919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.019947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.020021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.020102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.020129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.020249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.020334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.020361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.020474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.020584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.020610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.020711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.020821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.020847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.020924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.021034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.021077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.021185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.021303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.021329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.021441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.021557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.021583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.021741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.021825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.021851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.021971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.022081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.022107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.022232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.022324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.022353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.022471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.022588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.022627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.022741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.022858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.022885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.022980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.023087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.023116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.023236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.023316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.023345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.023442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.023536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.023563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.023676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.023787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.023814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.023963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.024048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.024074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.024189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.024275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.024301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.024437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.024605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.024642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.024770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.024847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.024873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.024982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.025093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.025118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.025215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.025335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.025364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.025459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.025550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.025579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.025733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.025818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.025844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-16 17:06:26.025949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.026029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-16 17:06:26.026058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.026184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.026282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.026311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.026441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.026513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.026539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.026636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.026732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.026759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.026882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.027016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.027044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.027139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.027219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.027245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.027339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.027452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.027478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.027587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.027689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.027720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.027861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.027972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.027998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.028131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.028253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.028282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.028408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.028542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.028568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.028659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.028771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.028797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.028956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.029053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.029084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.029244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.029363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.029390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.029530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.029654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.029682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.029786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.029908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.029937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.030049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.030172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.030201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.030309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.030421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.030448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.030614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.030745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.030771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.030854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.030960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.030987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.031103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.031241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.031267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.031416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.031513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.031542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.031654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.031749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.031777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.031940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.032061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.032087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.032224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.032338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.032367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.032484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.032587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.032626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.032790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.032877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.032904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.033012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.033143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.033172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.033270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.033357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.033387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.033493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.033640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.033667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.033805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.033917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.033943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.034058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.034165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.034191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.034270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.034373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.034399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.034541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.034683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.034713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.034834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.034953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.034984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.035121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.035234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.035261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.035368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.035449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.035478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.035593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.035696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.035726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-16 17:06:26.035837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.035947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-16 17:06:26.035973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.036062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.036213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.036242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.036359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.036488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.036516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.036661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.036780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.036806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.036920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.037051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.037095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.037181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.037319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.037345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.037438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.037529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.037556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.037635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.037750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.037776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.037864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.037967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.037996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.038134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.038243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.038270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.038369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.038518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.038554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.038682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.038799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.038827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.038967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.039103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.039129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.039261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.039391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.039419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.039544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.039666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.039696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.039861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.039997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.040023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.040115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.040235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.040264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.040362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.040451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.040482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.040614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.040738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.040764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.040905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.040992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.041018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.041128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.041270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.041299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.041415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.041504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.041530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.041631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.041760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.041789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.041885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.041968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.041997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.042140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.042281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.042307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.042441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.042592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.042641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.042725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.042838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.042864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.043007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.043119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.043145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.043224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.043334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.043361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.043440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.043514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.043540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.043625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.043765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.043791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.043919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.044074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.044103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.044253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.044400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.044429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.044556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.044668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.044697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.044805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.044928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.044957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-16 17:06:26.045070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-16 17:06:26.045172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.045201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.045333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.045411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.045437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.045525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.045638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.045665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.045800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.045905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.045934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.046102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.046182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.046208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.046338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.046451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.046481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.046605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.046699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.046730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.046828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.046945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.046971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.047088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.047167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.047192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.047279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.047429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.047455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.047567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.047661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.047689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.047822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.047958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.047987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.048139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.048227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.048256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.048355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.048469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.048495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.048629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.048768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.048794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.048904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.049030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.049059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.049166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.049282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.049309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.049414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.049579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.049608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.049747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.049859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.049888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.050022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.050130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.050156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.050295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.050384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.050413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.050544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.050657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.050685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.050825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.050966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.050993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.051099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.051180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.051206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.051320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.051403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.051429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.051505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.051607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.051639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.051716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.051820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.051850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.051929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.052056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.052085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.052240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.052344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.052370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.052510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.052598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.052631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.052724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.052800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.052826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.052936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.053077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.053103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.053221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.053309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.053336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.053425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.053532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.053558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.053645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.053784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.053810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.053892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.053965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.053991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.054082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.054229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.054255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.054366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.054478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.054504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-16 17:06:26.054637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.054724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-16 17:06:26.054753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.054883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.054973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.055003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.055108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.055223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.055248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.055412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.055565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.055594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.055723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.055877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.055906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.056007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.056146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.056172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.056301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.056458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.056487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.056613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.056742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.056771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.056928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.057016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.057042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.057177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.057312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.057338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.057457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.057555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.057583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.057724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.057870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.057896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.058036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.058182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.058211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.058328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.058422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.058453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.058583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.058677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.058703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.058845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.058972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.059002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.059119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.059267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.059293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.059434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.059548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.059574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.059712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.059821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.059847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.059935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.060049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.060075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.060227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.060345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.060370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.060485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.060595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.060628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.060724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.060803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.060831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.060942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.061052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.061078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.061247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.061371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.061400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.061499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.061628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.061658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.061821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.061932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.061957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.062050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.062177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.062206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.062365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.062510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.062535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.062672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.062799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.062825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.063003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.063139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.063164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.063260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.063391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.063420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.063556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.063667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.063695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.063858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.064034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.064060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.064183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.064321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.064347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.064491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.064606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.064638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.064753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.064871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.064898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.065021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.065140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.065170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-16 17:06:26.065308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.065391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-16 17:06:26.065416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.065552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.065656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.065692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.065818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.065943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.065972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.066107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.066246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.066272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.066402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.066530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.066555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.066669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.066812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.066837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.066917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.067028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.067054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.067194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.067306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.067331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.067442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.067550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.067576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.067694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.067837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.067863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.068002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.068095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.068125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.068247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.068328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.068356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.068494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.068581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.068607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.068696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.068808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.068834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.068914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.069053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.069083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.069205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.069322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.069348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.069450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.069565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.069594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.069773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.069925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.069954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.070092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.070213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.070239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.070339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.070461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.070490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.070644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.070766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.070794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.070906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.071023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.071048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.071191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.071302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.071327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.071477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.071572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.071600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.071736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.071850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.071875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.071993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.072129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.072155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.072317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.072448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.072477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.072596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.072712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.072739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.072850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.072931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.072956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.073089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.073201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.073229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.073380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.073514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.073540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.073681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.073781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.073811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.073909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.073994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.074024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.074154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.074263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.074289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.074468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.074610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.074645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.074815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.074951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.074977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.075116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.075198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.075223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.075344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.075432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.075474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.075594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.075699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.075728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-16 17:06:26.075838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-16 17:06:26.075973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.076000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.076143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.076248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.076276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.076418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.076528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.076555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.076667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.076779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.076809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.076950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.077039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.077066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.077195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.077341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.077368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.077534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.077676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.077718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.077855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.078010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.078056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.078199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.078304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.078333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.078462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.078604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.078638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.078804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.078895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.078923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.079045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.079181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.079207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.079295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.079432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.079457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.079540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.079683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.079710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.079833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.079905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.079946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.080094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.080206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.080233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.080371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.080493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.080522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.080665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.080804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.080830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.080940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.081027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.081053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.081168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.081250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.081277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.081384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.081508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.081538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.081701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.081791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.081817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.081969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.082083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.082112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.082268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.082376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.082413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.082562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.082674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.082700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.082868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.082991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.083020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.083136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.083286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.083313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.083450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.083531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.083556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.083669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.083831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.083857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.084002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.084165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.084194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.084333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.084444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.084470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.084597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.084774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.084800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.084960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.085093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.085119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.085259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.085396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.085422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.085591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.085722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.085752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-16 17:06:26.085845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-16 17:06:26.085946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.085970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.086082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.086220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.086246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.086368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.086487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.086530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.086678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.086767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.086792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.086902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.087020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.087045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.087184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.087311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.087340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.087489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.087640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.087669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.087807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.087921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.087946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.088055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.088161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.088189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.088330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.088476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.088514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.088652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.088747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.088772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.088888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.088996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.089023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.089132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.089212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.089238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.089392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.089527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.089553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.089679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.089835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.089861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.089949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.090087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.090116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.090272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.090386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.090412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.090575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.090667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.090696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.090795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.090908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.090937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.091038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.091141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.091171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.091298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.091423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.091452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.091575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.091706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.091736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.091848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.091986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.092019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.092131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.092251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.092279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.092405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.092526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.092555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.092656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.092769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.092796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.092886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.093058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.093084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.093196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.093330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.093359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.093486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.093609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.093681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.093880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.094000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.094039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.094185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.094342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.094369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.094527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.094646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.094673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.094788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.094948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.094976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.095071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.095218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.095246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.095368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.095506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.095531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.095654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.095761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.095786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.095918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.096011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.096039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.096175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.096313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.096338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-16 17:06:26.096415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.096533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-16 17:06:26.096558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.096674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.096762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.096788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.096873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.096984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.097011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.097096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.097208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.097234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.097366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.097485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.097513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.097632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.097719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.097744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.097857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.097946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.097974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.098092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.098187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.098230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.098305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.098411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.098437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.098552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.098659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.098685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.098776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.098929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.098955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.099079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.099219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.099245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.099353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.099469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.099497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.099613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.099752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.099781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.099877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.099950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.099976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.100084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.100246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.100275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.100382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.100486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.100511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.100625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.100719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.100745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.100859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.100991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.101033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.101171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.101278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.101303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.101448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.101568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.101597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.101722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.101824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.101852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.101993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.102082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.102108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.102195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.102312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.102338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.102420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.102494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.102519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.102664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.102795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.102821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.102931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.103044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.103070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.103147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.103255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.103281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.103388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.103497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.103523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.103604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.103709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.103734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.103856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.103990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.104018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.104150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.104249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.104276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.104421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.104556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.104586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.104687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.104778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.104803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.104920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.105034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.105062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.105156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.105282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.105309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.105422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.105540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.105568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.105657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.105788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.105813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.105890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.105992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-16 17:06:26.106020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-16 17:06:26.106133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.106236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.106265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.106376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.106479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.106507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.106596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.106740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.106766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.106878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.106957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.106982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.107088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.107222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.107248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.107363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.107489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.107518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.107634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.107745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.107770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.107861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.107996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.108022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.108164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.108246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.108274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.108377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.108463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.108492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.108589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.108671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.108697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.108780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.108887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.108912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.109050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.109227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.109271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.109453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.109569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.109597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.109723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.109797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.109822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.109922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.110030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.110058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.110208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.110286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.110314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.110439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.110559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.110588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.110732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.110860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.110890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.111033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.111136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.111164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.111317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.111435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.111463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.111571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.111667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.111694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.111784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.111863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.111913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.112032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.112124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.112153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.112258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.112388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.112418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.112560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.112733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.112766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.112905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.113087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.113131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.113237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.113363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.113390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.113479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.113572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.113600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.113720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.113818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.113848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.113946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.114072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.114103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.114248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.114387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.114413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.114557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.114682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.114709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.114833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.114952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.114979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-16 17:06:26.115090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.115174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-16 17:06:26.115201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.115299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.115451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.115480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.115631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.115765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.115792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.115906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.116010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.116036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.116169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.116296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.116327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.116483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.116581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.116610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.116755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.116842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.116870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.116989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.117109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.117135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.117255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.117365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.117408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.117507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.117644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.117671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.117767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.117854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.117880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.117980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.118103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.118134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.118261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.118389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.118418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.118513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.118633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.118669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.118791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.118897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.118923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.119037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.119149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.119175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.119308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.119445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.119474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.119664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.119747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.119774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.119887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.119995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.120022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.120159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.120279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.120309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.120431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.120587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.120630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.120771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.120854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.120892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.120976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.121146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.121176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.121327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.121430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.121459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.121585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.121710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.121737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.121851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.121940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.121967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.122104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.122210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.122237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.122353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.122490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.122517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.122635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.122765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.122791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.122886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.122980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.123025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.123184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.123270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.123306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.123431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.123559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.123589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.123723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.123849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.123890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.124039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.124200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.124226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.124392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.124508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.124536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.124631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.124778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.124804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.124956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.125155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.125225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.125400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.125557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.125585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-16 17:06:26.125765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.125852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-16 17:06:26.125879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.126097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.126264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.126299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.126506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.126629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.126686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.126770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.126874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.126918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.127054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.127235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.127286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.127457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.127569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.127606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.127764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.127849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.127887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.128028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.128148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.128177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.128347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.128501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.128529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.128701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.128811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.128836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.128972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.129102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.129128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.129244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.129357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.129387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.129472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.129585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.129623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.129717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.129824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.129850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.129938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.130082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.130108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.130240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.130361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.130390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.130513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.130608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.130655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.130783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.130868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.130894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.131027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.131118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.131147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.131300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.131410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.131438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.131588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.131724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.131751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.131841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.131958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.131983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.132065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.132203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.132232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.132336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.132416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.132446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.132598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.132760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.132804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.132919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.133002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.133030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.133175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.133281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.133306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.133442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.133569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.133604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.133740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.133862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.133890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.134018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.134157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.134183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.134290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.134457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.134483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.134603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.134733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.134760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.134906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.134996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.135021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.135164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.135300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.135326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.135433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.135551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.135580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.135743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.135835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.135872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.135971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.136093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.136121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.136270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.136401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.136429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-16 17:06:26.136566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.136684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-16 17:06:26.136710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.136843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.136989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.137015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.137165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.137288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.137316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.137498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.137582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.137607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.137700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.137815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.137841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.137980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.138129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.138157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.138304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.138450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.138476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.138610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.138725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.138754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.138845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.138968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.139006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.139111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.139219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.139245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.139368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.139493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.139521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.139678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.139785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.139811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.139930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.140020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.140056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.140195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.140290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.140319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.140435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.140586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.140650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.140791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.140945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.140971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.141086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.141253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.141280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.141415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.141565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.141594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.141781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.141868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.141902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.142016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.142166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.142192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.142296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.142441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.142470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.142576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.142725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.142753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.142883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.143055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.143081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.143194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.143318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.143346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.143461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.143568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.143594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.143735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.143874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.143901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.144040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.144172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.144201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.144302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.144384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.144410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.144518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.144669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.144700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.144818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.144942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.144971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.145101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.145250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.145275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.145413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.145510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.145540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.145672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.145799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.145827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.145990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.146123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.146149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.146282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.146404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.146446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.146592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.146767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.146797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.146927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.147044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.147071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.147192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.147328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.147357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-16 17:06:26.147445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.147552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-16 17:06:26.147578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.147694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.147808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.147835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.147928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.148042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.148085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.148232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.148318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.148344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.148462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.148546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.148572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.148686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.148814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.148843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.148965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.149128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.149157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.149333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.149450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.149476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.149612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.149738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.149767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.149905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.150023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.150061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.150161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.150277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.150302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.150383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.150491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.150518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.150659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.150740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.150783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.150892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.151033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.151059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.151155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.151259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.151288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.151407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.151534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.151563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.151727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.151842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.151879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.152054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.152175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.152204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.152341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.152499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.152540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.152703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.152827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.152853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.153006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.153087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.153130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.153297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.153402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.153428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.153520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.153627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.153665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.153787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.153941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.153968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.154087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.154221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.154247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.154340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.154472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.154498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.154608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.154724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.154751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.154840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.154995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.155020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.155162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.155282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.155309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.155468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.155604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.155639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.155760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.155841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.155878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.156019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.156101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.156127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.156281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.156401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.156438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.156564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.156651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.156689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.156778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.156951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.156977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-16 17:06:26.157086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-16 17:06:26.157214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.157257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.157374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.157485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.157510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.157590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.157716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.157743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.157872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.158053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.158079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.158203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.158323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.158351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.158482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.158591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.158624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.158718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.158808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.158834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.158926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.159063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.159091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.159225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.159333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.159359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.159449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.159572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.159601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.159734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.159858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.159893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.160048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.160163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.160189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.160299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.160459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.160488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.160625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.160745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.160774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.160915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.161008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.161034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.161177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.161259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.161288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.161426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.161513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.161540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.161666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.161778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.161804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.161918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.162051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.162083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.162238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.162369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.162395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.162533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.162643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.162673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.162819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.162948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.162981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.163084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.163180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.163211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.163350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.163492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.163518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.163682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.163817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.163844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.163947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.164031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.164059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.164195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.164314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.164340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.164481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.164569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.164613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.164750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.164912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.164941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.165055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.165174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.165201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.165288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.165422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.165464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.165559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.165677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.165703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.165848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.165947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.165977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.166098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.166232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.166262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.166397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.166547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.166576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.166706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.166797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.166825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.166996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.167134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.167163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-16 17:06:26.167288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.167428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-16 17:06:26.167454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.167589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.167736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.167763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.167880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.167962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.167988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.168101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.168225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.168256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.168417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.168510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.168536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.168673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.168802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.168836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.168963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.169110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.169139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.169250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.169335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.169370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.169454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.169544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.169570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.169697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.169832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.169858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.169973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.170061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.170088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.170220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.170365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.170403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.170534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.170670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.170701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.170810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.170922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.170956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.171083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.171234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.171263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.171391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.171538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.171571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.171745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.171862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.171897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.172062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.172166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.172195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.172335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.172497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.172523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.172606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.172743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.172769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.172885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.172990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.173018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.173109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.173260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.173289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.173428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.173537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.173563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.173686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.173801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.173827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.173961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.174112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.174141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.174274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.174389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.174415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.174555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.174711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.174740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.174864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.175026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.175067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.175155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.175262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.175288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.175395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.175486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.175512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.175631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.175731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.175757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.175866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.175976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.176002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.176125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.176246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.176275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.176394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.176523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.176549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.176636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.176727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.176753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.176886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.177020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.177045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.177131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.177299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.177327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.177420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.177539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.177565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-16 17:06:26.177675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.177761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-16 17:06:26.177787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.177897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.177983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.178009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.178123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.178240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.178267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.178422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.178555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.178584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.178744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.178879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.178905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.178991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.179101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.179128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.179242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.179356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.179381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.179526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.179630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.179670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.179787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.179912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.179938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.180098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.180193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.180221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.180354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.180437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.180462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.180577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.180728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.180755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.180885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.181049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.181077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.181177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.181302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.181328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.181443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.181560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.181586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.181707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.181790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.181818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.181974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.182129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.182158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.182298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.182410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.182436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.182581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.182710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.182737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.182873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.182995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.183023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.183180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.183289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.183314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.183462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.183594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.183632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.183769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.183898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.183926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.184037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.184117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.184143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.184289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.184391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.184417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.184500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.184579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.184606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.184729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.184841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.184868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.185001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.185098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.185142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.185260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.185374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.185400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.185534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.185644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.185681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.185795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.185920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.185962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.186108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.186239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.186267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.186359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.186477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.186505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.186658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.186747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.186775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.186940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.187053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-16 17:06:26.187082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-16 17:06:26.187180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.187330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.187358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.187466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.187591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.187627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.187793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.187904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.187930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.188036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.188154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.188183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.188280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.188413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.188439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.188592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.188739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.188765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.188879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.188992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.189018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.189130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.189208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.189234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.189321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.189447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.189476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.189611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.189764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.189789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.189909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.190051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.190076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.190213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.190375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.190401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.190523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.190641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.190679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.190794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.190913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.190939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.191084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.191197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.191223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.191326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.191446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.191474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.191591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.191726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.191753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.191833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.191947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.191989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.192117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.192233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.192259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.192341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.192463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.192493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.192625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.192763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.192792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.192927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.193065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.193091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.193205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.193276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.193303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.193392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.193502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.193528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.193646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.193818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.193847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.194004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.194116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.194145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.194308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.194420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.194446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.194574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.194712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.194741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.194902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.195046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.195071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.195221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.195337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.195363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.195506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.195601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.195637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.195756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.195840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.195896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.196046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.196143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.196173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.196293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.196421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.196450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.196572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.196664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.196691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.196795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.196918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.196946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.197044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.197138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.197172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-16 17:06:26.197271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.197414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-16 17:06:26.197440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.197523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.197634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.197661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.197772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.197864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.197891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.198023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.198174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.198203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.198327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.198449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.198492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.198604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.198749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.198775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.198943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.199075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.199104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.199191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.199322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.199348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.199467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.199548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.199592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.199742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.199822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.199847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.199955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.200077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.200112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.200199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.200320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.200349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.200508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.200657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.200696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.200807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.200926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.200951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.201087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.201245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.201273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.201386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.201511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.201540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.201662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.201815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.201844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.202014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.202092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.202120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.202236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.202385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.202411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.202547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.202671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.202701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.202816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.202908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.202937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.203059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.203142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.203167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.203317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.203446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.203475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.203595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.203737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.203768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.203909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.204033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.204062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.204177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.204287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.204313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.204472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.204603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.204641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.204775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.204861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.204896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.205013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.205138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.205182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.205330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.205413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.205438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.205550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.205693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.205720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.205850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.205976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.206005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.206095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.206253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.206281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.206387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.206475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.206502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.206644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.206732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.206775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.206891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.207022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.207047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.207122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.207259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.207307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.207427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.207513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.207539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-16 17:06:26.207642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.207769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-16 17:06:26.207799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.207945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.208031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.208059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.208207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.208300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.208328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.208497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.208587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.208613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.208739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.208813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.208839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.208951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.209086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.209117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.209247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.209384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.209410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.209490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.209568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.209595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.209646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa89e00 (9): Bad file descriptor 00:30:40.655 [2024-11-16 17:06:26.209869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.210012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.210044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.210137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.210235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.210261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.210379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.210471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.210499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.210644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.210758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.210785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.210864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.210957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.210983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.211097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.211212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.211239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.211324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.211449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.211482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.211597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.211701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.211728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.211869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.211984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.212010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.212106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.212212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.212238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.212319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.212430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.212456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.212566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.212721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.212749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.212863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.212954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.212981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.213096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.213179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.213206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.213302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.213416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.213443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.213562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.213709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.213736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.213826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.213901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.213928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.214039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.214144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.214170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.214319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.214427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.214454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.214598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.214690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.214716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.214828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.214947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.214974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.215081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.215201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.215237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.215321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.215432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.215459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.215545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.215655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.215683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.215790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.215869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.215896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.216008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.216132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.216159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.216262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.216369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.216395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.216485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.216604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.216639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.216783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.216863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.216890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.217000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.217142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.217168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-16 17:06:26.217279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-16 17:06:26.217389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.217416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.217531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.217607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.217643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.217757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.217877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.217904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.218023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.218136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.218162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.218305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.218394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.218420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.218510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.218665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.218693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.218787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.218902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.218928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.219038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.219154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.219180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.219255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.219367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.219394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.219490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.219577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.219603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.219729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.219842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.219869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.220018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.220097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.220125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.220221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.220303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.220341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.220484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.220599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.220631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.220721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.220803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.220830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.220943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.221019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.221045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.221157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.221231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.221257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.221401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.221555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.221581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.221710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.221816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.221841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.221948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.222095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.222121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.222231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.222372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.222404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.222491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.222570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.222596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.222728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.222842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.222869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.222984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.223131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.223157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.223300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.223404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.223432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.223513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.223605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.223640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.223768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.223843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.223869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.223983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.224126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.224152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.224262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.224336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.224374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.224491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.224605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.224649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.224762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.224906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.224937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.225023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.225169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.225196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.225310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.225426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.225453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.225575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.225708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.225735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.225856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.225972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-16 17:06:26.225998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-16 17:06:26.226105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.226186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.226213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.226304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.226394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.226420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.226537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.226642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.226678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.226820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.226898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.226925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.227065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.227176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.227202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.227317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.227425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.227456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.227572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.227664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.227692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.227809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.227921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.227948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.228093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.228211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.228237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.228325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.228450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.228476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.228591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.228701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.228729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.228880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.229017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.229043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.229184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.229293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.229320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.229411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.229504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.229544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.229676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.229815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.229841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.229980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.230090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.230122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.230203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.230312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.230338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.230458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.230542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.230568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.230684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.230791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.230818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.230940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.231018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.231044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.231182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.231293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.231319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.231433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.231545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.231572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.231704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.231853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.231879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.231993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.232107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.232135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.232219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.232354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.232380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.232467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.232624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.232652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.232771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.232911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.232937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.233047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.233158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.233184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.233300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.233378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.233404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.233530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.233661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.233688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.233796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.233919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.233945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.234038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.234150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.234177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.234298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.234440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.234466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.234574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.234697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.234725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.234850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.234962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.234988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.235122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.235232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.235258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.235401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.235481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.235514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-16 17:06:26.235630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.235777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-16 17:06:26.235803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.235930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.236049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.236076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.236215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.236323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.236349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.236430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.236547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.236573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.236695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.236803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.236829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.236946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.237054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.237081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.237161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.237275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.237302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.237409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.237521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.237548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.237629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.237734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.237761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.237853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.237961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.237988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.238094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.238173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.238203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.238324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.238433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.238459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.238587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.238704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.238732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.238841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.238980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.239007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.239157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.239272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.239299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.239395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.239506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.239533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.239607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.239732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.239760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.239915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.240057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.240084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.240194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.240271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.240298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.240383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.240496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.240523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.240642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.240765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.240792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.240909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.240994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.241021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.241154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.241294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.241321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.241411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.241526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.241553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.241674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.241782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.241808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.241958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.242044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.242072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.242182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.242289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.242316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.242461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.242571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.242598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.242719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.242832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.242858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.243013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.243155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.243182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.243274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.243387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.243413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.243505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.243627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.243655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.243796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.243882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.243909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.244050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.244178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.244205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.244325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.244441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.244467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.244551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.244696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.244723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.244820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.244933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.244959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.245067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.245148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.245175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-16 17:06:26.245328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.245444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-16 17:06:26.245472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.245568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.245678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.245705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.245792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.245909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.245936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.246044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.246159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.246185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.246296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.246372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.246398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.246541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.246658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.246696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.246779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.246893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.246930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.247074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.247186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.247213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.247329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.247434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.247460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.247551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.247667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.247694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.247803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.247915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.247946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.248069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.248190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.248217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.248332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.248408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.248434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.248545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.248627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.248654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.248803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.248882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.248919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.249063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.249200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.249226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.249332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.249410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.249440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.249580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.249676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.249703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.249793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.249908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.249934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.250051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.250136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.250164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.250272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.250383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.250410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.250524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.250688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.250720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.250836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.250956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.250984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.251104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.251211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.251238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.251379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.251458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.251485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.251569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.251656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.251683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.251802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.251911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.251937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.252025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.252138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.252164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.252310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.252386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.252413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.252530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.252651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.252678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.252813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.252886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.252924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.253007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.253100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.253126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.253209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.253324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.253351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.253468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.253544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.253571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.253670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.253775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.253801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-16 17:06:26.253952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-16 17:06:26.254041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.254068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.254148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.254224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.254251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.254337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.254477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.254504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.254591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.254747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.254775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.254891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.255032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.255062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.255181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.255267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.255293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.255405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.255523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.255550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.255641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.255758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.255786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.255864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.255984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.256011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.256086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.256220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.256246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.256357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.256498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.256525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.256644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.256777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.256803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.256886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.256972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.257001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.257119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.257231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.257259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.257373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.257488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.257517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.257633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.257756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.257783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.257905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.257994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.258022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.258136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.258250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.258277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.258414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.258558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.258584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.258725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.258857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.258890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.259010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.259145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.259171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.259288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.259432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.259458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.259575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.259723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.259750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.259845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.259938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.259964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.260047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.260154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.260180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.260264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.260347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.260375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.260502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.260629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.260657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.260742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.260831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.260857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.261011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.261121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.261149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.261292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.261405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.261432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.261541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.261656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.261683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.261791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.261880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.261912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.262000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.262109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.262138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.262230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.262340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.262367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.262455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.262543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.262570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.262719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.262804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.262831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.262914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.263001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.263032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-16 17:06:26.263170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.263260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-16 17:06:26.263288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.263407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.263524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.263550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.263647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.263737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.263764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.263855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.263935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.263961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.264052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.264173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.264199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.264286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.264402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.264428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.264533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.264679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.264707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.264825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.264925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.264951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.265067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.265149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.265175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.265265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.265341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.265371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.265492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.265610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.265642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.265759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.265869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.265896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.266017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.266154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.266179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.266269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.266362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.266388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.266505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.266590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.266625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.266742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.266826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.266854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.266975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.267063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.267092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.267204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.267317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.267343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.267460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.267550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.267578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.267730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.267851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.267904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.268021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.268145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.268172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.268287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.268401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.268430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.268541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.268634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.268661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.268747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.268888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.268915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.269034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.269151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.269177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.269265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.269340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.269366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.269473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.269561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.269587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.269672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.269817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.269843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.269938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.270012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.270038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.270121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.270234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.270264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.270388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.270479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.270507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.270581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.270704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.270732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.270853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.270997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.271023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.271143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.271232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.271259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.271373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.271465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.271492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.271600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.271700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.271727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.271822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.271966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.271993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.272127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.272210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.272238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-16 17:06:26.272385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-16 17:06:26.272465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.272491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.272609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.272729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.272756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.272868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.272977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.273005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.273118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.273261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.273288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.273379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.273471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.273498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.273636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.273752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.273779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.273898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.273985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.274011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.274129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.274246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.274274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.274395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.274534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.274560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.274674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.274756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.274783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.274922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.275003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.275029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.275144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.275260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.275286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.275411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.275499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.275526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.275647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.275754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.275780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.275865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.275953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.275980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.276063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.276209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.276235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.276320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.276412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.276439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.276555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.276662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.276689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.276827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.276912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.276938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.277047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.277182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.277209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.277325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.277437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.277463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.277549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.277645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.277673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.277769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.277881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.277907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.278047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.278123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.278149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.278236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.278324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.278350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.278467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.278555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.278583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.278702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.278819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.278845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.278930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.279036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.279062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.279170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.279260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.279286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.279426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.279513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.279543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.279651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.279760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.279787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.279901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.279981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.280007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.280123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.280215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.280241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.280327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.280413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.280440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.280522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.280602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-16 17:06:26.280638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-16 17:06:26.280729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.280808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.280837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.280985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.281080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.281106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.281191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.281329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.281356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.281465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.281542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.281568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.281689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.281799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.281826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.281944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.282028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.282054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.282168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.282283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.282309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.282394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.282508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.282536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.282684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.282815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.282841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.282957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.283033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.283058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.283202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.283311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.283338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.283430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.283537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.283564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.283685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.283826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.283853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.283969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.284081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.284107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.284226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.284338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.284366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.284481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.284591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.284624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.284739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.284853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.284879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.284999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.285114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.285141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.285255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.285340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.285366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.285481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.285567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.285594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.285704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.285809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.285835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.285924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.286065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.286092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.286181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.286293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.286320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.286412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.286520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.286546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.286658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.286753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.286780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.286868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.286984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.287010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.287098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.287205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.287231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.287350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.287465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.287493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.287601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.287749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.287776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.287866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.287943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.287969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.288111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.288195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.288221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.288331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.288447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.288473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.288622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.288767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.288794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.288896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.289006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.289032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.289125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.289239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.289266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.289380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.289461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.289488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.289582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.289726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.289754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-16 17:06:26.289848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.289940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-16 17:06:26.289967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.290083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.290204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.290234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.290383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.290521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.290548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.290697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.290858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.290884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.290973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.291086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.291113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.291208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.291297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.291323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.291410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.291519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.291545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.291636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.291749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.291776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.291919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.292055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.292082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.292197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.292318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.292346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.292502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.292589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.292623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.292735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.292838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.292865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.292955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.293092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.293118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.293214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.293304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.293331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.293453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.293567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.293594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.293716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.293858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.293885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.293968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.294051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.294077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.294190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.294303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.294330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.294440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.294522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.294549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.294692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.294798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.294829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.294946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.295032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.295059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.295173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.295317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.295343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.295453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.295584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.295611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.295759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.295875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.295903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.296049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.296134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.296161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.296276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.296384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.296410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.296528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.296640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.296671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.296810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.296927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.296955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.297066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.297150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.297177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.297284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.297393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.297419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.297499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.297594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.297629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.297729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.297819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.297848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.297942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.298047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.298073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.298157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.298268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.298293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.298407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.298520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.298547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.298663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.298783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.298809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.298895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.299041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.299069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.299184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.299303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.299332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-16 17:06:26.299449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.299562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-16 17:06:26.299590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.299695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.299834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.299859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.299999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.300114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.300144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.300263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.300379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.300405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.300495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.300609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.300642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.300729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.300810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.300836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.300951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.301059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.301087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.301196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.301280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.301308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.301463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.301577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.301604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.301695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.301807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.301834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.301957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.302039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.302065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.302179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.302323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.302350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.302469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.302560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.302593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.302695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.302816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.302843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.302965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.303061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.303088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.303170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.303255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.303281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.303391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.303499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.303525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.303607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.303788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.303818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.303956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.304067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.304093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.304179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.304332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.304359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.304445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.304552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.304578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.304672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.304756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.304783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.304908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.305020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.305049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.305162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.305252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.305278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.305393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.305506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.305533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.305651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.305765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.305792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.305872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.305954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.305981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.306062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.306173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.306200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.306297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.306413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.306439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.306559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.306670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.306697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.306840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.306951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.306978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.307120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.307235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.307262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.307339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.307424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.307457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.307600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.307745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.307772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.307861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.307974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.308002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.308123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.308266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.308293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.308377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.308527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.308554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.308672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.308766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.308792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-16 17:06:26.308884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.309000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-16 17:06:26.309028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.309119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.309195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.309221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.309328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.309434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.309461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.309573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.309664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.309691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.309801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.309947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.309974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.310092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.310174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.310202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.310294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.310400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.310429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.310573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.310670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.310697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.310784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.310926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.310955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.311102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.311187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.311214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.311352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.311438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.311464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.311573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.311712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.311739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.311854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.311934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.311960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.312068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.312160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.312187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.312302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.312444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.312470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.312624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.312710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.312736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.312849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.312932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.312959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.313070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.313179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.313206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.313293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.313378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.313405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.313519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.313632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.313659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.313781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.313872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.313900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.314037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.314123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.314152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.314295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.314431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.314456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.314574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.314663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.314689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.314810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.314918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.314945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.315094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.315202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.315227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.315338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.315446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.315472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.315564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.315644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.315671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.315762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.315905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.315932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.316047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.316165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.316192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.316274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.316360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.316385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-16 17:06:26.316503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-16 17:06:26.316614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.316649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.316738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.316883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.316911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.317051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.317195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.317222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.317338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.317420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.317446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.317571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.317681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.317711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.317834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.317917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.317944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.318034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.318130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.318158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.318272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.318413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.318439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.318524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.318622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.318648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.318767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.318911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.318935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.319048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.319162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.319187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.319306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.319416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.319440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.319556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.319634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.319659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.319747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.319858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.319884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.319974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.320087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.320112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.320203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.320283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.320307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.320422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.320534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.320558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.320662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.320742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.320767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.320881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.320965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.320989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.321099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.321186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.321212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.321330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.321406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.321434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.321524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.321639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.321665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.321750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.321861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.321886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.322006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.322082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.322107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.322232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.322374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.322400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.322515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.322628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.322653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.322772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.322863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.322889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.323012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.323124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.323152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.323241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.323351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.323377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.323485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.323589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.323624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.323740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.323891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.323920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.324038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.324126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.324153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.324240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.324354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.324381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.324491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.324599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.324636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.324757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.324865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.324892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.325007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.325118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.325143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-16 17:06:26.325236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-16 17:06:26.325350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.325376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.325465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.325583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.325608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.325744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.325832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.325858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.325973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.326059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.326084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.326196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.326289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.326314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.326412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.326520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.326548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.326695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.326809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.326835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.326926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.327039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.327067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.327209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.327301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.327329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.327448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.327537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.327564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.327677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.327787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.327814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.327938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.328023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.328049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.328133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.328216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.328245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.328335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.328451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.328479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.328569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.328693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.328719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.328869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.328980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.329007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.329092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.329172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.329198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.329313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.329396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.329422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.329512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.329634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.329662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.329782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.329892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.329920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.330005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.330146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.330172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.330253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.330335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.330362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.330449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.330554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.330581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.330709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.330793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.330819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.330938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.331021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.331047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.331161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.331245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.331273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.331365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.331439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.331467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.331556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.331647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.331675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.331818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.331910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.331935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.332048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.332126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.332151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.332240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.332314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.332340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.332430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.332570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.332597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.332694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.332813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.332839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.332924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.333034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.333060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.333199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.333278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.333304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.333398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.333485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.333513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.333627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.333759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.333786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.333871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.333961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.333988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.334073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.334162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.334190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.334280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.334385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.334411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-16 17:06:26.334557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-16 17:06:26.334654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.334682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.334826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.334910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.334936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.335049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.335130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.335156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.335276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.335423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.335448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.335545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.335654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.335681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.335820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.335907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.335933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.336051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.336168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.336193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.336301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.336407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.336432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.336549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.336666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.336693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.336830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.336917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.336944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.337034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.337144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.337171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.337281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.337387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.337413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.337518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.337632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.337659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.337770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.337885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.337911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.338000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.338110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.338136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.338254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.338371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.338398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.338510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.338599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.338633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.338716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.338826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.338853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.338932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.339017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.339045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.339135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.339217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.339243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.339359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.339444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.339471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.339554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.339660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.339690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.339807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.339961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.339988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.340075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.340161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.340186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.340271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.340389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.340416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.340503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.340609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.340646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.340793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.340881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.340906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.341050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.341135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.341161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.341277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.341359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.341390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.341533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.341645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.341674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.341769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.341854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.341880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.341968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.342049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.342075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.342193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.342273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.342298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.342385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.342509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.342535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.342674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.342766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.342797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-16 17:06:26.342917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.342997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-16 17:06:26.343024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.343145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.343228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.343256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.343376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.343454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.343478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.343593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.343743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.343776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.343872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.343984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.344011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.344093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.344200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.344227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.344341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.344479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.344506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.344710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.344825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.344853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.344946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.345087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.345114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.345191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.345302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.345327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.345417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.345526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.345552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.345644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.345728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.345752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.345867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.345973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.345999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.346080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.346166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.346194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.346313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.346428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.346454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.346567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.346654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.346679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.346793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.346886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.346913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.346998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.347084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.347109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.347223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.347301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.347325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.347411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.347520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.347548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.347645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.347756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.347781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.347895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.347971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.347996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.348082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.348165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.348191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.348334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.348415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.348440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.348553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.348666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.348693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.348805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.348914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.348941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.349084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.349198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.349225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.349339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.349485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.349512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.349628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.349714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.349741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.349859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.349971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.349999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.350112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.350189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.350214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.350337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.350423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.350448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.350587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.350678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.350709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.350798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.350910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.350938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.351090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.351205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.351230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.351326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.351440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.351471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.351556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.351640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.351667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.351755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.351849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.351873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.351963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.352075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.352102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.352194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.352335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.352364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-16 17:06:26.352453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.352560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-16 17:06:26.352586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-16 17:06:26.352706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.352822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.352848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-16 17:06:26.352933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.353037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.353063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-16 17:06:26.353185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.353300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.353327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-16 17:06:26.353443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.353528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.353556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-16 17:06:26.353713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.353847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.353873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-16 17:06:26.354018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.354134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.354161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-16 17:06:26.354311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.354397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.354423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-16 17:06:26.354516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.354636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.354663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-16 17:06:26.354744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.354826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-16 17:06:26.354853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-16 17:06:26.354944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.950 [2024-11-16 17:06:26.355063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.950 [2024-11-16 17:06:26.355091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.950 qpair failed and we were unable to recover it. 00:30:40.950 [2024-11-16 17:06:26.355197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.950 [2024-11-16 17:06:26.355314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.355342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.355460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.355545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.355572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.355691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.355805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.355831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.355953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.356096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.356123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.356243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.356385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.356411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.356494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.356578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.356604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.356698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.356778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.356804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.356926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.357039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.357067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.357213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.357296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.357322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.357400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.357505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.357534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.357654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.357789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.357817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.357943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.358094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.358121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.358234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.358350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.358377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.358492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.358601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.358636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.358718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.358804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.358832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.358954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.359074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.359101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.359225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.359305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.359334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.359419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.359492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.359518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.359661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.359743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.359769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.359885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.360023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.360049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.360141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.360262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.360288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.360404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.360485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.360510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.360626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.360743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.360767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.360922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.361037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.361061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.361143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.361227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.361251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.361366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.361479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.361505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.361590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.361677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.361703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.361810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.361899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.361924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.362034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.362148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.362172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.362260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.362342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.362367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.362489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.362598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.362632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.362746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.362886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.362911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.363007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.363111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.363135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.363275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.363399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.363426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.363545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.363690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.363717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.363798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.363882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.363908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.363996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.364074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.364102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.364209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.364290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.364316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.364395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.364509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.364535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.364622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.364734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.951 [2024-11-16 17:06:26.364760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.951 qpair failed and we were unable to recover it. 00:30:40.951 [2024-11-16 17:06:26.364869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.364953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.364978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.365066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.365145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.365173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.365299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.365419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.365463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.365594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.365739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.365769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.365855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.365964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.365990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.366095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.366181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.366206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.366339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.366455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.366483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.366576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.366722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.366749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.366839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.366957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.366986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.367086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.367185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.367213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.367301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.367483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.367513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.367646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.367724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.367750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.367887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.367998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.368024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.368139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.368231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.368258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.368378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.368481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.368523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.368601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.368725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.368751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.368865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.369005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.369030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.369137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.369263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.369293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.369417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.369512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.369540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.369636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.369744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.369770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.369845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.369962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.369987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.370071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.370183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.370212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.370341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.370495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.370520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.370635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.370726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.370756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.370849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.370997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.371023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.371136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.371231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.371259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.371365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.371506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.371547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.371642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.371724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.371750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.371837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.371915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.371941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.372032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.372170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.372196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.372301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.372382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.372411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.372560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.372677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.372704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.372783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.372864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.372890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.373006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.373119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.373145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.373307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.373400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.373428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.373532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.373611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.373643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.373731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.373811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.373836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.373915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.374026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.374052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.374151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.374296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.374324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-16 17:06:26.374434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.374532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-16 17:06:26.374575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.374672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.374789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.374816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.374899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.375035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.375063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.375186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.375270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.375299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.375392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.375521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.375547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.375663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.375761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.375787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.375898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.376032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.376060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.376189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.376283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.376327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.376463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.376542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.376568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.376659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.376748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.376774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.376858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.376946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.376973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.377079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.377200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.377230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.377318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.377433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.377461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.377547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.377690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.377716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.377831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.377916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.377942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.378058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.378175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.378219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.378373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.378494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.378522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.378638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.378734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.378760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.378847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.378978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.379007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.379126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.379214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.379242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.379339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.379460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.379489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.379583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.379692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.379719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.379793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.379921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.379950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.380080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.380229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.380257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.380376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.380473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.380502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.380636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.380735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.380766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.380850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.380936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.380962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.381041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.381177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.381206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.381293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.381416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.381444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.381579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.381666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.381692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.381805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.381890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.381916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.382026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.382106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.382130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.382242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.382383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.382409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.382515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.382646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.382674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.382757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.382836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.382862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.382968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.383079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.383109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.383189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.383276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.383301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.383441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.383517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.383543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.383651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.383748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.383774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.383852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.383956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.383983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.384064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.384177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.384203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-16 17:06:26.384283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-16 17:06:26.384396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.384422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.384560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.384699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.384726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.384812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.384892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.384937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.385068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.385146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.385172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.385255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.385385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.385411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.385524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.385633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.385676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.385770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.385856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.385882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.385969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.386079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.386105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.386231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.386389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.386431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.386544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.386639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.386666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.386781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.386890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.386915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.387042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.387171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.387198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.387286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.387366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.387392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.387479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.387614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.387647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.387738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.387820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.387846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.387950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.388161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.388190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.388284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.388364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.388390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.388505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.388588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.388624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.388716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.388821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.388850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.388993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.389106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.389132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.389240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.389331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.389356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.389473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.389553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.389580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.389676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.389797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.389825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.389909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.389992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.390017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.390138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.390232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.390260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.390417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.390544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.390573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.390672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.390784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.390811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.390891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.390980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.391006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.391087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.391202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.391231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.391352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.391439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.391465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.391577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.391701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.391729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.391810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.391928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.391954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.392037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.392150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.392177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.392292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.392365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.392391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.392509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.392630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.392657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-16 17:06:26.392751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-16 17:06:26.392836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.392862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.393000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.393099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.393128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.393326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.393432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.393458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.393577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.393674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.393701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.393793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.393901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.393929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.394043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.394118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.394143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.394227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.394334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.394359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.394440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.394553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.394580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.394683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.394790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.394816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.394897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.395002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.395029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.395112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.395229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.395256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.395375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.395459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.395485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.395590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.395676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.395703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.395788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.395903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.395929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.396037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.396125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.396152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.396268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.396351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.396376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.396457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.396543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.396571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.396665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.396781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.396808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.396918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.397030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.397057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.397197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.397342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.397369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.397446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.397530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.397561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.397675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.397759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.397785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.397866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.397948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.397974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.398121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.398230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.398256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.398349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.398438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.398465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.398553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.398637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.398664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.398778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.398886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.398911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.398988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.399101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.399127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.399235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.399346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.399372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.399580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.399725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.399751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.399840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.399914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.399940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.400076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.400218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.400243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.400354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.400470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.400496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.400578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.400662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.400689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.400772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.400859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.400886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.401000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.401087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.401113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.401253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.401338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.401363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.401473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.401553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.401578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.401683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.401780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.401811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.401927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.402071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.402099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-16 17:06:26.402243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-16 17:06:26.402340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.402368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.402462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.402576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.402605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.402724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.402820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.402848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.402939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.403017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.403044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.403153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.403268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.403295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.403439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.403518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.403544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.403637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.403726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.403754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.403848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.403989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.404016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.404111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.404222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.404249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.404333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.404446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.404472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.404627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.404714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.404742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.404870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.404983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.405009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.405122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.405234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.405260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.405339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.405476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.405503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.405588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.405739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.405766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.405847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.405988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.406016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.406104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.406200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.406228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.406320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.406401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.406444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.406524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.406667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.406695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.406781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.406861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.406888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.407056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.407143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.407171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.407274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.407365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.407393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.407520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.407598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.407636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.407723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.407816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.407843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.408014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.408142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.408168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.408429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.408561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.408591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.408766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.408863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.408893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.409037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.409176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.409206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.409334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.409487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.409516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.409645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.409751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.409778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.409891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.410003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.410029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.410119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.410285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.410315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.410421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.410519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.410550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.410689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.410783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.410810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.410897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.411010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.411036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.411150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.411245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.411273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.411390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.411543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.411569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.411656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.411781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.411808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.411922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.412034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.412061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.412170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.412310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.412336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-16 17:06:26.412463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-16 17:06:26.412571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.412597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.412690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.412830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.412861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.412944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.413020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.413046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.413195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.413314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.413343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.413434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.413527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.413555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.413642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.413742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.413768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.413848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.413942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.413967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.414044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.414157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.414183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.414263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.414393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.414422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.414523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.414636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.414670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.414763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.414841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.414869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.414980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.415068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.415113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.415273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.415368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.415396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.415490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.415573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.415601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.415740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.415854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.415889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.416047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.416155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.416182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.416259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.416356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.416382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.416471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.416591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.416638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.416757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.416869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.416895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.417008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.417116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.417141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.417232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.417370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.417414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.417544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.417628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.417654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.417777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.417885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.417931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.418026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.418140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.418166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.418370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.418492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.418533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.418649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.418735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.418761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.418837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.418964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.418991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.419100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.419213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.419240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.419388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.419498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.419524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.419633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.419747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.419775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.419873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.419983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.420028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.420142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.420269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.420298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.420387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.420473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.420516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.420594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.420687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.420713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.420827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.420909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.420935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.421049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.421156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.421185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-16 17:06:26.421305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.421391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-16 17:06:26.421419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.421514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.421631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.421675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.421757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.421912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.421938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.422051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.422226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.422254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.422351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.422469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.422497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.422638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.422767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.422793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.422890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.422979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.423005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.423092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.423180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.423206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.423308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.423391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.423420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.423558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.423654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.423697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.423813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.423907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.423933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.424044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.424153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.424180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.424261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.424372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.424398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.424536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.424640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.424672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.424783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.424887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.424913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.425029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.425113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.425139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.425248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.425363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.425394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.425479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.425629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.425667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.425745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.425877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.425904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.426022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.426137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.426162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.426242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.426356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.426382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.426478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.426645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.426677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.426816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.426909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.426935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.427020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.427158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.427183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.427303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.427416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.427459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.427582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.427703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.427730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.427875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.427960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.427986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.428129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.428246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.428272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.428401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.428525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.428552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.428694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.428788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.428817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.428944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.429066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.429094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.429191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.429284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.429327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.429410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.429525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.429551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.429673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.429761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.429787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.429869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.429952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.429978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.430137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.430254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.430283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.430374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.430461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.430489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.430573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.430724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.430751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.430841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.430955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.430983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.431137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.431252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.431279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.431415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.431528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.431555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-16 17:06:26.431643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-16 17:06:26.431753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.431779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.431895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.432000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.432027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.432140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.432250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.432277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.432356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.432469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.432495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.432583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.432707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.432734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.432820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.432906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.432933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.433026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.433116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.433141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.433229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.433336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.433362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.433474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.433563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.433589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.433712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.433802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.433829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.433910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.434031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.434057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.434140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.434247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.434273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.434363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.434479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.434507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.434624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.434762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.434788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.434870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.434990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.435017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.435124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.435229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.435256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.435382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.435485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.435517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.435647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.435765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.435792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.435887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.435966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.435992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.436108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.436200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.436228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.436375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.436459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.436485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.436608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.436691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.436719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.436803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.436882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.436912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.437008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.437085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.437113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.437196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.437333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.437359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.437443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.437560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.437588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.437730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.437837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.437866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.437958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.438075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.438103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.438216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.438338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.438364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.438481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.438596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.438633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.438814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.438902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.438932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.439029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.439135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.439162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.439257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.439392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.439421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.439541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.439686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.439712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.439818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.439899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.439926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.440054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.440174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.440203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.440302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.440462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.440492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.440650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.440756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.440781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.440874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.441018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.441045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.441127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.441205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.441232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-16 17:06:26.441325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.441406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-16 17:06:26.441432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.441514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.441628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.441655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.441765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.441840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.441866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.441953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.442030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.442070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.442163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.442334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.442362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.442467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.442597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.442638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.442746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.442834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.442864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.442994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.443141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.443170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.443262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.443384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.443412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.443531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.443656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.443684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.443821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.443942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.443974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.444125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.444210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.444252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.444383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.444476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.444505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.444641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.444732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.444759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.444845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.444985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.445010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.445133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.445210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.445254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.445390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.445501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.445529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.445677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.445759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.445785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.445871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.445950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.445975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.446103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.446228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.446258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.446396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.446570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.446597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.446726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.446817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.446843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.446951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.447071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.447099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.447252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.447372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.447401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.447517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.447649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.447691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.447830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.447960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.447988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.448112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.448199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.448227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.448331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.448452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.448481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.448582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.448666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.448693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.448807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.448882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.448928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.449056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.449188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.449214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.449325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.449432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.449458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.449545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.449684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.449711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.449797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.449901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.449926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.450035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.450148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.450192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.450306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.450398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.450428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.450520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.450647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.450691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-16 17:06:26.450806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.450932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-16 17:06:26.450960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.451049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.451166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.451195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.451318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.451409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.451438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.451565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.451680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.451706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.451820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.451908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.451934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.452065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.452222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.452248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.452396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.452508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.452533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.452629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.452720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.452746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.452831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.452915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.452940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.453050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.453157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.453183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.453300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.453375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.453405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.453496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.453604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.453639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.453731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.453844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.453869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.454013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.454096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.454122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.454242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.454323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.454348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.454436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.454540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.454566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.454679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.454787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.454813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.454891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.455028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.455054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.455171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.455255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.455281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.455397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.455502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.455528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.455649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.455729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.455760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.455845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.455926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.455953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.456031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.456158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.456183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.456299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.456387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.456414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.456509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.456627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.456654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.456823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.456950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.456976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.457094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.457182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.457207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.457351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.457573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.457624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.457754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.457888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.457916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.458005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.458108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.458134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.458251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.458363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.458389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.458478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.458565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.458590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.458721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.458829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.458855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.458942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.459049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.459076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.459246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.459340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.459368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.459519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.459608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.459658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.459767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.459856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.459883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.459992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.460098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.460125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.460213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.460324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.460350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.460429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.460538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.460564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.460653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.460738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.961 [2024-11-16 17:06:26.460764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-16 17:06:26.460860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.461016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.461042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.461151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.461262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.461288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.461401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.461531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.461561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.461688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.461816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.461842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.461923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.462005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.462030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.462147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.462277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.462306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.462406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.462537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.462563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.462711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.462822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.462849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.462934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.463031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.463062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.463186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.463317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.463343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.463417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.463546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.463572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.463692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.463795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.463821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.463935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.464072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.464097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.464178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.464260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.464286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.464391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.464500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.464525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.464667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.464756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.464782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.464904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.465015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.465041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.465139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.465238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.465267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.465358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.465445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.465476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.465603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.465697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.465723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.465812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.465948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.465978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.466087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.466224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.466250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.466387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.466470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.466496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.466584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.466685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.466713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.466831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.466923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.466949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.467031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.467145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.467172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.467324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.467412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.467438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.467514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.467705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.467731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.467921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.468023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.468049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.468156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.468235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.468262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.468373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.468538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.468567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.468692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.468813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.468839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.468927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.469034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.469061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.469146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.469226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.469252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.469339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.469445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.469471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.469558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.469641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.469668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.469750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.469825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.469851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.469962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.470081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.470107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.470186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.470276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.470302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.470409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.470529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.470555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-16 17:06:26.470667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.470749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.962 [2024-11-16 17:06:26.470775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.470888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.470995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.471021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.471124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.471228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.471253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.471362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.471470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.471495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.471643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.471731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.471757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.471898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.472006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.472032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.472119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.472229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.472254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.472339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.472419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.472445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.472552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.472629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.472655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.472733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.472871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.472897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.473010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.473083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.473109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.473232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.473349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.473375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.473491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.473608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.473643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.473730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.473839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.473867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.473954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.474069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.474095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.474210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.474314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.474340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.474431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.474543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.474569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.474688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.474897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.474926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.475049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.475160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.475187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.475322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.475429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.475456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.475543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.475659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.475687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.475796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.475907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.475933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.476040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.476199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.476225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.476346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.476490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.476518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.476628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.476717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.476744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.476840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.476949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.476974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.477059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.477140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.477166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.477250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.477363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.477389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.477469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.477539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.477564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.477688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.477768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.477795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.477905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.478016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.478043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.478121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.478254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.478288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.478427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.478577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.478606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.478781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.478870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.478896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.478980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.479120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.479146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.479256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.479362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.479388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.479502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.479606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.479642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.479729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.479864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.479890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.480003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.480086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.480111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.480220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.480325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.963 [2024-11-16 17:06:26.480350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.963 qpair failed and we were unable to recover it. 00:30:40.963 [2024-11-16 17:06:26.480516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.480638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.480666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.480754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.480890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.480919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.481028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.481146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.481172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.481314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.481398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.481424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.481533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.481647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.481677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.481812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.481897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.481922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.482033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.482192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.482217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.482334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.482423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.482452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.482596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.482746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.482773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.482983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.483118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.483144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.483232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.483341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.483368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.483456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.483566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.483591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.483695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.483779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.483806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.483920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.484052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.484081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.484251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.484340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.484366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.484566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.484645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.484671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.484765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.484872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.484898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.484988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.485097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.485122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.485285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.485411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.485440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.485559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.485687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.485716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.485911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.486026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.486052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.486145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.486288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.486314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.486404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.486522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.486552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.486685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.486800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.486826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.486939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.487052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.487098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.487204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.487319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.487345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.487463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.487573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.487600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.487745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.487936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.487965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.488105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.488229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.488258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.488388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.488500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.488526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.488602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.488722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.488749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.488823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.489011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.489037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.489162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.489247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.489277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.489389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.489548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.489576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.489672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.489799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.489841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.489937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.490015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.490042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.964 [2024-11-16 17:06:26.490157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.490242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.964 [2024-11-16 17:06:26.490269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.964 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.490457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.490569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.490595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.490711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.490838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.490867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.491005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.491181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.491227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.491334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.491509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.491537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.491646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.491780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.491826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.491990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.492124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.492157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.492271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.492365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.492391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.492481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.492595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.492628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.492713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.492829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.492855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.492945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.493056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.493083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.493253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.493391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.493420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.493512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.493639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.493681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.493761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.493869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.493895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.493998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.494150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.494179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.494302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.494425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.494454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.494576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.494714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.494742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.494904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.495023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.495051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.495172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.495307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.495335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.495538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.495709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.495736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.495865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.496008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.496036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.496136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.496328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.496357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.496478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.496604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.496639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.496773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.496857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.496887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.496977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.497106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.497135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.497267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.497364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.497393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.497503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.497612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.497644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.497786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.497890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.497919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.498095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.498212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.498241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.498369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.498482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.498510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.498628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.498790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.498835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.498951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.499081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.499110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.499227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.499309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.499337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.499443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.499519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.499546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.499643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.499721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.499748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.499826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.499951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.499977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.500087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.500232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.500258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.500383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.500496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.500522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.500637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.500719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.500746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.500892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.501008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.501036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.501152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.501239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.965 [2024-11-16 17:06:26.501266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.965 qpair failed and we were unable to recover it. 00:30:40.965 [2024-11-16 17:06:26.501352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.501470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.501496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.501600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.501718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.501744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.501835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.501974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.502000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.502094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.502235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.502263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.502354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.502493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.502520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.502638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.502771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.502813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.502924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.503019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.503048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.503166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.503242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.503268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.503375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.503481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.503507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.503596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.503738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.503766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.503866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.503984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.504013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.504107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.504193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.504222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.504323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.504437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.504463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.504551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.504708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.504738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.504873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.504956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.504985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.505083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.505201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.505229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.505318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.505413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.505442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.505571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.505692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.505718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.505829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.505943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.505971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.506087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.506180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.506208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.506342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.506496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.506524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.506666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.506811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.506837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.506947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.507078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.507108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.507245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.507359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.507387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.507508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.507648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.507692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.507768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.507905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.507931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.508069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.508198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.508235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.508356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.508521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.508548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.508685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.508798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.508824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.508915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.509008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.509037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.509117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.509235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.509262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.509357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.509481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.509510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.509635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.509768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.509794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.509888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.509983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.510011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.510130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.510243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.510271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.510364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.510511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.510540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.510669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.510757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.510784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.510867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.511035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.511064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.511214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.511329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.511358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.511448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.511547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.511578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.966 [2024-11-16 17:06:26.511721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.511835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.966 [2024-11-16 17:06:26.511861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.966 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.511961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.512088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.512117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.512336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.512486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.512514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.512661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.512749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.512774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.512885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.512967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.513009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.513123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.513251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.513280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.513434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.513559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.513588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.513737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.513853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.513879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.513996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.514167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.514195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.514293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.514396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.514425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.514575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.514711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.514739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.514878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.514996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.515022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.515130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.515282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.515310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.515429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.515585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.515611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.515742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.515854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.515880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.515956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.516063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.516090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.516172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.516258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.516284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.516383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.516522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.516568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.516699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.516845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.516873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.516983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.517099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.517124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.517248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.517386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.517412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.517533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.517637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.517664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.517754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.517894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.517924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.518068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.518200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.518227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.518334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.518448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.518475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.518599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.518725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.518755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.518885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.519034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.519060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.519210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.519336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.519362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.519483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.519597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.519632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.519742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.519825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.519851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.519941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.520056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.520082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.520158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.520234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.520259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.520365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.520489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.520516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.520629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.520724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.520750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.520857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.520939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.520964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.521080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.521185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.521210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.521325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.521410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.521435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.967 qpair failed and we were unable to recover it. 00:30:40.967 [2024-11-16 17:06:26.521515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.521602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.967 [2024-11-16 17:06:26.521635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.521746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.521852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.521878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.521962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.522103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.522129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.522241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.522379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.522405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.522521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.522645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.522673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.522767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.522905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.522932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.523046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.523164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.523190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.523279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.523389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.523416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.523560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.523691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.523736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.523860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.524008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.524051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.524190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.524308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.524334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.524449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.524584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.524610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.524758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.524839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.524864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.525029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.525154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.525182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.525316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.525423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.525448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.525557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.525639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.525665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.525784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.525896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.525922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.526058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.526209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.526235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.526348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.526490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.526516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.526654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.526748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.526773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.526861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.526944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.526974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.527059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.527151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.527178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.527291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.527386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.527412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.527494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.527583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.527608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.527734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.527841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.527867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.527976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.528096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.528123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.528237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.528383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.528410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.528492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.528598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.528632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.528739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.528839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.528866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.529014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.529091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.529118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.529232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.529317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.529349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.529445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.529579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.529605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.529729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.529849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.529876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.529966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.530051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.530077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.530166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.530303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.530329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.530443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.530575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.530601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.530750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.530870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.530896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.531014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.531123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.531148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.531222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.531358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.531383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.531491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.531609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.531643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.968 [2024-11-16 17:06:26.531760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.531884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.968 [2024-11-16 17:06:26.531914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.968 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.532058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.532170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.532196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.532311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.532446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.532471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.532560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.532646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.532673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.532800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.532921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.532950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.533048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.533132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.533159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.533270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.533357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.533384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.533524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.533604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.533639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.533756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.533872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.533898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.534013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.534143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.534170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.534313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.534425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.534458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.534606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.534723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.534768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.534879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.534969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.534996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.535106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.535187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.535214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.535300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.535388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.535414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.535561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.535651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.535678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.535759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.535871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.535897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.536014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.536148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.536174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.536310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.536416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.536441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.536518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.536631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.536658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.536772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.536883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.536910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.537033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.537123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.537150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.537290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.537381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.537406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.537549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.537667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.537693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.537781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.537895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.537921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.538010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.538120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.538148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.538260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.538374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.538401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.538522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.538659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.538686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.538797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.538914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.538941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.539050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.539197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.539223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.539365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.539469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.539496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.539647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.539841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.539868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.539962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.540094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.540120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.540260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.540383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.540411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.540501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.540630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.540658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.540821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.540974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.541020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.541160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.541247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.541273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.541357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.541467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.541493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.541600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.541732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.541759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.541866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.542005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.542031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.969 qpair failed and we were unable to recover it. 00:30:40.969 [2024-11-16 17:06:26.542179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.542290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.969 [2024-11-16 17:06:26.542316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.542441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.542515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.542541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.542682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.542819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.542845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.543015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.543137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.543163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.543253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.543337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.543364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.543489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.543603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.543637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.543714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.543803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.543830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.543925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.544042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.544069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.544174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.544282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.544308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.544420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.544545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.544571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.544726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.544836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.544863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.544983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.545064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.545091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.545211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.545327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.545353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.545433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.545539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.545565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.545649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.545763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.545789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.545903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.546006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.546033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.546148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.546260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.546287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.546482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.546560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.546586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.546736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.546846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.546872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.546983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.547119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.547144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.547229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.547368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.547393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.547562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.547685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.547714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.547865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.548006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.548049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.548202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.548314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.548339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.548452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.548564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.548590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.548688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.548830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.548856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.548935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.549043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.549069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.549208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.549315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.549340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.549462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.549553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.549579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.549697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.549809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.549836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.549955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.550060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.550085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.550209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.550317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.550343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.550455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.550572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.550599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.550700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.550814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.550841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.550960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.551072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.551099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.551180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.551295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.551321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.970 [2024-11-16 17:06:26.551412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.551497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.970 [2024-11-16 17:06:26.551523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.970 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.551638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.551754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.551780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.551866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.551954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.551981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.552123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.552233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.552259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.552369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.552451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.552476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.552560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.552667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.552694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.552778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.552884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.552911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.552996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.553075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.553102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.553179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.553293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.553319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.553459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.553565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.553591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.553730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.553837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.553863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.553977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.554086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.554113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.554198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.554310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.554344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.554443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.554608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.554642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.554787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.554923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.554949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.555081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.555203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.555228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.555310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.555422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.555447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.555561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.555672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.555700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.555817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.555929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.555955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.556068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.556153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.556179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.556259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.556397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.556424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.556502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.556609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.556643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.556739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.556825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.556850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.556935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.557016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.557043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.557157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.557260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.557286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.557362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.557476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.557502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.557659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.557748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.557774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.557858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.557953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.557979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.558056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.558168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.558193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.558303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.558386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.558412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.558551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.558658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.558685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.558802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.558948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.558975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.559104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.559247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.559272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.559387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.559463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.559489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.559600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.559709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.559738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.559903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.560011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.560037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.560129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.560244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.560270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.560381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.560464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.560489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.560578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.560726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.560753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.560863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.560939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.560965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.561071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.561153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.971 [2024-11-16 17:06:26.561179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.971 qpair failed and we were unable to recover it. 00:30:40.971 [2024-11-16 17:06:26.561297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.561432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.561459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.561574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.561699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.561726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.561865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.561980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.562006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.562143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.562256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.562281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.562402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.562493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.562519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.562637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.562724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.562750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.562830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.562917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.562945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.563100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.563247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.563273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.563393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.563505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.563530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.563613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.563731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.563775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.563886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.566747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.566776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.566921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.567094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.567138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.567274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.567406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.567433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.567543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.567683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.567710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.567797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.567955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.567999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.568129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.568255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.568281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.568423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.568559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.568585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.568687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.568783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.568811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.568911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.569048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.569074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.569188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.569311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.569336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.569428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.569532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.569559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.569720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.569881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.569925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.570056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.570214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.570240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.570354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.570441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.570467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.570575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.570708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.570758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.570898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.570972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.570998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.571138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.571220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.571246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.571363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.571444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.571471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.571612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.571755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.571798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.571886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.571976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.572003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.572121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.572226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.572251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.572392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.572528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.572554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.572687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.572837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.572868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.572994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.573118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.573146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.573229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.573341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.573372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.573480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.573593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.573642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.573755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.573884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.573910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.574024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.574113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.574140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.574254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.574462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.574489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.574630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.574712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.574738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.972 qpair failed and we were unable to recover it. 00:30:40.972 [2024-11-16 17:06:26.574830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.972 [2024-11-16 17:06:26.574919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.574945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.575033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.575117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.575143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.575283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.575400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.575426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.575517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.575632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.575659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.575800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.575920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.575952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.576101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.576216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.576243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.576357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.576475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.576500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.576582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.576727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.576771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.576915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.577030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.577057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.577196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.577310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.577338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.577458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.577573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.577599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.577749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.577908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.577952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.578117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.578238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.578264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.578374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.578516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.578541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.578631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.578792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.578841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.579006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.579154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.579198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.579289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.579425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.579452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.579565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.579644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.579669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.579746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.579860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.579886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.580001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.580114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.580141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.580258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.580364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.580391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.580533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.580674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.580701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.580787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.580904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.580931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.581022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.581133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.581159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.581277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.581391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.581417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.581565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.581684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.581709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.581843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.582023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.582068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.582199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.582335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.582362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.582507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.582592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.582626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.582835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.582967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.582993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.583131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.583225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.583251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.583331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.583416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.583442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.583599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.583734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.583778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.583896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.584006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.584034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.584152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.584258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.584285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.584432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.584508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.973 [2024-11-16 17:06:26.584534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.973 qpair failed and we were unable to recover it. 00:30:40.973 [2024-11-16 17:06:26.584633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.584725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.584753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.584896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.585035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.585061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.585170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.585275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.585301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.585387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.585497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.585523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.585639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.585751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.585777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.585889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.585970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.585997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.586105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.586218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.586246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.586356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.586470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.586496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.586590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.586703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.586730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.586848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.586932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.586959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.587099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.587241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.587268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.587390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.587508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.587534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.587648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.587737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.587764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.587881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.587996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.588021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.588106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.588210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.588235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.588341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.588456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.588482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.588573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.588690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.588717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.588831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.588950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.588975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.589087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.589200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.589227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.589350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.589457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.589483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.589590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.589698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.589726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.589875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.589985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.590011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.590126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.590232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.590259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.590351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.590457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.590485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.590629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.590743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.590769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.590881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.591019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.591045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.591155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.591237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.591265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.591403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.591517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.591543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.591688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.591878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.591907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.592069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.592213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.592239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.592347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.592454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.592480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.592602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.592724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.592752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.592874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.592985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.593011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.593127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.593208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.593235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.593316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.593398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.593424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.593532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.593612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.593646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.593839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.593946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.593973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.594065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.594199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.594226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.594338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.594416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.594443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.594560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.594650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.594678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.974 qpair failed and we were unable to recover it. 00:30:40.974 [2024-11-16 17:06:26.594818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.974 [2024-11-16 17:06:26.594924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.594951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.595142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.595286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.595312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.595451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.595545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.595573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.595714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.595834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.595864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.595962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.596099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.596126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.596206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.596317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.596344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.596458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.596539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.596565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.596682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.596793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.596820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.596963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.597078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.597104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.597215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.597298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.597325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.597439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.597558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.597584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.597749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.597879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.597923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.598030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.598168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.598194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.598304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.598447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.598473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.598629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.598757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.598801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.598969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.599095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.599122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.599229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.599344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.599371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.599475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.599585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.599612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.599736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.599859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.599885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.599997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.600100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.600127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.600241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.600380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.600406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.600486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.600567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.600593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.600690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.600807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.600832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.600913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.601022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.601049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.601166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.601281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.601308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.601386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.601492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.601519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.601642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.601786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.601812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.601895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.602007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.602034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.602173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.602286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.602314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.602403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.602538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.602565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.602702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.602853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.602905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.603017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.603161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.603188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.603300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.603384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.603412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.603499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.603623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.603651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.603808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.603923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.603951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.604067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.604179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.604206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.604295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.604378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.604403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.604511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.604648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.604675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.604800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.604879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.604905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.605052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.605154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.605181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.975 qpair failed and we were unable to recover it. 00:30:40.975 [2024-11-16 17:06:26.605322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.605437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.975 [2024-11-16 17:06:26.605463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.605570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.605693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.605720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.605810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.605896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.605922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.606029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.606145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.606171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.606281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.606357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.606383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.606481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.606557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.606583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.606714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.606802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.606829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.606941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.607049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.607075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.607188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.607274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.607300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.607383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.607464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.607490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.607576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.607698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.607725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.607815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.607929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.607957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.608073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.608186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.608213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.608355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.608432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.608458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.608546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.608637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.608665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.608806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.608895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.608922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.609040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.609154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.609181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.609288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.609374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.609402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.609513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.609598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.609631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.609826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.609941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.609967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.610076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.610185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.610211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.610316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.610397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.610423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.610505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.610622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.610651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.610763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.610875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.610901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.611092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.611204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.611230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.611372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.611487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.611513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.611627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.611715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.611743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.611885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.611986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.612013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.612130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.612236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.612262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.612348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.612538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.612569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.612701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.612830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.612856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.613016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.613146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.613172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.613291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.613484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.613511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.613648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.613764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.613791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.613937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.614081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.614107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.614212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.614327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.614355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.614498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.614614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.614649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.614741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.614880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.614907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.615040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.615147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.615174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.615313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.615425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.615460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.976 [2024-11-16 17:06:26.615574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.615729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.976 [2024-11-16 17:06:26.615756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.976 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.615877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.615993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.616019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.616104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.616208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.616234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.616313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.616421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.616447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.616531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.616623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.616651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.616761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.616880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.616906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.617021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.617145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.617171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.617288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.617401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.617429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.617547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.617660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.617688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.617888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.618025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.618055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.618167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.618275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.618302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.618416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.618532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.618558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.618689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.618794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.618821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.618904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.619019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.619046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.619156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.619275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.619301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.619415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.619501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.619527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.619610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.619713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.619739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.619827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.619967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.619993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.620133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.620272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.620298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.620414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.620550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.620581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.620743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.620920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.620966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.621126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.621221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.621248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.621333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.621444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.621472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.621562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.621652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.621680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.621789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.621866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.621892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.621969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.622082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.622111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.622187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.622280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.622306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.622422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.622501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.622527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.622636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.622715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.622741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.622822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.622902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.622928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.623010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.623121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.623148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.623260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.623342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.623367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.623454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.623540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.623566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.623684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.623823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.623849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.623964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.624041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.624067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.624146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.624257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.624283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.624429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.624566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.624592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.977 qpair failed and we were unable to recover it. 00:30:40.977 [2024-11-16 17:06:26.624702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.977 [2024-11-16 17:06:26.624828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.624873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.624962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.625076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.625101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.625189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.625273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.625298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.625388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.625471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.625497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.625624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.625763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.625790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.625905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.626020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.626045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.626183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.626296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.626321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.626450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.626540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.626567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.626653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.626775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.626802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.626941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.627029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.627055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.627165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.627239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.627264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.627345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.627462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.627489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.627608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.627731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.627758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.627837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.627915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.627943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.628087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.628204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.628230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.628309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.628420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.628445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.628566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.628728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.628757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.628850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.628971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.628999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.629156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.629266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.629293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.629434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.629523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.629550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.629691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.629813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.629840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.629971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.630126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.630152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.630265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.630348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.630374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.630494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.630584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.630611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.630760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.630874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.630900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.631017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.631204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.631231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.631348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.631489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.631515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.631633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.631727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.631753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.631834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.631917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.631944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.632080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.632217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.632244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.632384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.632498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.632527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.632636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.632716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.632742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.632903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.633002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.633029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.633135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.633283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.633309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.633422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.633509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.633536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.633648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.633765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.633791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.633883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.633993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.634020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.634110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.634201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.634228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.634338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.634451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.634478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.634628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.634719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.634746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.978 qpair failed and we were unable to recover it. 00:30:40.978 [2024-11-16 17:06:26.634856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.634965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.978 [2024-11-16 17:06:26.634990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.635109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.635213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.635239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.635322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.635401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.635427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.635546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.635662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.635689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.635835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.635954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.635980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.636094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.636200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.636226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.636372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.636477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.636503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.636594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.636718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.636744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.636838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.636976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.637002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.637144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.637281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.637307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.637421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.637568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.637594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.637783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.637895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.637928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.638021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.638178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.638208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.638335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.638470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.638500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.638631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.638774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.638803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.638939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.639054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.639082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.639195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.639312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.639338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.639422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.639539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.639565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.639680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.639797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.639823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.639931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.640012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.640038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.640134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.640308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.640339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.640465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.640623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.640650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.640762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.640870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.640896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.641023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.641147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.641176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.641330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.641482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.641510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.641604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.641780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.641806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.641999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.642228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.642295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.642444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.642594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.642648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.642736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.642844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.642871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.643081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.643298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.643351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.643462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.643570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.643596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.643689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.643798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.643842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.643964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.644106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.644132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.644209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.644351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.644378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.644456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.644570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.644596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.644690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.644782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.644809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.645001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.645196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.645225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.645355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.645477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.645504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.645623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.645720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.645747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.645882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.646039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.646068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.979 [2024-11-16 17:06:26.646205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.646322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.979 [2024-11-16 17:06:26.646349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.979 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.646439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.646553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.646580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.646720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.646814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.646841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.646984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.647099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.647126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.647240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.647320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.647346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.647487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.647630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.647658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.647795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.647905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.647933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.648021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.648135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.648161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.648269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.648385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.648412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.648496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.648632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.648660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.648744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.648824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.648851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.648963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.649077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.649103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.649215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.649327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.649354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.649485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.649599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.649635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.649720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.649831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.649857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.649966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.650080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.650106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.650247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.650387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.650413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.650527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.650645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.650672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.650782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.650866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.650892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.651007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.651083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.651108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.651224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.651378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.651404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.651513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.651630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.651658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.651820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.651995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.652044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.652159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.652273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.652304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.652424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.652579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.652608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.652750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.652890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.652916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.653029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.653112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.653139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.653256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.653362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.653388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.653471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.653612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.653647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.653752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.653842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.653867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.654008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.654128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.654154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.654238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.654395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.654428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.654574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.654693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.654741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.654873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.655012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.655061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.655153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.655293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.655319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.655404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.655545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.655571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.655693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.655832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.655858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.980 qpair failed and we were unable to recover it. 00:30:40.980 [2024-11-16 17:06:26.655942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.980 [2024-11-16 17:06:26.656098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.656142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.656259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.656405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.656431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.656574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.656741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.656786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.656883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.657026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.657054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.657189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.657314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.657341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.657480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.657585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.657612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.657706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.657789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.657820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.657981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.658106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.658132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.658293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.658379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.658405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.658515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.658632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.658660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.658771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.658882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.658910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.659052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.659157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.659183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.659296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.659414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.659441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.659588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.659679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.659706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.659793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.659870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.659896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.660037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.660120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.660147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.660266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.660409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.660440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.660583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.660751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.660795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.660989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.661173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.661215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.661356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.661497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.661523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.661687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.661866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.661909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.662104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.662264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.662291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.662375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.662487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.662513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.662631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.662733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.662763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.662902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.663002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.663046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.663188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.663291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.663318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.663431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.663543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.663569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.663736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.663853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.663880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.663968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.664058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.664086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.664194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.664305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.664331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.664451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.664589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.664622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.664751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.664840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.664868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.665026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.665168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.665194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.665307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.665397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.665424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.665532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.665610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.665643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.665786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.665868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.665896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.666015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.666122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.666148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.666263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.666349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.666375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.666460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.666533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.666559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.666687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.666767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.666793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.981 qpair failed and we were unable to recover it. 00:30:40.981 [2024-11-16 17:06:26.666913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.667023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.981 [2024-11-16 17:06:26.667049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.667133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.667248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.667274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.667391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.667465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.667492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.667606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.667697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.667724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.667849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.667969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.667995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.668078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.668168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.668195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.668335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.668418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.668444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.668597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.668732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.668776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.668909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.669067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.669093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.669236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.669358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.669384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.669466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.669573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.669599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.669733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.669849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.669877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.670020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.670168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.670194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.670321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.670437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.670462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.670569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.670674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.670701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.670780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.670865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.670891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.671033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.671140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.671167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.671258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.671362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.671389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.671504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.671629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.671656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.671732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.671843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.671871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.671989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.672097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.672124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.672212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.672324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.672351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.672439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.672548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.672574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.672694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.672804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.672830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.672973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.673084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.673110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.673196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.673336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.673363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.673478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.673584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.673611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.673768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.673879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.673905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.674019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.674135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.674161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.674270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.674351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.674378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.674523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.674645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.674672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.674781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.674867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.674894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.675012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.675120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.675145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.675230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.675384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.675410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.675555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.675697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.675744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.675854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.676032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.676076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.676220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.676363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.676389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.982 qpair failed and we were unable to recover it. 00:30:40.982 [2024-11-16 17:06:26.676534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.982 [2024-11-16 17:06:26.676660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.676691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.983 qpair failed and we were unable to recover it. 00:30:40.983 [2024-11-16 17:06:26.676876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.677021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.677066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.983 qpair failed and we were unable to recover it. 00:30:40.983 [2024-11-16 17:06:26.677176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.677286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.677312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.983 qpair failed and we were unable to recover it. 00:30:40.983 [2024-11-16 17:06:26.677422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.677499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.677525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.983 qpair failed and we were unable to recover it. 00:30:40.983 [2024-11-16 17:06:26.677601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.677739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.677766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.983 qpair failed and we were unable to recover it. 00:30:40.983 [2024-11-16 17:06:26.677844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.677987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.678013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.983 qpair failed and we were unable to recover it. 00:30:40.983 [2024-11-16 17:06:26.678090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.678205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.678231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.983 qpair failed and we were unable to recover it. 00:30:40.983 [2024-11-16 17:06:26.678375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.678517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.678544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.983 qpair failed and we were unable to recover it. 00:30:40.983 [2024-11-16 17:06:26.678661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.678738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.983 [2024-11-16 17:06:26.678764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:40.983 qpair failed and we were unable to recover it. 00:30:40.983 [2024-11-16 17:06:26.678879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.678956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.678983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.268 qpair failed and we were unable to recover it. 00:30:41.268 [2024-11-16 17:06:26.679114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.679194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.679223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.268 qpair failed and we were unable to recover it. 00:30:41.268 [2024-11-16 17:06:26.679344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.679460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.679488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.268 qpair failed and we were unable to recover it. 00:30:41.268 [2024-11-16 17:06:26.679630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.679762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.679790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.268 qpair failed and we were unable to recover it. 00:30:41.268 [2024-11-16 17:06:26.679897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.679982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.680009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.268 qpair failed and we were unable to recover it. 00:30:41.268 [2024-11-16 17:06:26.680095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.680202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.680228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.268 qpair failed and we were unable to recover it. 00:30:41.268 [2024-11-16 17:06:26.680344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.680454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.680482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.268 qpair failed and we were unable to recover it. 00:30:41.268 [2024-11-16 17:06:26.680589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.680713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.680741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.268 qpair failed and we were unable to recover it. 00:30:41.268 [2024-11-16 17:06:26.680820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.680946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.268 [2024-11-16 17:06:26.680973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.268 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.681101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.681212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.681238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.681355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.681439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.681466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.681582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.681712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.681742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.681850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.681977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.682003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.682140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.682226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.682252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.682360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.682432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.682458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.682545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.682650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.682678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.682757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.682862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.682888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.682968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.683106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.683132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.683241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.683357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.683383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.683469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.683549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.683575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.683672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.683780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.683807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.683949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.684057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.684084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.684169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.684286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.684313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.684456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.684569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.684594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.684692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.684849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.684878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.684990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.685074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.685100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.685184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.685299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.685326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.685405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.685488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.685514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.685629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.685744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.685770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.685861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.685953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.685981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.686086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.686248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.686276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.686436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.686579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.686605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.686752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.686911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.686941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.687157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.687248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.687289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.687432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.687556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.687585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.687765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.687878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.687920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.688074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.688227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.269 [2024-11-16 17:06:26.688254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.269 qpair failed and we were unable to recover it. 00:30:41.269 [2024-11-16 17:06:26.688405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.688495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.688523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.688645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.688751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.688776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.688911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.688999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.689027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.689141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.689230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.689258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.689381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.689544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.689572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.689704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.689883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.689929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.690043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.690175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.690203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.690313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.690441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.690468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.690557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.690699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.690726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.690820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.690934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.690961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.691046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.691160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.691187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.691296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.691422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.691449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.691594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.691740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.691767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.691909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.691992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.692019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.692214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.692372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.692399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.692517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.692607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.692642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.692752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.692927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.692971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.693194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.693332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.693358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.693436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.693576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.693603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.693745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.693888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.693917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.694063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.694222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.694249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.694362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.694446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.694473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.694584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.694768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.694796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.694939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.695049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.695077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.695195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.695334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.695365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.695509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.695657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.695685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.695827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.695943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.695969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.696080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.696196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.270 [2024-11-16 17:06:26.696224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.270 qpair failed and we were unable to recover it. 00:30:41.270 [2024-11-16 17:06:26.696336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.696444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.696470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.696585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.696684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.696711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.696818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.696904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.696932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.697043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.697130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.697157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.697301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.697406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.697433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.697548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.697666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.697694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.697833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.697919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.697952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.698064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.698208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.698234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.698351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.698486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.698512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.698640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.698747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.698776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.698905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.699048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.699075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.699225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.699364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.699390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.699478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.699589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.699625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.699764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.699909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.699939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.700043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.700155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.700182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.700292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.700367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.700394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.700482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.700593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.700634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.700719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.700804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.700832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.700970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.701105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.701132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.701283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.701395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.701422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.701558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.701680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.701710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.701851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.701953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.701981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.702090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.702203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.702229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.702315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.702395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.702423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.702530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.702640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.702667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.702810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.702882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.702909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.702999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.703119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.703150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.703238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.703344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.703369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.271 qpair failed and we were unable to recover it. 00:30:41.271 [2024-11-16 17:06:26.703477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.271 [2024-11-16 17:06:26.703628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.703655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.703772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.703858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.703885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.704029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.704139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.704166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.704247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.704358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.704385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.704475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.704585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.704612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.704704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.704843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.704869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.704954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.705041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.705067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.705191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.705278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.705304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.705410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.705548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.705574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.705702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.705817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.705844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.705924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.706035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.706062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.706179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.706253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.706279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.706397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.706510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.706537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.706659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.706802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.706828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.706945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.707092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.707118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.707197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.707306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.707333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.707458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.707541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.707566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.707681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.707792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.707819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.707922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.708032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.708058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.708176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.708294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.708320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.708397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.708545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.708572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.708656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.708765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.708792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.708879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.708963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.708991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.709081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.709224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.709251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.709367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.709449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.709475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.709565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.709658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.709685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.709809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.709951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.709977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.710090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.710206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.710233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.272 qpair failed and we were unable to recover it. 00:30:41.272 [2024-11-16 17:06:26.710347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.710431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.272 [2024-11-16 17:06:26.710459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.710604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.710721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.710766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.710844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.710958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.710985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.711126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.711239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.711266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.711382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.711458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.711485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.711629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.711742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.711769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.711879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.711987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.712014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.712126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.712205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.712231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.712343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.712451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.712478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.712587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.712679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.712707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.712820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.712936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.712964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.713051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.713195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.713222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.713335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.713471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.713497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.713608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.713733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.713761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.713851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.713956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.713983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.714064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.714185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.714211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.714288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.714397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.714424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.714507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.714588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.714614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.714741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.714832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.714859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.714937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.715045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.715072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.715178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.715286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.715312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.715397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.715511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.715538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.715677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.715793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.715820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.715936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.716049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.273 [2024-11-16 17:06:26.716076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.273 qpair failed and we were unable to recover it. 00:30:41.273 [2024-11-16 17:06:26.716190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.716297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.716323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.716408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.716485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.716511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.716627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.716769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.716795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.716912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.717024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.717050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.717170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.717274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.717301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.717409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.717547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.717574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.717664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.717751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.717778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.717924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.718078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.718105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.718224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.718336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.718363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.718477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.718637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.718665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.718774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.718899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.718925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.719064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.719151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.719177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.719288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.719400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.719426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.719516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.719600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.719637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.719756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.719872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.719898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.720010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.720154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.720181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.720266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.720384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.720410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.720558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.720673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.720701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.720849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.720985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.721011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.721124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.721238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.721263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.721387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.721509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.721538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.721703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.721816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.721842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.721941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.722061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.722090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.722218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.722393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.722421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.722574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.722681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.722708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.722825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.722927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.722970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.723075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.723178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.723208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.723356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.723529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.723561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.274 qpair failed and we were unable to recover it. 00:30:41.274 [2024-11-16 17:06:26.723706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.274 [2024-11-16 17:06:26.723825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.723851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.723947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.724148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.724215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.724429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.724556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.724583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.724729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.724842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.724868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.725018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.725164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.725224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.725346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.725473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.725503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.725628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.725728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.725754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.725869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.725962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.725988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.726120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.726281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.726309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.726409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.726542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.726571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.726682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.726820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.726846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.726959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.727034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.727061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.727167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.727285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.727314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.727437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.727598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.727642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.727782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.727899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.727925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.728007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.728134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.728163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.728253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.728375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.728405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.728556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.728682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.728725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.728870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.729009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.729035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.729177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.729377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.729407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.729557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.729652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.729695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.729804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.729917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.729944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.730059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.730139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.730184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.730339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.730470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.730499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.730667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.730761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.730787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.730895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.730997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.731027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.731156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.731241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.731271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.731394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.731492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.731520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.275 qpair failed and we were unable to recover it. 00:30:41.275 [2024-11-16 17:06:26.731682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.731771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.275 [2024-11-16 17:06:26.731797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.731909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.732002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.732049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.732137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.732250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.732279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.732402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.732489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.732531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.732608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.732755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.732782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.732898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.733013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.733040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.733160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.733311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.733341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.733472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.733633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.733677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.733787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.733927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.733954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.734035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.734113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.734140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.734265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.734352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.734378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.734493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.734642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.734670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.734817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.734931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.734957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.735050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.735193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.735222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.735345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.735439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.735467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.735582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.735757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.735789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.735908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.736077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.736121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.736302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.736436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.736462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.736547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.736661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.736688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.736801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.736908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.736935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.737016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.737128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.737155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.737242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.737324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.737356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.737462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.737533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.737559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.737656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.737749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.737777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.737858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.737943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.737970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.738087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.738178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.738205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.738290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.738399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.738425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.738565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.738678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.738704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.738846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.738932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.276 [2024-11-16 17:06:26.738958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.276 qpair failed and we were unable to recover it. 00:30:41.276 [2024-11-16 17:06:26.739040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.739126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.739152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.739304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.739391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.739418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.739532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.739640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.739672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.739764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.739876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.739903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.739992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.740069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.740096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.740172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.740275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.740302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.740411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.740518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.740544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.740631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.740741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.740768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.740848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.740963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.740990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.741107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.741221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.741247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.741329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.741438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.741464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.741576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.741696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.741725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.741867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.741979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.742013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.742104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.742213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.742239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.742382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.742488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.742515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.742595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.742715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.742742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.742826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.742939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.742966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.743108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.743199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.743226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.743342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.743455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.743483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.743581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.743673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.743700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.743818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.743965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.743992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.744134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.744224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.744252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.744328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.744436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.744463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.744582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.744674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.744701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.277 [2024-11-16 17:06:26.744845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.744983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.277 [2024-11-16 17:06:26.745009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.277 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.745129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.745206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.745233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.745310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.745459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.745485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.745603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.745700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.745726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.745841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.745925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.745951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.746031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.746149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.746176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.746281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.746399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.746426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.746512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.746656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.746684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.746770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.746857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.746884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.747002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.747078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.747105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.747217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.747309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.747335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.747446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.747583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.747609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.747702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.747819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.747845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.747960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.748078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.748104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.748220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.748324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.748350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.748440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.748522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.748549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.748627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.748742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.748769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.748880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.748961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.748989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.749139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.749279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.749305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.749395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.749540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.749566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.749747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.749925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.749972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.750098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.750193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.750219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.750295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.750367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.750398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.750517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.750590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.750625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.750773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.750881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.750909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.751056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.751174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.751201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.751311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.751448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.751475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.751624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.751787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.751832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.278 qpair failed and we were unable to recover it. 00:30:41.278 [2024-11-16 17:06:26.751958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.752088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.278 [2024-11-16 17:06:26.752115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.752235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.752323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.752350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.752435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.752573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.752599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.752769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.752917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.752946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.753117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.753244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.753271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.753417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.753533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.753561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.753717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.753862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.753910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.754052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.754178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.754204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.754310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.754414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.754440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.754556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.754645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.754673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.754761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.754882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.754909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.755050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.755161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.755187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.755261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.755401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.755427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.755533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.755640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.755667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.755802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.755906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.755933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.756053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.756167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.756195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.756311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.756423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.756450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.756567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.756683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.756710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.756843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.756952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.756978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.757099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.757188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.757214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.757333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.757440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.757467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.757559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.757683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.757711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.757830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.757969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.757995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.758110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.758198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.758225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.758336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.758445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.758472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.758586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.758717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.758745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.758890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.759004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.759030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.759176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.759294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.759321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.759460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.759603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.279 [2024-11-16 17:06:26.759637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.279 qpair failed and we were unable to recover it. 00:30:41.279 [2024-11-16 17:06:26.759765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.759866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.759892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.760055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.760140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.760166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.760259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.760370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.760397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.760477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.760589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.760620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.760737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.760843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.760870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.760981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.761100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.761127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.761214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.761329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.761355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.761497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.761640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.761668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.761840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.762015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.762059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.762148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.762254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.762284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.762404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.762489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.762517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.762622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.762707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.762735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.762854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.762972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.763000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.763115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.763204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.763232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.763376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.763455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.763482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.763598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.763692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.763729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.763846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.763954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.763981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.764100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.764213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.764241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.764359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.764510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.764537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.764629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.764719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.764749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.764863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.764983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.765009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.765124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.765283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.765310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.765419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.765537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.765564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.765647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.765730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.765756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.765866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.765981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.766011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.766121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.766244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.766272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.766391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.766506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.766533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.766643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.766762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.766789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.280 qpair failed and we were unable to recover it. 00:30:41.280 [2024-11-16 17:06:26.766912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.280 [2024-11-16 17:06:26.767036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.767062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.767138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.767263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.767291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.767406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.767512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.767540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.767628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.767714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.767741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.767834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.767957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.767985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.768099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.768196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.768224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.768346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.768485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.768511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.768592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.768715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.768743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.768857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.768939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.768965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.769105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.769222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.769248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.769332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.769411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.769437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.769563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.769681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.769710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.769805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.769921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.769946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.770062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.770175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.770201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.770287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.770403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.770430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.770520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.770628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.770655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.770806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.770890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.770919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.771010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.771122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.771148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.771233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.771339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.771366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.771474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.771569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.771596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.771748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.771857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.771884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.772005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.772088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.772128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.772271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.772395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.772423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.772503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.772612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.772646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.772763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.772879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.772906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.773047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.773187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.773214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.773324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.773440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.773478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.773558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.773701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.773731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.281 [2024-11-16 17:06:26.773884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.774042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.281 [2024-11-16 17:06:26.774069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.281 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.774185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.774307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.774335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.774433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.774584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.774610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.774744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.774889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.774922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.775053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.775153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.775182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.775343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.775458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.775487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.775625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.775760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.775794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.775916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.776070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.776099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.776189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.776281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.776309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.776407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.776531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.776557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.776651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.776740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.776765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.776927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.777058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.777088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.777256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.777376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.777406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.777554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.777702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.777729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.777875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.777984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.778010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.778116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.778239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.778268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.778387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.778503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.778537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.778627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.778791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.778817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.778932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.779058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.779086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.779248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.779364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.779393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.779512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.779669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.779694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.779822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.779901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.779927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.780056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.780140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.780187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.780340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.780447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.780476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.780593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.780709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.780750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.282 [2024-11-16 17:06:26.780896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.781032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.282 [2024-11-16 17:06:26.781079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.282 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.781255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.781476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.781555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.781651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.781736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.781764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.781889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.782052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.782079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.782234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.782327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.782355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.782440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.782580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.782606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.782714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.782875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.782919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.783055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.783217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.783270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.783416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.783523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.783549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.783708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.783834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.783880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.784035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.784184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.784213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.784346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.784487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.784520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.784639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.784734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.784761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.784851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.784969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.784996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.785144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.785251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.785278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.785386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.785465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.785492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.785570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.785734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.785765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.785858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.786011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.786037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.786122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.786201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.786227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.786340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.786430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.786456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.786551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.786637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.786681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.786837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.786991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.787023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.787122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.787235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.787264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.787374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.787455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.787481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.787593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.787680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.787708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.787795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.787879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.787922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.788052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.788157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.788185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.788308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.788444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.788471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.788585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.788720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.283 [2024-11-16 17:06:26.788747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.283 qpair failed and we were unable to recover it. 00:30:41.283 [2024-11-16 17:06:26.788834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.788962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.788988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.789086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.789208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.789238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.789356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.789515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.789543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.789679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.789794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.789823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.789948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.790069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.790097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.790202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.790353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.790381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.790521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.790659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.790685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.790768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.790879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.790921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.791025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.791151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.791179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.791330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.791413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.791441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.791553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.791673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.791700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.791805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.791923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.791955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.792043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.792171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.792199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.792369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.792507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.792540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.792714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.792860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.792886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.793054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.793174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.793203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.793321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.793420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.793449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.793552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.793638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.793683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.793798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.793938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.793963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.794038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.794146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.794177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.794327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.794426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.794454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.794628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.794736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.794762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.794877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.794956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.794982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.795130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.795252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.795283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.795433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.795579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.795605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.795704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.795815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.795841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.795929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.796071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.796097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.796225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.796355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.796383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.284 qpair failed and we were unable to recover it. 00:30:41.284 [2024-11-16 17:06:26.796508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.284 [2024-11-16 17:06:26.796593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.796634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.796747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.796859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.796903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.797032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.797123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.797157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.797284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.797395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.797424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.797534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.797669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.797696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.797805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.797900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.797945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.798114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.798235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.798264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.798382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.798508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.798537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.798632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.798714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.798741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.798834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.798984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.799013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.799160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.799285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.799316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.799464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.799584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.799613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.799742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.799865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.799891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.800030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.800166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.800195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.800383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.800511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.800540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.800704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.800811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.800841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.800932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.801045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.801070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.801190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.801287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.801316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.801432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.801564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.801590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.801688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.801800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.801826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.801909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.802032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.802061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.802183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.802296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.802324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.802462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.802599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.802641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.802754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.802897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.802923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.803013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.803127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.803153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.803238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.803338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.803372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.803479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.803584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.803610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.803733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.803857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.803883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.285 [2024-11-16 17:06:26.803999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.804075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.285 [2024-11-16 17:06:26.804102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.285 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.804208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.804347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.804373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.804533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.804642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.804669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.804751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.804866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.804892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.804999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.805090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.805116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.805264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.805414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.805442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.805571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.805688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.805715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.805826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.805920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.805946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.806028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.806168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.806194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.806302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.806377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.806420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.806527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.806656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.806684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.806777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.806884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.806910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.807024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.807105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.807131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.807271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.807383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.807409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.807527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.807648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.807676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.807806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.807897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.807923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.808039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.808150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.808176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.808297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.808439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.808465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.808651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.808760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.808786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.808899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.809020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.809046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.809124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.809262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.809288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.809440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.809570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.809599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.809755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.809869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.809894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.809982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.810072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.810098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.810210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.810281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.810306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.810418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.810554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.810580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.810669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.810794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.810821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.810931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.811016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.811058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.811162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.811266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.811293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.286 qpair failed and we were unable to recover it. 00:30:41.286 [2024-11-16 17:06:26.811406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.286 [2024-11-16 17:06:26.811514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.811540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.811680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.811786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.811813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.811926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.812042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.812068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.812161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.812278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.812304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.812388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.812509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.812536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.812628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.812768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.812794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.812941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.813069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.813098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.813194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.813345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.813371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.813488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.813573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.813600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.813729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.813812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.813842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.813920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.814044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.814070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.814186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.814305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.814331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.814409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.814540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.814575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.814701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.814790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.814819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.814928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.815032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.815058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.815190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.815332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.815360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.815507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.815638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.815667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.815811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.815924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.815950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.816064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.816167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.816193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.816320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.816401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.816427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.816514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.816629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.816655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.816795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.816941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.816969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.817099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.817199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.817225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.817313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.817455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.817481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.817611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.817763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.817789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.287 qpair failed and we were unable to recover it. 00:30:41.287 [2024-11-16 17:06:26.817909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.287 [2024-11-16 17:06:26.817995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.818029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.818218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.818367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.818408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.818548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.818684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.818711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.818819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.818909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.818935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.819044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.819131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.819158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.819256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.819361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.819386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.819520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.819602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.819652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.819767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.819880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.819907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.819987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.820094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.820131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.820205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.820277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.820302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.820413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.820527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.820552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.820634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.820723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.820748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.820865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.820937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.820963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.821152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.821290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.821316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.821428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.821518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.821544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.821737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.821883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.821909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.822021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.822133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.822159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.822278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.822352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.822378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.822459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.822573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.822598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.822746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.822824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.822850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.822986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.823077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.823106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.823266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.823358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.823387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.823498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.823589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.823621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.823706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.823813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.823838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.823957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.824066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.824092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.824197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.824310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.824336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.824463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.824574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.824601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.824736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.824811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.824837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.824920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.825109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.288 [2024-11-16 17:06:26.825135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.288 qpair failed and we were unable to recover it. 00:30:41.288 [2024-11-16 17:06:26.825254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.825398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.825424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.825536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.825643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.825682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.825793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.825866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.825892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.826018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.826157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.826183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.826265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.826376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.826402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.826517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.826667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.826695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.826834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.826953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.826983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.827067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.827231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.827260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.827398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.827510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.827536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.827656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.827762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.827788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.827872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.827946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.827971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.828092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.828206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.828231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.828350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.828505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.828530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.828603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.828732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.828758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.828872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.828978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.829004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.829089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.829210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.829236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.829347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.829469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.829512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.829594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.829688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.829715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.829796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.829934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.829960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.830074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.830247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.830273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.830416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.830541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.830566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.830653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.830766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.830792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.830875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.831010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.831040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.831171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.831277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.831303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.831381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.831492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.831518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.831637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.831725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.831751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.831837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.831944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.831970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.832092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.832173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.832199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.289 [2024-11-16 17:06:26.832356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.832511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.289 [2024-11-16 17:06:26.832539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.289 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.832712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.832824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.832850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.832960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.833075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.833102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.833182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.833294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.833321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.833432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.833516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.833542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.833662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.833739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.833765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.833842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.833924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.833950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.834077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.834199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.834250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.834364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.834503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.834530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.834648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.834771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.834798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.834916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.834997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.835031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.835176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.835336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.835380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.835496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.835584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.835610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.835724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.835886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.835913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.836026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.836142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.836168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.836250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.836332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.836357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.836462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.836534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.836559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.836643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.836779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.836805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.836919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.837025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.837068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.837227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.837318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.837348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.837512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.837656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.837682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.837834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.837950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.837994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.838109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.838190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.838219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.838343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.838503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.838532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.838637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.838742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.838768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.838895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.839009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.839038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.839155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.839246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.839274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.839368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.839460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.839488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.839642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.839764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.839794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.290 qpair failed and we were unable to recover it. 00:30:41.290 [2024-11-16 17:06:26.839919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.290 [2024-11-16 17:06:26.840105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.840156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.840318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.840477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.840504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.840627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.840762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.840806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.840904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.841064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.841095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.841275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.841410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.841437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.841522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.841699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.841745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.841835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.841909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.841935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.842094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.842208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.842235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.842350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.842469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.842495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.842660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.842768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.842798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.842909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.842991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.843026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.843150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.843290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.843317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.843440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.843586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.843612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.843784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.843928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.843976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.844079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.844216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.844243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.844337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.844480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.844507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.844587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.844744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.844770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.844884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.844990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.845016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.845129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.845256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.845282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.845420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.845512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.845539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.845635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.845719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.845747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.845863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.846008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.846035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.846149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.846271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.846298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.846403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.846522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.846549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.291 [2024-11-16 17:06:26.846663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.846739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.291 [2024-11-16 17:06:26.846764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.291 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.846901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.847012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.847040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.847120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.847238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.847265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.847383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.847471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.847499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.847580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.847730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.847761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.847843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.847947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.847974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.848099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.848216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.848246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.848338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.848455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.848484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.848630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.848747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.848773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.848854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.849005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.849031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.849111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.849250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.849285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.849367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.849481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.849508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.849623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.849762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.849790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.849891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.850029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.850058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.850201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.850291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.850318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.850434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.850522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.850549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.850647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.850759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.850786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.850956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.851077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.851103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.851240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.851329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.851356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.851476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.851581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.851608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.851725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.851800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.851826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.851942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.852057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.852084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.852163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.852239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.852265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.852406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.852574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.852601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.852741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.852902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.852945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.853075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.853209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.853236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.853411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.853521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.853547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.853691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.853780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.853806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.853919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.854032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.292 [2024-11-16 17:06:26.854058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.292 qpair failed and we were unable to recover it. 00:30:41.292 [2024-11-16 17:06:26.854140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.854217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.854243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.854357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.854477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.854503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.854600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.854722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.854752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.854846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.854932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.854959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.855073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.855213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.855239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.855329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.855452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.855478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.855594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.855741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.855768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.855886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.856023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.856049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.856170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.856255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.856281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.856387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.856514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.856540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.856659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.856756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.856782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.856897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.856979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.857004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.857141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.857274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.857301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.857441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.857531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.857556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.857674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.857775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.857804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.857921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.858024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.858050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.858139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.858253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.858279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.858391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.858509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.858535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.858636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.858779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.858805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.858921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.859006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.859032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.859174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.859280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.859305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.859443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.859525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.859552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.859653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.859793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.859836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.859981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.860116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.860142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.860275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.860364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.860389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.860502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.860614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.860647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.860798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.860907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.860945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.861037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.861119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.861146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.293 qpair failed and we were unable to recover it. 00:30:41.293 [2024-11-16 17:06:26.861297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.293 [2024-11-16 17:06:26.861381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.861407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.861551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.861671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.861700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.861821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.861906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.861933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.862037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.862146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.862172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.862313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.862405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.862432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.862526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.862634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.862660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.862752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.862858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.862885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.862979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.863156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.863182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.863305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.863396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.863423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.863506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.863580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.863623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.863744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.863830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.863856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.863949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.864065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.864091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.864176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.864260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.864287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.864404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.864515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.864540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.864644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.864740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.864767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.864879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.864997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.865023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.865136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.865248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.865277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.865360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.865470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.865496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.865581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.865699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.865725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.865813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.865925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.865951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.866073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.866162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.866189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.866304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.866416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.866442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.866586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.866726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.866753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.866928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.867093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.867138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.867257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.867365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.867391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.867530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.867614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.867660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.867816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.867924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.867951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.868094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.868194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.868220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.294 [2024-11-16 17:06:26.868327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.868445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.294 [2024-11-16 17:06:26.868472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.294 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.868589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.868735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.868762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.868876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.869016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.869043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.869131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.869268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.869295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.869391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.869505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.869532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.869655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.869773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.869799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.869931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.870021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.870052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.870163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.870275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.870301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.870383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.870493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.870519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.870639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.870754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.870782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.870921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.871037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.871064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.871183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.871296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.871323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.871462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.871553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.871578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.871697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.871771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.871797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.871907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.872021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.872047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.872185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.872269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.872295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.872406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.872487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.872513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.872629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.872772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.872798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.872921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.873008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.873034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.873146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.873240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.873267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.873409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.873547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.873574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.873687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.873795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.873824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.873943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.874088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.874115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.874232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.874372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.874397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.874511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.874602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.874635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.874766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.874928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.874971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.875096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.875182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.875208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.875316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.875443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.875470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.875591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.875719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.295 [2024-11-16 17:06:26.875746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.295 qpair failed and we were unable to recover it. 00:30:41.295 [2024-11-16 17:06:26.875936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.876043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.876069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.876190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.876270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.876297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.876384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.876490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.876516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.876667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.876747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.876777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.876869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.876948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.876975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.877089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.877196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.877222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.877368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.877457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.877484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.877567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.877676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.877702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.877844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.877958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.877985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.878100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.878212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.878239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.878361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.878447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.878472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.878621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.878701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.878728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.878842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.878982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.879008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.879118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.879235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.879265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.879380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.879536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.879564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.879731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.879853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.879887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.880000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.880089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.880116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.880231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.880355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.880382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.880524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.880669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.880696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.880835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.880924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.880950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.881056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.881200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.881228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.881313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.881399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.881428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.881525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.881622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.881650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.881767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.881851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.881894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.881973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.882086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.296 [2024-11-16 17:06:26.882114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.296 qpair failed and we were unable to recover it. 00:30:41.296 [2024-11-16 17:06:26.882198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.882315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.882344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.882454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.882572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.882599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.882736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.882848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.882875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.882992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.883077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.883103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.883189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.883335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.883366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.883458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.883574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.883602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.883740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.883857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.883884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.884005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.884152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.884178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.884293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.884415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.884447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.884592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.884695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.884723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.884813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.884924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.884950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.885062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.885144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.885171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.885283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.885372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.885399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.885509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.885629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.885655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.885767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.885906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.885932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.886015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.886128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.886155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.886236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.886345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.886372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.886461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.886600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.886637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.886754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.886865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.886892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.887015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.887097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.887124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.887234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.887353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.887380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.887494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.887609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.887646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.887761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.887856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.887882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.888000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.888113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.888138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.888215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.888354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.888380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.888529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.888612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.888646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.888783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.888919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.888946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.889048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.889174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.297 [2024-11-16 17:06:26.889200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.297 qpair failed and we were unable to recover it. 00:30:41.297 [2024-11-16 17:06:26.889340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.889451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.889482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.889607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.889741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.889785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.889906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.890020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.890047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.890158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.890296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.890323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.890408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.890501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.890527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.890612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.890735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.890760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.890905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.891018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.891046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.891135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.891249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.891277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.891362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.891480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.891520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.891642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.891723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.891749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.891845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.891948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.891974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.892061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.892279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.892306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.892444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.892561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.892588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.892685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.892813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.892843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.892940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.893045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.893070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.893221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.893334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.893361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.893497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.893626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.893652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.893797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.893888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.893915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.894026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.894167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.894193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.894283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.894363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.894388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.894475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.894589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.894620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.894747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.894828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.894853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.894950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.895088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.895114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.895230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.895344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.895371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.895514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.895664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.895691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.895769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.895886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.895912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.896000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.896118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.896145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.896257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.896353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.298 [2024-11-16 17:06:26.896379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.298 qpair failed and we were unable to recover it. 00:30:41.298 [2024-11-16 17:06:26.896466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.896580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.896607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.896697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.896784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.896811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.896953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.897074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.897105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.897223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.897339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.897366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.897462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.897537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.897562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.897682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.897769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.897796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.897905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.898043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.898081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.898203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.898342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.898368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.898487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.898598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.898632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.898749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.898865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.898892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.898984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.899095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.899131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.899277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.899387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.899414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.899535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.899678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.899705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.899850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.899942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.899967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.900110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.900197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.900223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.900339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.900449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.900476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.900600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.900688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.900717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.900828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.900911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.900938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.901015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.901117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.901146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.901268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.901348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.901374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.901521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.901635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.901661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.901817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.901956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.901982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.902120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.902237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.902265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.902361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.902475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.902501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.902640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.902759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.902789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.902879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.902993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.903019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.903107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.903236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.903262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.903353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.903460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.299 [2024-11-16 17:06:26.903485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.299 qpair failed and we were unable to recover it. 00:30:41.299 [2024-11-16 17:06:26.903633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.903749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.903775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.903908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.903994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.904021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.904161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.904264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.904291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.904404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.904545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.904571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.904679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.904838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.904881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.904985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.905119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.905149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.905269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.905397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.905424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.905538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.905632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.905659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.905746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.905856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.905882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.905993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.906108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.906134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.906276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.906392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.906418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.906504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.906614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.906656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.906762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.906841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.906884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.907018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.907133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.907161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.907284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.907419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.907448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.907544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.907683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.907710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.907798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.907940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.907984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.908167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.908292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.908333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.908491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.908640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.908685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.908803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.908948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.908974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.909738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.909882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.909929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.910056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.910205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.910234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.910357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.910483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.910513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.910614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.910735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.910762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.910873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.911002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.911027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.911156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.911286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.911316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.911437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.911574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.911602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.911725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.911810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.911836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.300 qpair failed and we were unable to recover it. 00:30:41.300 [2024-11-16 17:06:26.911953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.300 [2024-11-16 17:06:26.912088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.912113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.912252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.912337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.912367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.912491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.912624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.912669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.912782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.912927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.912952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.913080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.913242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.913271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.913377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.913515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.913555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.913648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.913778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.913804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.913884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.914029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.914056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.914132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.914242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.914285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.914439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.914566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.914595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.914778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.914888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.914914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.915016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.915130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.915159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.915271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.915399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.915427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.915536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.915645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.915672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.915756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.915835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.915862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.915979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.916084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.916110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.916235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.916365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.916393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.916481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.916582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.916624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.916768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.916855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.916881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.917037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.917139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.917164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.917239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.917328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.917353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.917474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.917629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.917674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.917783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.917861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.917887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.917998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.918132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.918174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.918271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.918387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.301 [2024-11-16 17:06:26.918417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.301 qpair failed and we were unable to recover it. 00:30:41.301 [2024-11-16 17:06:26.918549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.918666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.918693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.918786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.918865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.918907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.919000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.919116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.919162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.919290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.919406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.919434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.919527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.919660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.919687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.919778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.919897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.919922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.920033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.920118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.920160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.920283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.920386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.920414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.920546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.920695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.920721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.920801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.920887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.920929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.921027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.921144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.921173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.921323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.921424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.921452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.921555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.921649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.921679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.921756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.921833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.921860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.922010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.922151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.922177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.922309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.922456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.922484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.922608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.922748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.922775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.922887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.923043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.923069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.923218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.923340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.923368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.923485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.923587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.923633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.923737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.923827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.923853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.923990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.924106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.924139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.924271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.924447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.924497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.924591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.924688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.924718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.924849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.924990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.925016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.925135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.925307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.925353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.925461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.925547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.925573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.925696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.925827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.925853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.302 qpair failed and we were unable to recover it. 00:30:41.302 [2024-11-16 17:06:26.925945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.302 [2024-11-16 17:06:26.926035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.926063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.926200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.926339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.926365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.926474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.926586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.926628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.926727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.926816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.926843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.926955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.927068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.927095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.927183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.927285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.927311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.927425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.927553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.927580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.927703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.927790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.927817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.927941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.928079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.928105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.928214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.928293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.928319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.928424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.928533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.928560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.928666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.928759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.928786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.928877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.928965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.928991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.929136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.929221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.929247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.929333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.929452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.929478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.929607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.929751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.929782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.929926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.930055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.930085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.930247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.930370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.930399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.930516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.930653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.930696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.930807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.930894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.930945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.931098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.931221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.931251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.931374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.931478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.931506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.931651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.931745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.931771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.931922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.932039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.932068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.932168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.932285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.932314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.932452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.932546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.932576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.932727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.932863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.932908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.933073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.933224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.933267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.303 qpair failed and we were unable to recover it. 00:30:41.303 [2024-11-16 17:06:26.933400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.303 [2024-11-16 17:06:26.933533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.933561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.933692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.933801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.933829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.934005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.934178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.934207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.934363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.934468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.934494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.934574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.934715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.934761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.934859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.935006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.935054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.935191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.935308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.935334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.935451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.935567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.935593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.935706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.935806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.935837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.935934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.936050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.936077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.936198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.936275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.936300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.936412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.936526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.936552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.936670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.936788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.936816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.936931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.937055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.937084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.937226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.937343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.937371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.937491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.937580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.937624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.937757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.937837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.937864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.938072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.938164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.938193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.938289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.938403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.938431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.938520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.938655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.938683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.938765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.938845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.938871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.938955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.939079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.939107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.939192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.939279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.939308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.939450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.939564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.939589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.939719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.939794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.939819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.939912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.940016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.940044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.940191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.940343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.940372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.940504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.940644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.940686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.304 qpair failed and we were unable to recover it. 00:30:41.304 [2024-11-16 17:06:26.940800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.940877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.304 [2024-11-16 17:06:26.940919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.941026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.941136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.941161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.941249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.941380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.941408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.941500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.941595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.941638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.941751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.941896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.941925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.942087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.942241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.942269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.942416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.942521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.942549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.942692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.942781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.942807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.942916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.943019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.943060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.943156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.943254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.943282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.943432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.943558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.943586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.943724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.943827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.943857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.943947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.944083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.944112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.944211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.944338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.944367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.944483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.944577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.944630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.944738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.944820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.944846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.944936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.945092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.945121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.945239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.945324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.945353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.945468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.945601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.945639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.945726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.945810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.945852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.945967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.946133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.946162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.946310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.946395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.946424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.946548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.946640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.946668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.946773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.946848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.946890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.947026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.947131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.947160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.305 qpair failed and we were unable to recover it. 00:30:41.305 [2024-11-16 17:06:26.947284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.305 [2024-11-16 17:06:26.947399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.947427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.947561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.947722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.947749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.947857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.947992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.948022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.948122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.948206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.948234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.948353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.948476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.948509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.948643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.948757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.948784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.948880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.949000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.949029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.949124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.949226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.949253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.949368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.949452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.949492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.949596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.949715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.949756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.949837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.949987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.950016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.950141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.950292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.950320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.950449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.950594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.950641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.950756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.950883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.950933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.951058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.951223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.951257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.951367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.951478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.951506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.951640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.951748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.951774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.951859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.951960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.951989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.952115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.952215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.952243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.952396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.952504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.952530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.952643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.952749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.952775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.952849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.952942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.952969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.953052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.953183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.953225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.953328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.953448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.953476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.953612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.953700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.953726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.953844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.953955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.953980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.954098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.954197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.954226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.954328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.954468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.954494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.306 [2024-11-16 17:06:26.954611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.954698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.306 [2024-11-16 17:06:26.954724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.306 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.954836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.954967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.954996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.955159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.955271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.955296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.955429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.955521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.955550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.955652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.955762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.955788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.955903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.956011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.956037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.956176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.956278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.956304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.956420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.956575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.956603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.956706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.956795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.956821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.956951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.957070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.957099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.957224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.957372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.957402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.957525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.957635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.957671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.957780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.957871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.957925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.958020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.958131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.958160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.958267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.958374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.958400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.958488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.958575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.958612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.958739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.958821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.958846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.958969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.959057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.959082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.959231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.959361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.959389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.959477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.959568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.959598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.959703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.959776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.959800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.959921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.960029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.960057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.960186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.960322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.960348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.960429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.960539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.960565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.960714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.960825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.960851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.960984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.961098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.961127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.961252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.961323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.961349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.961478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.961596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.961664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.961780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.961862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.961888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.307 qpair failed and we were unable to recover it. 00:30:41.307 [2024-11-16 17:06:26.962035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.307 [2024-11-16 17:06:26.962148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.962174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.962280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.962363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.962406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.962533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.962695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.962723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.962805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.962942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.962968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.963079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.963197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.963222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.963338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.963444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.963469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.963549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.963639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.963666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.963758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.963861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.963886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.964012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.964146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.964172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.964265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.964377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.964403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.964530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.964653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.964682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.964778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.964896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.964925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.965028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.965117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.965142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.965283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.965376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.965401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.965489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.965588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.965657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.965802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.965919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.965946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.966112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.966228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.966257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.966351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.966465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.966494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.966662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.966771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.966797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.966942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.967096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.967125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.967214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.967307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.967335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.967443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.967556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.967582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.967716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.967826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.967852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.968003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.968100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.968129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.968235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.968339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.968366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.968481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.968561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.968587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.968714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.968816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.968862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.968988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.969072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.969097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.969208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.969336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.969363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.969523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.969602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.969643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.308 qpair failed and we were unable to recover it. 00:30:41.308 [2024-11-16 17:06:26.969756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.969864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.308 [2024-11-16 17:06:26.969890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.969979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.970081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.970109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.970194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.970310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.970339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.970442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.970523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.970548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.970655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.970822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.970863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.971002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.971132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.971160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.971324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.971464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.971489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.971604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.971726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.971754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.971870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.971975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.972003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.972139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.972233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.972260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.972362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.972479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.972508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.972610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.972706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.972735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.972871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.972983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.973008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.973156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.973285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.973314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.973465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.973584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.973613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.973766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.973876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.973902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.974010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.974169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.974195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.974300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.974456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.974484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.974649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.974767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.974793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.974902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.975010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.975040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.975156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.975314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.975342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.975474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.975610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.975643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.975772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.975899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.975927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.976061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.976142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.976168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.976282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.976419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.976445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.976555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.976685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.976714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.976860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.976986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.977011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.977151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.977239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.977265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.977382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.977463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.977505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.977604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.977716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.977745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.977855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.977965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.977990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.309 [2024-11-16 17:06:26.978095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.978179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.309 [2024-11-16 17:06:26.978208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.309 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.978366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.978448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.978473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.978607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.978760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.978804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.978911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.978998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.979026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.979117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.979266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.979295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.979416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.979496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.979521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.979641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.979777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.979804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.979958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.980061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.980086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.980237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.980351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.980377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.980514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.980632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.980661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.980808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.980953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.980982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.981120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.981201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.981226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.981333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.981473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.981502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.981598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.981736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.981766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.981878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.982001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.982027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.982142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.982251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.982280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.982410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.982535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.982561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.982640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.982751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.982777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.982891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.983013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.983038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.983140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.983279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.983305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.983450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.983531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.983558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.983731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.983814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.983840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.983970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.984119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.984148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.984253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.984362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.984388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.984539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.984639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.984666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.984770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.984916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.984944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.985114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.985250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.985291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.985422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.985528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.985553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.310 [2024-11-16 17:06:26.985685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.985783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.310 [2024-11-16 17:06:26.985812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.310 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.985927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.986040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.986070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.986193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.986296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.986322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.986439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.986574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.986600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.986698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.986805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.986832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.986936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.987045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.987073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.987157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.987270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.987297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.987475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.987582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.987607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.987752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.987841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.987870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.987997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.988147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.988173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.988315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.988426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.988453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.988612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.988712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.988760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.988899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.988980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.989005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.989162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.989268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.989294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.989423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.989516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.989545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.989682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.989844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.989871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.989994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.990103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.990129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.990232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.990347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.990376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.990523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.990604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.990650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.990785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.990924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.990955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.991045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.991173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.991199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.311 [2024-11-16 17:06:26.991279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.991394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.311 [2024-11-16 17:06:26.991437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.311 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.991587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.991693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.991720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.991867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.992000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.992028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.992159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.992294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.992320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.992409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.992521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.992547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.992625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.992703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.992728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.992828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.992954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.992980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.993090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.993171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.993196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.993273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.993366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.993394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.993522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.993651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.993679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.993792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.993877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.993903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.993997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.994108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.994134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.994244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.994377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.994403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.994514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.994599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.994630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.994745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.994823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.994849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.994954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.995112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.995141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.995305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.995418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.995444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.995601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.995751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.995778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.995870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.996032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.996058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.996168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.996255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.996282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.996356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.996522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.996550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.996704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.996805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.996833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.996968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.997082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.997108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.997190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.997297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.997323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.997460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.997561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.596 [2024-11-16 17:06:26.997591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.596 qpair failed and we were unable to recover it. 00:30:41.596 [2024-11-16 17:06:26.997730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.997837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.997863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:26.997980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.998100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.998131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:26.998256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.998366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.998392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:26.998471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.998580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.998606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:26.998749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.998897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.998926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:26.999022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.999149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.999175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:26.999315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.999432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.999462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:26.999572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.999664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.999690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:26.999790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.999940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:26.999968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.000055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.000159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.000186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.000298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.000477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.000503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.000621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.000748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.000776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.000933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.001015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.001041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.001177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.001262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.001294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.001411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.001526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.001554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1331505 Killed "${NVMF_APP[@]}" "$@" 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.001696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.001785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.001811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 17:06:27 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:41.597 [2024-11-16 17:06:27.001926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.002041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.002067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 17:06:27 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.002177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 17:06:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:41.597 [2024-11-16 17:06:27.002285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.002313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 17:06:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:41.597 [2024-11-16 17:06:27.002450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 17:06:27 -- common/autotest_common.sh@10 -- # set +x 00:30:41.597 [2024-11-16 17:06:27.002594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.002637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.002765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.002861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.002890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.002987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.003121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.003147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.003275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.003365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.003391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.003490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.003606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.003640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.003739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.003830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.003858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.003970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.004057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.004082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.004185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.004344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.004386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.004532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.004672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.597 [2024-11-16 17:06:27.004698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.597 qpair failed and we were unable to recover it. 00:30:41.597 [2024-11-16 17:06:27.004779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.004865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.004890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.005009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.005123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.005166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.005259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.005352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.005380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.005491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.005606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.005647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.005729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 17:06:27 -- nvmf/common.sh@469 -- # nvmfpid=1332084 00:30:41.598 [2024-11-16 17:06:27.005836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 17:06:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:41.598 [2024-11-16 17:06:27.005861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 17:06:27 -- nvmf/common.sh@470 -- # waitforlisten 1332084 00:30:41.598 [2024-11-16 17:06:27.005978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.006130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 17:06:27 -- common/autotest_common.sh@829 -- # '[' -z 1332084 ']' 00:30:41.598 [2024-11-16 17:06:27.006159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.006256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 17:06:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:41.598 [2024-11-16 17:06:27.006370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.006395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 17:06:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:41.598 [2024-11-16 17:06:27.006502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 17:06:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:41.598 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:41.598 [2024-11-16 17:06:27.006607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.006660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 17:06:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:41.598 [2024-11-16 17:06:27.006744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 17:06:27 -- common/autotest_common.sh@10 -- # set +x 00:30:41.598 [2024-11-16 17:06:27.006827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.006853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.006966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.007078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.007104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.007231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.007320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.007349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.007472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.007595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.007649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.007819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.007940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.007966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.008096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.008232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.008262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.008415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.008506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.008535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.008736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.008850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.008876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.009059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.009169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.009195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.009336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.009433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.009462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.009593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.009731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.009757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.009847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.009963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.009989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.010104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.010192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.010218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.010305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.010390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.010416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.010525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.010669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.010695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.010833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.010988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.011014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.011129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.011232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.011258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.011371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.011451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.011477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.598 qpair failed and we were unable to recover it. 00:30:41.598 [2024-11-16 17:06:27.011587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.598 [2024-11-16 17:06:27.011677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.011703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.011817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.011910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.011935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.012048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.012123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.012149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.012269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.012359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.012385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.012467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.012576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.012601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.012690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.012803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.012829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.012979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.013061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.013097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.013178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.013253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.013278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.013384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.013498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.013523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.013606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.013735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.013761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.013842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.013930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.013957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.014033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.014112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.014145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.014266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.014354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.014379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.014485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.014570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.014596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.014714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.014801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.014827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.014946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.015055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.015080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.015165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.015302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.015328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.015448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.015554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.015579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.015685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.015777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.015803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.015894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.016033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.016060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.016212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.016323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.016351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.016438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.016578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.016623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.016745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.016860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.016886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.016970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.017080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.017106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.599 [2024-11-16 17:06:27.017225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.017336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.599 [2024-11-16 17:06:27.017362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.599 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.017442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.017515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.017540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.017666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.017804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.017830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.017951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.018044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.018069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.018176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.018293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.018318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.018396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.018508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.018534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.018645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.018726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.018752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.018870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.018981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.019007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.019135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.019212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.019239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.019355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.019454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.019480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.019559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.019651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.019677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.019788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.019898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.019924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.020016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.020094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.020130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.020236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.020345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.020371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.020481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.020590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.020621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.020703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.020837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.020863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.020952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.021025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.021051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.021205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.021275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.021300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.021383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.021496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.021522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.021636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.021724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.021749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.021862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.021939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.021967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.600 qpair failed and we were unable to recover it. 00:30:41.600 [2024-11-16 17:06:27.022090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.600 [2024-11-16 17:06:27.022198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.022223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.022298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.022386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.022412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.022489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.022592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.022655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.022771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.022852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.022877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.022969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.023056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.023082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.023186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.023300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.023326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.023404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.023517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.023542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.023642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.023752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.023778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.023868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.023980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.024006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.024083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.024187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.024213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.024286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.024399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.024428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.024553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.024671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.024697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.024777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.024893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.024929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.025043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.025181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.025207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.025295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.025409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.025437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.025541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.025628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.601 [2024-11-16 17:06:27.025658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.601 qpair failed and we were unable to recover it. 00:30:41.601 [2024-11-16 17:06:27.025799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.025882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.025914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.026031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.026142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.026173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.026281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.026361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.026386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.026498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.026583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.026637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.026758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.026852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.026878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.027018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.027137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.027163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.027247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.027334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.027359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.027443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.027566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.027591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.027687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.027827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.027852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.027946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.028053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.028079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.028163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.028269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.028295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.028376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.028487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.028512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.028637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.028746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.028772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.028912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.029000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.029026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.029141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.029220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.029246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.029360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.029441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.029467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.029574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.029666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.029694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.029810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.029915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.029941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.030060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.030176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.030202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.602 [2024-11-16 17:06:27.030286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.030434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.602 [2024-11-16 17:06:27.030461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.602 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.030571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.030664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.030691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.030776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.030858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.030884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.031009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.031096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.031122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.031219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.031307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.031333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.031481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.031558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.031583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.031689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.031801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.031827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.031934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.032070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.032096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.032210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.032291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.032324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.032415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.032500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.032526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.032653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.032739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.032765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.032844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.032965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.032990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.033129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.033219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.033245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.033402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.033523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.033550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.033667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.033780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.033806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.033900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.033980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.034006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.034091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.034224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.034250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.034340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.034428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.034456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.034540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.034651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.034678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.034753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.034831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.034857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.034980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.035054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.035080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.035164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.035253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.035279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.035418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.035510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.035537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.035646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.035723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.035753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.035900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.036007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.036033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.036171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.036249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.036274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.036391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.036509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.036535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.036630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.036707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.036734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.603 qpair failed and we were unable to recover it. 00:30:41.603 [2024-11-16 17:06:27.036840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.603 [2024-11-16 17:06:27.036953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.036988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.037099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.037211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.037237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.037348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.037433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.037459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.037536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.037626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.037666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.037751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.037889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.037915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.038037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.038127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.038153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.038266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.038379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.038405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.038542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.038639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.038667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.038820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.038957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.038983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.039076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.039166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.039191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.039305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.039378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.039404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.039509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.039592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.039624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.039734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.039849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.039874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.039961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.040071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.040097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.040172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.040243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.040268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.040378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.040460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.040486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.040576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.040737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.040763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.040881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.040999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.041025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.041107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.041227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.041253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.041337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.041450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.041475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.041581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.041680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.041706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.041797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.041907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.041933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.042019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.042107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.042132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.042211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.042328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.042354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.042441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.042522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.042548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.042628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.042709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.042734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.042851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.042925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.042951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.043028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.043131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.043158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.043241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.043352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.604 [2024-11-16 17:06:27.043388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.604 qpair failed and we were unable to recover it. 00:30:41.604 [2024-11-16 17:06:27.043527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.043634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.043661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.043771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.043861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.043887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.044000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.044104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.044129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.044220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.044331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.044357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.044440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.044562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.044587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.044712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.044823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.044848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.044959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.045066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.045091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.045207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.045322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.045347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.045464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.045580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.045605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.045715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.045819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.045845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.045958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.046047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.046073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.046211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.046326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.046351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.046432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.046517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.046543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.046667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.046754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.046780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.046862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.047004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.047030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.047141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.047215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.047240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.047353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.047456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.047481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.047591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.047711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.047741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.047902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.048013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.048039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.048126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.048240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.048265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.048352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.048436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.048462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.048601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.048685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.048721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.048867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.048988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.049014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.049104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.049184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.049211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.049303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.049449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.049442] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:41.605 [2024-11-16 17:06:27.049475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.049504] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:41.605 [2024-11-16 17:06:27.049566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.049674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.049700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.049825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.049936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.049959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.605 qpair failed and we were unable to recover it. 00:30:41.605 [2024-11-16 17:06:27.050051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.050161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.605 [2024-11-16 17:06:27.050186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.050266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.050367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.050393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.050609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.050710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.050736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.050877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.050974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.050998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.051100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.051215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.051240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.051351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.051457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.051482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.051585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.051717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.051743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.051829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.052027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.052053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.052167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.052306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.052332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.052415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.052556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.052582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.052688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.052762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.052788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.052873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.052959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.052985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.053076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.053188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.053213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.053294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.053410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.053435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.053520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.053627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.053658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.053739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.053867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.053892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.053977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.054121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.054147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.054260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.054369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.054394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.054510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.054587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.054612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.054734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.054847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.054872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.055007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.055120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.055145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.606 [2024-11-16 17:06:27.055232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.055337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.606 [2024-11-16 17:06:27.055362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.606 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.055444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.055528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.055563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.055645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.055727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.055754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.055830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.055939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.055967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.056054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.056166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.056192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.056280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.056362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.056387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.056505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.056623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.056648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.056738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.056843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.056868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.056962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.057057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.057081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.057161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.057267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.057296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.057381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.057467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.057494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.057606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.057725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.057751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.057841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.057928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.057953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.058104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.058190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.058217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.058309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.058389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.058414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.058508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.058592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.058630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.058774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.058882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.058918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.059006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.059118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.059143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.059268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.059405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.059431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.059582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.059709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.059735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.059892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.060000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.060036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.060123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.060197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.060223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.060310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.060409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.060434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.060548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.060639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.060665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.060809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.060924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.060950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.061040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.061125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.061149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.061263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.061386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.061412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.061488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.061607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.061646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.061735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.061841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.061867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.607 qpair failed and we were unable to recover it. 00:30:41.607 [2024-11-16 17:06:27.061968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.607 [2024-11-16 17:06:27.062084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.062108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.062219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.062358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.062384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.062470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.062606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.062636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.062745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.062857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.062883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.062995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.063104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.063129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.063209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.063292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.063318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.063417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.063521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.063547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.063639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.063716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.063743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.063859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.063951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.063976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.064082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.064157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.064182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.064269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.064380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.064404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.064510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.064599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.064632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.064751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.064890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.064915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.065052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.065166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.065191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.065302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.065388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.065413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.065518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.065629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.065655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.065771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.065850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.065875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.066011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.066111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.066142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.066263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.066347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.066375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.066489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.066602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.066645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.066758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.066841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.066868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.066958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.067049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.067076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.067196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.067283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.067309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.067392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.067470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.067496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.067649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.067762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.067789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.067903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.068012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.068039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.068156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.068296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.068322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.068407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.068545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.068572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.068750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.068900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.608 [2024-11-16 17:06:27.068926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.608 qpair failed and we were unable to recover it. 00:30:41.608 [2024-11-16 17:06:27.069023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.069139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.069165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.069247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.069331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.069358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.069472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.069563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.069590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.069714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.069820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.069846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.069927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.070020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.070048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.070165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.070271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.070297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.070410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.070493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.070521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.070610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.070713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.070739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.070848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.070960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.070986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.071065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.071188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.071215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.071355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.071445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.071471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.071588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.071710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.071737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.071848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.071929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.071961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.072085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.072231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.072257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.072367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.072455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.072481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.072627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.072741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.072767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.072886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.073019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.073044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.073123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.073210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.073236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.073338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.073474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.073501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.073630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.073747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.073774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.073863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.073960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.073986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.074133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.074217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.074243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.074353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.074441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.074477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.074572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.074695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.074721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.074837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.074959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.074985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.075100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.075241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.075267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.075350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.075462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.075489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.075611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.075735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.075762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.609 qpair failed and we were unable to recover it. 00:30:41.609 [2024-11-16 17:06:27.075844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.609 [2024-11-16 17:06:27.075956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.075982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.076062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.076139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.076165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.076277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.076405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.076431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.076518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.076592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.076623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.076767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.076850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.076881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.076978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.077106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.077132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.077248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.077382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.077409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.077498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.077638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.077665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.077781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.077899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.077925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.078062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.078170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.078196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.078290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.078424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.078450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.078565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.078661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.078689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.078802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.078897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.078933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.079127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.079214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.079241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.079382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.079498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.079528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.079611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.079710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.079736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.079850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.079971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.079997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.080089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.080172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.080198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.080287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.080373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.080400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.080592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.080742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.080769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.080860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.080968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.080995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.081072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.081210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.081236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.081322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.081408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.081436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.081525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.081613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.081647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.081731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.081847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.081874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.081998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.082088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.082114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.082258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.082364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.082393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.082479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.082588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.082631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.082726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.082813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.610 [2024-11-16 17:06:27.082839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.610 qpair failed and we were unable to recover it. 00:30:41.610 [2024-11-16 17:06:27.082964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.083076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.083102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.083216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.083354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.083380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.083503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.083629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.083656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.083771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.083862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.083887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.084009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.084091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.084119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.084211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.084324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.084350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.084474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.084584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.084626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.084744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.084834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.084860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.084940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.085047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.085073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.085188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.085301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.085329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.085413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.085524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.085551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.085652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.085769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.085795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.085886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.086002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.086029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.086145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.086296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.086323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.086439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.086551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.086577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.086671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.086811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.086837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.086986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.087095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.087121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.087267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.087350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.087377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.087520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.087669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.087696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.087809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.087893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.087922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.088011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.088120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.088145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 EAL: No free 2048 kB hugepages reported on node 1 00:30:41.611 [2024-11-16 17:06:27.088232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.088342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.088367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.088448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.088575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.088602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.088714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.088799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.088825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.611 qpair failed and we were unable to recover it. 00:30:41.611 [2024-11-16 17:06:27.088945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.611 [2024-11-16 17:06:27.089055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.089082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.089230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.089347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.089373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.089500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.089602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.089636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.089744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.089822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.089849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.089979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.090095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.090122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.090233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.090338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.090365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.090481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.090572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.090598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.090763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.090849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.090876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.091032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.091130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.091156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.091272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.091386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.091412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.091525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.091628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.091655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.091753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.091840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.091866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.092015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.092108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.092135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.092220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.092346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.092372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.092512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.092633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.092660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.092748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.092826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.092853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.092965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.093070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.093096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.093183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.093258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.093285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.093424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.093507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.093533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.093658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.093751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.093776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.093892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.094000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.094026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.094135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.094326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.094352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.094439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.094546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.094572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.094718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.094836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.094862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.094988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.095097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.095124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.095206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.095340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.095366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.095450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.095563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.095589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.095698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.095803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.095829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.612 qpair failed and we were unable to recover it. 00:30:41.612 [2024-11-16 17:06:27.095943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.096053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.612 [2024-11-16 17:06:27.096079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.096189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.096301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.096328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.096449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.096586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.096627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.096736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.096848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.096875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.096976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.097062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.097088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.097287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.097435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.097471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.097555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.097677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.097703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.097794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.097910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.097935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.098126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.098203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.098229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.098346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.098463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.098489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.098646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.098836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.098862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.098982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.099099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.099125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.099231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.099345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.099372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.099482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.099609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.099641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.099752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.099839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.099865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.099971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.100081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.100108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.100300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.100376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.100403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.100508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.100625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.100652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.100761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.100864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.100891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.100984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.101100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.101126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.101315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.101398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.101425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.101536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.101631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.101659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.101742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.101856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.101883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.102033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.102108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.102135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.102277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.102377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.102407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.102567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.102675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.102704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.102782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.102868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.102896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.103049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.103166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.103192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.103337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.103417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.613 [2024-11-16 17:06:27.103442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.613 qpair failed and we were unable to recover it. 00:30:41.613 [2024-11-16 17:06:27.103527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.103629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.103655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.103737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.103824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.103849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.103928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.104067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.104093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.104177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.104290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.104316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.104397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.104503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.104528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.104646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.104786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.104812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.104891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.104983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.105009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.105093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.105237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.105262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.105403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.105509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.105535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.105628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.105734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.105760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.105850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.105988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.106013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.106130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.106246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.106272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.106389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.106508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.106533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.106625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.106716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.106742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.106828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.106943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.106970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.107078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.107170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.107197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.107312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.107400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.107428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.107568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.107682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.107709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.107828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.107926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.107952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.108080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.108202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.108232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.108321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.108432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.108458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.108569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.108688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.108715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.108798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.108905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.108932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.109042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.109120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.109146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.109224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.109339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.109365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.109476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.109591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.109625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.109717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.109801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.109826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.109936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.110028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.110056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.614 qpair failed and we were unable to recover it. 00:30:41.614 [2024-11-16 17:06:27.110134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.614 [2024-11-16 17:06:27.110271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.110297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.110373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.110509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.110534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.110629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.110713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.110740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.110932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.111042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.111068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.111184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.111275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.111303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.111392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.111535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.111561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.111681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.111768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.111793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.111908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.112106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.112132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.112248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.112386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.112412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.112524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.112663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.112690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.112776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.112861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.112888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.112998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.113116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.113143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.113257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.113368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.113395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.113537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.113649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.113676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.113820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.113910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.113936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.114019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.114164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.114190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.114274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.114420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.114445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.114589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.114707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.114738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.114851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.114966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.114992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.115083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.115193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.115218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.115326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.115437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.115462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.115568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.115677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.115704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.115820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.115936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.115962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.116046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.116162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.116190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.116328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.116416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.116444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.615 qpair failed and we were unable to recover it. 00:30:41.615 [2024-11-16 17:06:27.116549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.116687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.615 [2024-11-16 17:06:27.116714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.116822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.116935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.116962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.117045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.117159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.117190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.117303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.117389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.117415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.117496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.117604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.117636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.117752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.117866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.117893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.118007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.118117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.118143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.118219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.118358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.118384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.118524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.118641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.118668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.118750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.118862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.118889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.119007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.119120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.119147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.119229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.119339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.119366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.119488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.119569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.119602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.119690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.119834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.119860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.119977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.120082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.120108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.120253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.120337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.120363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.120472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.120559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.120587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.120709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.120793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.120819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.120903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.121010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.121036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.121112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.121225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.121251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.121357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.121431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.121457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.121571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.121724] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:41.616 [2024-11-16 17:06:27.121769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.121794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.121985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.122096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.122122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.122237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.122364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.122390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.122473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.122612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.122655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.122800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.122916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.122942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.123053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.123166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.123194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.123333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.123418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.123445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.616 qpair failed and we were unable to recover it. 00:30:41.616 [2024-11-16 17:06:27.123526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.616 [2024-11-16 17:06:27.123635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.123662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.123747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.123825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.123851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.123935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.124020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.124047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.124183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.124374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.124400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.124517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.124626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.124657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.124770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.124880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.124906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.125027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.125146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.125172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.125286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.125370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.125397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.125510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.125649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.125676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.125788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.125932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.125958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.126075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.126190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.126216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.126323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.126467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.126494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.126577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.126701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.126728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.126867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.126984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.127010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.127086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.127172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.127202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.127290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.127480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.127506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.127613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.127763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.127789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.127901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.128093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.128120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.128234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.128374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.128400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.128481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.128560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.128586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.128677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.128770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.128797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.128877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.129022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.129049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.129131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.129217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.129245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.129357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.129495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.129522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.129611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.129747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.129778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.129886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.129964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.129990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.130133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.130217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.130244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.130323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.130460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.130486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.617 [2024-11-16 17:06:27.130602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.130753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.617 [2024-11-16 17:06:27.130780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.617 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.130895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.130978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.131005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.131090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.131175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.131201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.131315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.131422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.131448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.131537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.131682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.131710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.131865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.131974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.132000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.132109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.132232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.132263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.132401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.132485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.132521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.132637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.132754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.132780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.132929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.133068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.133094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.133180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.133291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.133318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.133432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.133574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.133601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.133718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.133795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.133822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.133941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.134051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.134077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.134216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.134295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.134321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.134418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.134521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.134547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.134663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.134769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.134795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.134909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.135028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.135054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.135198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.135273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.135299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.135416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.135499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.135525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.135639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.135756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.135781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.135873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.135962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.135988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.136102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.136180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.136207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.136334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.136443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.136469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.136576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.136674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.136702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.136812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.136892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.136918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.137032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.137113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.137140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.137251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.137331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.137358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.137453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.137564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.137592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.618 qpair failed and we were unable to recover it. 00:30:41.618 [2024-11-16 17:06:27.137791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.618 [2024-11-16 17:06:27.137873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.137899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.138012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.138127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.138154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.138296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.138384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.138413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.138606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.138764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.138791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.138904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.139016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.139043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.139127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.139205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.139233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.139355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.139433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.139461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.139547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.139662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.139690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.139790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.139904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.139931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.140010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.140120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.140147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.140261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.140374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.140402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.140491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.140613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.140646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.140726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.140815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.140841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.140955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.141099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.141126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.141237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.141362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.141389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.141501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.141589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.141621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.141706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.141789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.141818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.141931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.142046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.142073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.142154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.142268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.142295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.142377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.142467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.142494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.142579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.142696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.142723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.142820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.142902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.142930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.143046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.143156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.143183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.143321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.143433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.143460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.143575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.143667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.143695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.143811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.143929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.143955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.144047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.144134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.144162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.144303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.144389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.144416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.619 qpair failed and we were unable to recover it. 00:30:41.619 [2024-11-16 17:06:27.144565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.144686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.619 [2024-11-16 17:06:27.144714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.144812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.144931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.144958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.145072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.145264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.145291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.145402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.145543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.145570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.145663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.145853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.145880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.145968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.146080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.146107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.146222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.146334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.146361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.146552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.146667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.146696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.146836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.146917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.146944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.147024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.147136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.147165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.147291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.147372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.147399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.147485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.147563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.147590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.147734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.147840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.147868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.147984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.148097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.148123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.148261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.148374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.148401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.148482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.148593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.148627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.148717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.148795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.148822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.148902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.149054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.149082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.149193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.149278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.149306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.149431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.149522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.149549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.149668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.149752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.149779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.149868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.150004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.150031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.150223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.150328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.150354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.150464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.150543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.150569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.150689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.150799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.150825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.620 qpair failed and we were unable to recover it. 00:30:41.620 [2024-11-16 17:06:27.150936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.620 [2024-11-16 17:06:27.151049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.151076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.151230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.151367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.151394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.151483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.151569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.151596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.151711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.151791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.151819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.151928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.152041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.152068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.152243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.152391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.152420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.152541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.152658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.152687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.152804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.152947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.152973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.153064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.153202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.153229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.153344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.153433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.153460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.153571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.153687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.153715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.153833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.153940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.153968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.154050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.154187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.154215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.154332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.154480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.154507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.154604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.154746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.154774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.154894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.155010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.155037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.155176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.155258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.155285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.155401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.155487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.155513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.155606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.155721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.155748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.155840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.155946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.155973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.156091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.156172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.156200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.156394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.156479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.156508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.156626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.156770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.156797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.156911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.157019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.157045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.157139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.157279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.157305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.157394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.157489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.157516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8964000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.157607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.157698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.621 [2024-11-16 17:06:27.157726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.621 qpair failed and we were unable to recover it. 00:30:41.621 [2024-11-16 17:06:27.157836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.157919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.157947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.158057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.158170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.158196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.158307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.158385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.158411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.158526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.158606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.158640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.158781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.158900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.158927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.159038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.159147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.159177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.159272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.159355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.159382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.159497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.159608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.159640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.159724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.159852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.159878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.160019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.160168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.160195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.160314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.160397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.160425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.160539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.160688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.160716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.160801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.160884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.160911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.161052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.161138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.161163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.161274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.161416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.161443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.161535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.161684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.161712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.161829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.161944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.161972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.162082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.162226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.162253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.162341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.162433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.162460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.162545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.162654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.162682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.162802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.162886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.162914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.163025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.163136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.163163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.163252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.163390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.163417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.163531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.163622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.163649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.163729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.163814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.163842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.163985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.164126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.164153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.164265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.164347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.164375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.164460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.164601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.164634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.622 qpair failed and we were unable to recover it. 00:30:41.622 [2024-11-16 17:06:27.164781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.622 [2024-11-16 17:06:27.164877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.164908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.165019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.165127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.165154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.165294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.165381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.165408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.165520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.165606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.165640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.165755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.165871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.165897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.165990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.166094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.166121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.166204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.166287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.166313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.166438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.166554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.166580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.166708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.166787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.166813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.166954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.167068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.167094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.167179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.167259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.167291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.167376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.167489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.167516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.167643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.167758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.167784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.167871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.167991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.168017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.168124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.168208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.168234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.168316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.168435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.168461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.168576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.168696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.168723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.168843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.168931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.168960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.169044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.169182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.169208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.169348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.169432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.169459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.169570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.169690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.169725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.169819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.169924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.169950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.170066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.170179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.170205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.170318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.170421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.170447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.170555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.170636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.170662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.170758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.170869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.170896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.171043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.171180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.171206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.171314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.171433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.171459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.623 [2024-11-16 17:06:27.171551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.171634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.623 [2024-11-16 17:06:27.171661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.623 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.171774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.171888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.171914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.172022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.172111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.172138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.172220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.172340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.172366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.172509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.172626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.172654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.172746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.172830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.172857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.173003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.173143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.173170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.173248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.173389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.173416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.173534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.173671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.173699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.173791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.173903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.173931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.174042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.174158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.174186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.174273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.174363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.174389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.174511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.174597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.174630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.174758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.174868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.174895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.175011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.175100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.175127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.175264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.175406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.175432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.175521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.175644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.175671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.175750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.175864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.175890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.175972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.176110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.176137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.176245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.176385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.176411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.176518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.176629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.176656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.176770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.176845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.176872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.176989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.177070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.177096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.177243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.177365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.177392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.177477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.177621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.177649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.177792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.177909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.177935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.178015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.178124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.178150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.178258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.178344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.178370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.178478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.178559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.624 [2024-11-16 17:06:27.178585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.624 qpair failed and we were unable to recover it. 00:30:41.624 [2024-11-16 17:06:27.178708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.178815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.178842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.178939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.179024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.179052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.179163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.179300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.179327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.179441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.179548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.179576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.179732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.179844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.179871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.179980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.180090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.180117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.180208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.180335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.180362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.180448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.180534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.180562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.180673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.180791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.180818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.180901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.181038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.181065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.181146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.181232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.181259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.181337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.181448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.181476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.181648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.181739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.181767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.181857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.181966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.181994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.182141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.182283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.182311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.182435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.182521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.182548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.182631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.182782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.182809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.182949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.183060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.183087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.183202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.183327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.183355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.183468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.183545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.183573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.183660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.183773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.183800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.183893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.183972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.184002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.184109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.184199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.184228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.184342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.184484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.184511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.184601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.184688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.184716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.625 qpair failed and we were unable to recover it. 00:30:41.625 [2024-11-16 17:06:27.184803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.625 [2024-11-16 17:06:27.184893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.184921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.185041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.185120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.185147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.185259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.185369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.185397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.185517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.185653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.185682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.185826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.185941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.185968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.186059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.186211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.186239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.186353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.186495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.186522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.186613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.186709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.186736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.186880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.186961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.186988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.187110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.187238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.187266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.187405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.187520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.187547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.187630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.187768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.187795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.187906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.187987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.188016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.188139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.188250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.188277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.188390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.188541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.188569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.188657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.188736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.188764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.188882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.188968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.188996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.189112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.189255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.189282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.189388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.189472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.189500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8968000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.189606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.189738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.189769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.189892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.190003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.190030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.190122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.190215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.190242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.190324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.190438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.190465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.190550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.190676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.190704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.190796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.190878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.190907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.190988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.191103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.191130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.191244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.191355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.191381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.191496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.191643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.191670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.626 [2024-11-16 17:06:27.191781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.191862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.626 [2024-11-16 17:06:27.191888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.626 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.192002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.192096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.192123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.192234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.192372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.192398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.192478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.192590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.192624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.192735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.192816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.192842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.192957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.193069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.193096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.193207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.193287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.193315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.193462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.193573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.193599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.193681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.193772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.193800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.193913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.193995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.194021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.194162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.194269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.194295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.194381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.194505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.194532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.194620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.194735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.194762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.194872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.194987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.195015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.195127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.195236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.195262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.195351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.195462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.195488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.195596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.195695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.195722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.195836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.195955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.195981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.196063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.196175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.196210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.196351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.196462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.196489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.196577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.196688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.196715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.196823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.196946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.196973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.197068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.197153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.197180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.197272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.197381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.197408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.197489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.197602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.197635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.197745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.197823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.197849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.197964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.198078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.198106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.198218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.198308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.198335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.198473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.198580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.198606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.627 qpair failed and we were unable to recover it. 00:30:41.627 [2024-11-16 17:06:27.198696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.627 [2024-11-16 17:06:27.198781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.198809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.198924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.199060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.199087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.199169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.199253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.199281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.199394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.199531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.199557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.199650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.199756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.199782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.199897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.200033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.200060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.200144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.200283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.200309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.200414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.200529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.200554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.200634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.200746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.200772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.200880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.200989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.201016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.201109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.201187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.201214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.201330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.201419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.201447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.201535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.201645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.201677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.201791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.201901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.201927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.202041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.202116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.202142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.202248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.202361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.202387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.202504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.202610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.202643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.202721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.202828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.202855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.202942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.203027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.203055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.203143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.203224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.203251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.203393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.203533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.203560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.203644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.203765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.203792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.203881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.204020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.204051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.204168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.204308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.204334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.204443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.204538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.204564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.204646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.204760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.204787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.204925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.205009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.205035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.205150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.205267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.205294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.628 qpair failed and we were unable to recover it. 00:30:41.628 [2024-11-16 17:06:27.205417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.628 [2024-11-16 17:06:27.205525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.205551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.205657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.205770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.205796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.205877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.206017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.206044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.206132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.206215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.206242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.206331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.206415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.206446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.206587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.206707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.206733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.206814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.206904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.206931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.207045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.207158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.207184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.207263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.207349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.207377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.207460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.207565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.207591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.207753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.207884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.207914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.208062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.208140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.208166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.208255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.208340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.208368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.208486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.208566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.208591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.208713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.208791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.208816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.208943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.209063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.209088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.209166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.209276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.209301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.209389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.209472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.209497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.209572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.209673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.209700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.209782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.209858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.209884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.209961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.210056] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:41.629 [2024-11-16 17:06:27.210125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.210150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.210175] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:41.629 [2024-11-16 17:06:27.210193] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:41.629 [2024-11-16 17:06:27.210207] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:41.629 [2024-11-16 17:06:27.210228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.210313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.210272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:41.629 [2024-11-16 17:06:27.210327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:41.629 [2024-11-16 17:06:27.210338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.210324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:41.629 [2024-11-16 17:06:27.210298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:41.629 [2024-11-16 17:06:27.210450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.210533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.210559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.629 qpair failed and we were unable to recover it. 00:30:41.629 [2024-11-16 17:06:27.210665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.629 [2024-11-16 17:06:27.210741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.210767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.210856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.210969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.210994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.211073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.211161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.211187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.211268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.211353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.211378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.211477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.211586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.211613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.211708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.211791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.211817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.211929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.212008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.212034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.212116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.212225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.212252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.212360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.212468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.212493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.212570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.212660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.212687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.212791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.212900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.212926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.213010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.213117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.213143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.213234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.213311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.213336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.213412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.213490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.213515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.213602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.213695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.213722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.213834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.213917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.213943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.214023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.214104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.214129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.214209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.214292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.214318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.214395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.214477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.214504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.214610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.214704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.214731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.214818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.214900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.214925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.215037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.215122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.215148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.215291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.215417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.215443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.215546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.215629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.215655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.215740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.215826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.215852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.215959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.216041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.216067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.216180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.216261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.216287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.216396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.216473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.216498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.216580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.216675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.630 [2024-11-16 17:06:27.216701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.630 qpair failed and we were unable to recover it. 00:30:41.630 [2024-11-16 17:06:27.216808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.216880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.216906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.217017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.217130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.217156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.217238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.217350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.217376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.217490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.217570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.217598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.217719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.217834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.217860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.217956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.218037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.218064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.218140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.218249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.218285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.218368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.218473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.218498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.218577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.218661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.218688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.218793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.218876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.218902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.219014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.219094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.219121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.219238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.219328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.219359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.219439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.219544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.219570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.219656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.219735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.219761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.219877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.219957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.219982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.220076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.220150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.220176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.220259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.220336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.220361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.220437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.220532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.220558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.220650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.220760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.220786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.220895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.221032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.221057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.221160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.221247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.221273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.221386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.221465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.221491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.221575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.221660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.221687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.221796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.221879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.221905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.221983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.222063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.222089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.222196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.222310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.222335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.222415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.222520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.222545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.222636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.222748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.222774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.631 [2024-11-16 17:06:27.222878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.222987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.631 [2024-11-16 17:06:27.223013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.631 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.223091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.223175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.223201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.223289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.223371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.223397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.223511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.223597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.223631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.223743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.223819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.223845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.223932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.224043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.224068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.224178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.224317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.224343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.224429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.224503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.224529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.224606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.224691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.224717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.224798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.224878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.224903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.224990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.225102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.225128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.225242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.225320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.225346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.225456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.225534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.225559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.225646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.225767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.225793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.225880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.226000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.226026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.226135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.226210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.226236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.226312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.226451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.226477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.226555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.226663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.226690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.226799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.226909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.226935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.227048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.227140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.227166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.227252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.227356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.227382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.227492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.227600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.227637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.227750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.227829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.227855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.227962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.228066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.228092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.228171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.228280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.228311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.228386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.228496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.228522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.228636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.228713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.228739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.228853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.228934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.228960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.229074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.229159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.229185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.632 qpair failed and we were unable to recover it. 00:30:41.632 [2024-11-16 17:06:27.229269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.632 [2024-11-16 17:06:27.229349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.229375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.229483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.229589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.229630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.229721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.229804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.229829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.229913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.230018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.230043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.230154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.230258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.230284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.230358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.230432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.230465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.230605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.230720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.230746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.230831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.230918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.230946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.231022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.231100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.231126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.231243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.231327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.231353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.231436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.231514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.231540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.231629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.231744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.231771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.231850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.231955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.231980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.232091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.232166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.232192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.232299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.232433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.232458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.232574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.232675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.232702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.232815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.232953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.232978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.233055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.233133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.233160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.233271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.233346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.233372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.233481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.233559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.233584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.233688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.233763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.233789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.233882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.233989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.234014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.234094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.234184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.234210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.234287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.234394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.234419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.234496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.234578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.234605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.234701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.234784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.234809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.234922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.235044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.235070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.235148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.235225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.235251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.633 [2024-11-16 17:06:27.235369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.235474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.633 [2024-11-16 17:06:27.235499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.633 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.235589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.235681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.235708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.235848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.235931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.235957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.236074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.236151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.236177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.236261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.236343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.236370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.236479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.236590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.236625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.236731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.236805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.236831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.236912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.237003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.237029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.237138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.237216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.237242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.237321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.237394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.237420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.237549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.237655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.237682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.237775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.237882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.237908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.237994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.238121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.238147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.238255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.238374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.238400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.238481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.238585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.238611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.238703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.238806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.238832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.238916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.238998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.239024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.239135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.239212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.239238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.239339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.239449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.239479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.239561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.239651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.239677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.239753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.239843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.239869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.239992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.240077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.240104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.240252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.240360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.240387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.240481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.240576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.240611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.240707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.240796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.240822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.240915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.241023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.241049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.634 qpair failed and we were unable to recover it. 00:30:41.634 [2024-11-16 17:06:27.241160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.634 [2024-11-16 17:06:27.241269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.241295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.241372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.241453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.241479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.241553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.241633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.241660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.241754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.241836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.241862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.242011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.242119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.242145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.242259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.242347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.242374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.242489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.242562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.242588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.242712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.242790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.242816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.242928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.243013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.243038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.243146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.243254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.243279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.243357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.243440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.243466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.243560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.243668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.243695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.243781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.243858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.243884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.243976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.244101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.244127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.244210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.244299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.244325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.244433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.244536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.244562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.244688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.244799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.244825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.244906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.245013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.245038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.245118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.245225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.245250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.245331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.245437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.245463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.245546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.245674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.245701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.245787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.245870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.245896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.245972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.246070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.246096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.246221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.246328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.246357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.246480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.246561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.246587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.246731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.246812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.246839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.246949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.247071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.247098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.247220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.247308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.247336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.247475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.247557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.635 [2024-11-16 17:06:27.247583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.635 qpair failed and we were unable to recover it. 00:30:41.635 [2024-11-16 17:06:27.247717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.247795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.247821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.247910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.248014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.248040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.248125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.248245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.248270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.248382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.248460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.248491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.248574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.248704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.248730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.248843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.248957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.248983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.249090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.249175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.249201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.249316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.249397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.249425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.249507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.249660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.249687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.249803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.249879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.249905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.249998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.250114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.250149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.250287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.250372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.250398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.250521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.250601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.250640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.250719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.250797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.250822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.250952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.251046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.251072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.251150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.251286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.251311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.251420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.251497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.251523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.251596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.251721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.251747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.251826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.251946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.251972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.252052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.252135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.252161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.252269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.252353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.252379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.252463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.252534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.252560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.252649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.252726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.252751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.252868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.252977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.253002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.253074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.253200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.253226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.253301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.253386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.253413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.253489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.253641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.253668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.253760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.253840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.253866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.636 qpair failed and we were unable to recover it. 00:30:41.636 [2024-11-16 17:06:27.253955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.636 [2024-11-16 17:06:27.254031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.254057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.254163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.254236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.254262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.254375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.254486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.254512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.254629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.254728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.254755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.254880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.254959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.254985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.255067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.255170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.255195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.255281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.255394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.255426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.255518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.255680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.255707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.255795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.255884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.255910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.256030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.256109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.256135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.256226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.256310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.256336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.256452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.256532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.256557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.256653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.256744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.256770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.256877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.256956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.256981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.257119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.257260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.257285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.257377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.257462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.257489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.257602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.257724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.257755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.257830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.257903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.257936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.258083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.258162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.258187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.258275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.258382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.258408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.258522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.258601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.258637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.258713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.258787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.258813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.258923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.259052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.259077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.259164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.259272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.259297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.259394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.259484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.259509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.259601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.259758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.259785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.259868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.259958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.260000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.260111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.260240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.637 [2024-11-16 17:06:27.260267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.637 qpair failed and we were unable to recover it. 00:30:41.637 [2024-11-16 17:06:27.260358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.260438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.260464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.260563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.260654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.260682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.260796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.260936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.260962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.261072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.261177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.261202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.261291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.261374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.261400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.261547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.261630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.261656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.261785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.261876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.261903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.262013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.262095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.262122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.262208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.262348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.262378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.262458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.262531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.262557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.262675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.262819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.262845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.262928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.263012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.263037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.263160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.263272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.263297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.263380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.263461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.263487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.263572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.263663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.263691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.263804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.263911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.263937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.264050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.264126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.264163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.264285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.264370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.264398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.264516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.264643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.264669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.264753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.264869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.264895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.265007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.265120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.265145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.265234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.265321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.265347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.265457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.265537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.265563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.265703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.265819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.265845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.265941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.266020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.266045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.266127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.266234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.266259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.638 qpair failed and we were unable to recover it. 00:30:41.638 [2024-11-16 17:06:27.266371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.638 [2024-11-16 17:06:27.266448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.266473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.266583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.266706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.266733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.266827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.266942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.266968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.267066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.267201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.267226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.267315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.267396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.267421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.267502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.267647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.267674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.267758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.267836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.267862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.267947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.268028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.268054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.268159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.268233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.268259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.268340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.268446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.268471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.268548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.268692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.268719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.268825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.268899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.268925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.269012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.269122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.269147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.269237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.269319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.269345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.269428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.269537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.269564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.269681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.269758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.269784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.269862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.269980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.270005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.270099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.270204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.270229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.270318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.270405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.270432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.270542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.270658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.270686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.270765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.270854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.270880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.270978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.271070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.271097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.271181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.271260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.271286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.271379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.271460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.271487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.271606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.271736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.271761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.271879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.271955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.271980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.272058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.272198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.272223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.272308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.272391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.272417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.272529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.272606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.272641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.272728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.272834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.272860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.272943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.273049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.639 [2024-11-16 17:06:27.273075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.639 qpair failed and we were unable to recover it. 00:30:41.639 [2024-11-16 17:06:27.273152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.273255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.273281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.273363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.273444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.273470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.273584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.273711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.273738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.273850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.273933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.273960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.274069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.274163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.274189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.274330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.274409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.274435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.274509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.274594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.274627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.274712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.274792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.274818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.274935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.275012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.275037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.275120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.275209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.275235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.275310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.275392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.275418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.275495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.275610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.275643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.275742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.275853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.275879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.275963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.276071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.276096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.276216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.276290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.276316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.276405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.276521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.276549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.276658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.276741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.276767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.276851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.276933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.276959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.277047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.277155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.277192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.277273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.277358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.277384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.277494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.277605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.277637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.277711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.277789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.277814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.277897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.278009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.278035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.278119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.278197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.278224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.278310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.278418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.278445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.278558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.278639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.278665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.278805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.278884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.278910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.278988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.279108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.279135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.279225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.279338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.279363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.279452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.279546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.279573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.640 qpair failed and we were unable to recover it. 00:30:41.640 [2024-11-16 17:06:27.279690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.279767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.640 [2024-11-16 17:06:27.279792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.279868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.280963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.281008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.281144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.281222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.281248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.281360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.281471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.281497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.281580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.281675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.281702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.281789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.281871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.281898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.282008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.282090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.282116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.282222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.282331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.282356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.282436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.282520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.282545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.282666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.282753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.282778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.282858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.282996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.283022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.283106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.283186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.283211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.283311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.283392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.283418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.283526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.283632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.283659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.283743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.283829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.283855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.283943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.284020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.284046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.284137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.284242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.284268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.284363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.284450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.284476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.284620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.284731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.284758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.284843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.284985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.285012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.285151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.285229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.285255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.285329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.285419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.285445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.285528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.285607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.285639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.285727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.285809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.285835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.285918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.286027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.286053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.286137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.286228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.286259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.286344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.286422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.286448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.286524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.286604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.286641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.286740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.286846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.286872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.286987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.287103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.287132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.287210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.287285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.287311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.641 qpair failed and we were unable to recover it. 00:30:41.641 [2024-11-16 17:06:27.287398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.641 [2024-11-16 17:06:27.287479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.287506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.287584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.287677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.287704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.287823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.287905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.287931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.288009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.288090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.288115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.288192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.288274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.288300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.288387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.288508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.288535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.288644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.288725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.288751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.288841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.288957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.288983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.289058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.289170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.289195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.289307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.289387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.289413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.289489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.289594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.289626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.289724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.289839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.289865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.289945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.290063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.290088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.290214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.290298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.290323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.290414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.290491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.290516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.290626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.290735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.290761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.290874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.290948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.290975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.291054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.291136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.291162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.291249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.291338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.291364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.291445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.291527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.291555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.291636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.291725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.291751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.291831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.291907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.291937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.292062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.292142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.292168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.292248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.292377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.292403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.292511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.292591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.292668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.292755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.292831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.292857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.292950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.293032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.293058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.293148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.293236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.293261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.293367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.293475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.293500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.293609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.293702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.293728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.293806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.293891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.642 [2024-11-16 17:06:27.293919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.642 qpair failed and we were unable to recover it. 00:30:41.642 [2024-11-16 17:06:27.294014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.294137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.294177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.294263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.294371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.294398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.294490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.294594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.294650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.294793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.294892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.294931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.295041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.295117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.295143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.295242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.295316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.295341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.295457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.295538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.295564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.295656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.295741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.295769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.295854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.295966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.295992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.296101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.296182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.296208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.296286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.296361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.296392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.296499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.296573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.296599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.296696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.296783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.296809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.296920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.296993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.297019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.297127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.297213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.297239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.297319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.297408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.297433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.297544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.297667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.297695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.297779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.297857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.297883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.297997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.298111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.298137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.298219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.298295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.298320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.643 qpair failed and we were unable to recover it. 00:30:41.643 [2024-11-16 17:06:27.298398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.643 [2024-11-16 17:06:27.298480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.298510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.298584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.298701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.298727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.298836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.298954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.298981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.299064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.299153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.299180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.299301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.299409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.299435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.299521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.299631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.299659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.299750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.299835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.299861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.299944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.300055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.300092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.300200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.300315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.300340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.300451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.301201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.301231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.301382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.301503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.301529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.301648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.301762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.301788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.301905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.301990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.302016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.302095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.302169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.302195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.302305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.302394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.302419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.302498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.302607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.302641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.302751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.302873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.302899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.303006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.303092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.303118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.303202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.303312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.303337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.303415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.303494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.303520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.303606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.303729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.303756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.303902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.304006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.304032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.304134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.304218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.304243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.304352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.304466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.304492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.304571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.304686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.304712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.304817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.304932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.304959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.305040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.305129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.305155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.305235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.305337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.305363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.305444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.305548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.305574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.644 [2024-11-16 17:06:27.305660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.305745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.644 [2024-11-16 17:06:27.305771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.644 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.305847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.305959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.305985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.306106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.306188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.306215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.306353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.306465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.306492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.306566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.306655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.306682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.306790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.306866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.306893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.307021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.307100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.307125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.307208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.307314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.307340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.307453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.307535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.307562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.307661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.307751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.307777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.307865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.307936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.307962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.308069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.308151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.308179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.308298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.308374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.308400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.308475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.308553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.308578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.308663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.308780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.308805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.308901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.308982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.309007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.309116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.309198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.309223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.309342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.309446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.309472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.309591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.309714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.309741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.309855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.309967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.309993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.310105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.310245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.310270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.310346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.310433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.310459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.310575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.310705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.310732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.310873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.310951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.310977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.311057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.311164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.311189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.645 qpair failed and we were unable to recover it. 00:30:41.645 [2024-11-16 17:06:27.311309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.645 [2024-11-16 17:06:27.311384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.311410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.311495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.311571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.311596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.311680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.311756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.311782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.311875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.311963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.311990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.312070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.312147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.312174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.312258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.312331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.312357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.312461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.312600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.312634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.312733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.312842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.312868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.312950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.313026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.313052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.313167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.313241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.313267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.313354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.313465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.313491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.313571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.313647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.313673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.313757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.313865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.313891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.313964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.314042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.314080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.314186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.314265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.314290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.314399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.314502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.314527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.314598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.314688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.314714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.314814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.314893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.314918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.315003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.315089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.315115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f8970000b90 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.315220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.315353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.315384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.315504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.315585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.315612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.315718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.315798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.315825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.315905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.315990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.316017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.316113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.316231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.316256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.316340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.316427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.316453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.316544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.316652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.316681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.316759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.316869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.316895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.317020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.317113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.317140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.317256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.317373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.317399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.317485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.317566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.317592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.646 [2024-11-16 17:06:27.317691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.317781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.646 [2024-11-16 17:06:27.317807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.646 qpair failed and we were unable to recover it. 00:30:41.647 [2024-11-16 17:06:27.317889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.317999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.318024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.647 qpair failed and we were unable to recover it. 00:30:41.647 [2024-11-16 17:06:27.318143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.318221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.318247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.647 qpair failed and we were unable to recover it. 00:30:41.647 [2024-11-16 17:06:27.318357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.318434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.318460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.647 qpair failed and we were unable to recover it. 00:30:41.647 [2024-11-16 17:06:27.318571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.318657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.318684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.647 qpair failed and we were unable to recover it. 00:30:41.647 [2024-11-16 17:06:27.318796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.318909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.318935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.647 qpair failed and we were unable to recover it. 00:30:41.647 [2024-11-16 17:06:27.319044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.319124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.319150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.647 qpair failed and we were unable to recover it. 00:30:41.647 [2024-11-16 17:06:27.319235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.319322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.319353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.647 qpair failed and we were unable to recover it. 00:30:41.647 [2024-11-16 17:06:27.319439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.319530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.319556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.647 qpair failed and we were unable to recover it. 00:30:41.647 [2024-11-16 17:06:27.319650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.319733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.647 [2024-11-16 17:06:27.319759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.647 qpair failed and we were unable to recover it. 00:30:41.647 [2024-11-16 17:06:27.319847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.319972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.319999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.320074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.320191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.320217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.320361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.320442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.320469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.320586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.320690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.320717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.320796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.320876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.320902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.321044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.321126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.321152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.321228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.321303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.321329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.321416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.321499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.321526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.321608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.321699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.321726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.321807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.321920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.321946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.322036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.322142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.322167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.322254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.322334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.322360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.322441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.322580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.322607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.322696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.322782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.322808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.322893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.322979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.323005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.911 qpair failed and we were unable to recover it. 00:30:41.911 [2024-11-16 17:06:27.323096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.911 [2024-11-16 17:06:27.323202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.323228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.323341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.323422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.323448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.323526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.323637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.323665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.323761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.323851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.323877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.323954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.324032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.324058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.324149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.324263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.324289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.324367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.324447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.324473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.324591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.324689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.324716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.324797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.324879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.324905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.325015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.325099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.325124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.325206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.325280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.325306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.325424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.325528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.325554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.325646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.325730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.325756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.325841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.325919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.325945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.326024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.326108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.326134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.326221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.326304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.326330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.326437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.326550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.326576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.326666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.326746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.326773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.326854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.326935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.326961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.327107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.327184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.327212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.327323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.327432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.327458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.327540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.327622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.327653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.327731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.327809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.327835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.327921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.328002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.328029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.328149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.328233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.328259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.328339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.328444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.328470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.328550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.328628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.328655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.328734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.328824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.328849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.328924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.329012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.912 [2024-11-16 17:06:27.329038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.912 qpair failed and we were unable to recover it. 00:30:41.912 [2024-11-16 17:06:27.329118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.329191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.329217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.329301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.329378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.329403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.329481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.329599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.329638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.329715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.329828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.329854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.329938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.330050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.330080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.330159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.330238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.330264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.330341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.330421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.330448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.330556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.330648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.330675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.330756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.330832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.330858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.330950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.331058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.331083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.331165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.331254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.331280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.331392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.331469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.331495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.331605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.331694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.331722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.331804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.331885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.331912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.331995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.332072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.332098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.332219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.332333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.332359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.332438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.332519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.332545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.332653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.332737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.332764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.332846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.332956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.332982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.333092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.333167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.333193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.333273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.333378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.333403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.333524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.333603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.333636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.333715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.333827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.333853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.333933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.334015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.334041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.334119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.334197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.334223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.334335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.334427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.334453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.334533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.334644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.334671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.334749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.334827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.334852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.913 qpair failed and we were unable to recover it. 00:30:41.913 [2024-11-16 17:06:27.334930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.335075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.913 [2024-11-16 17:06:27.335101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.335214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.335292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.335317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.335399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.335504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.335529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.335640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.335715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.335741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.335815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.335889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.335915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.336022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.336130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.336167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.336273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.336344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.336370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.336449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.336560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.336587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.336675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.336766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.336791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.336880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.336962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.336989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.337069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.337143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.337169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.337259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.337331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.337357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.337467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.337545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.337571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.337661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.337755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.337780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.337864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.337942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.337968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.338072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.338157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.338183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.338296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.338407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.338432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.338516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.338629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.338656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.338737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.338843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.338869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.338952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.339037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.339063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.339143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.339222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.339248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.339323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.339402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.339429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.339513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.339633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.339662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.339742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.339852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.339878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.339995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.340109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.340136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.340213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.340321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.340346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.340431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.340543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.340568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.340676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.340758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.340789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.914 [2024-11-16 17:06:27.340878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.340956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.914 [2024-11-16 17:06:27.340982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.914 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.341057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.341192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.341217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.341325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.341399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.341424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.341504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.341581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.341607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.341723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.341800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.341827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.341913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.342000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.342026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.342142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.342227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.342253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.342360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.342442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.342469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.342586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.342667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.342693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.342770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.342854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.342880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.342990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.343070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.343096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.343211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.343292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.343318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.343395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.343468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.343494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.343571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.343658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.343686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.343771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.343910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.343936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.344041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.344182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.344209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.344287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.344366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.344392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.344480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.344558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.344584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.344669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.344777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.344803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.344884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.344989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.345015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.345100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.345208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.345233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.345375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.345450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.345475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.345580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.345665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.345692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.345770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.345905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.345931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.346053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.346166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.346191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.346299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.346381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.346407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.346487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.346563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.346590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.346687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.346761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.346787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.346871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.346961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.915 [2024-11-16 17:06:27.346990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.915 qpair failed and we were unable to recover it. 00:30:41.915 [2024-11-16 17:06:27.347105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.347214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.347240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.347380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.347492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.347518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.347596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.347681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.347709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.347792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.347900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.347926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.348003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.348080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.348106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.348186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.348259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.348285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.348389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.348505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.348530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.348607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.348719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.348746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.348833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.348922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.348947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.349060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.349139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.349165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.349239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.349313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.349340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.349424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.349506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.349536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.349650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.349755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.349781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.349892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.349995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.350021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.350104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.350186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.350217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.350294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.350403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.350429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.350502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.350607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.350638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.350712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.350789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.350815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.350953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.351036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.351062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.351142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.351255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.351293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.351374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.351450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.351477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.351593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.351727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.351754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.351868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.351943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.351969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.352087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.352166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.352194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.352269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.352347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.916 [2024-11-16 17:06:27.352372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.916 qpair failed and we were unable to recover it. 00:30:41.916 [2024-11-16 17:06:27.352479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.352589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.352621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.352711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.352791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.352817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.352925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.353064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.353090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.353174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.353289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.353315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.353396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.353500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.353526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.353614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.353703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.353729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.353830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.353911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.353939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.354025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.354133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.354160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.354238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.354342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.354368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.354444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.354553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.354578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.354666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.354741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.354766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.354840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.354947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.354973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.355058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.355137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.355164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.355286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.355358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.355384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.355470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.355549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.355575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.355681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.355762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.355789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.355863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.355978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.356004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.356123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.356201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.356227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.356337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.356442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.356467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.356582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.356737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.356765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.356840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.356916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.356942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.357023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.357115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.357141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.357224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.357310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.357336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.357416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.357524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.357550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.357640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.357723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.357749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.357857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.357941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.357967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.358044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.358149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.358175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.358257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.358367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.358393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.917 [2024-11-16 17:06:27.358503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.358579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.917 [2024-11-16 17:06:27.358605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.917 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.358704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.358778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.358804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.358924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.359004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.359029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.359110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.359187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.359213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.359296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.359405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.359431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.359539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.359643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.359682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.359801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.359876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.359902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.359986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.360067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.360094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.360168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.360248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.360275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.360360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.360437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.360471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.360606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.360696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.360723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.360805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.360889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.360928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.361003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.361112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.361138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.361215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.361322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.361348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.361425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.361531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.361557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.361632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.361722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.361747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.361854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.361970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.361996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.362076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.362156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.362184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.362291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.362373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.362400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.362476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.362586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.362612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.362701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.362777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.362803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.362912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.362986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.363013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.363119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.363227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.363253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.363364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.363440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.363466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.363555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.363637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.363674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 [2024-11-16 17:06:27.363779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.363859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.363886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa7c390 with addr=10.0.0.2, port=4420 00:30:41.918 qpair failed and we were unable to recover it. 00:30:41.918 A controller has encountered a failure and is being reset. 00:30:41.918 [2024-11-16 17:06:27.364034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.364132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.918 [2024-11-16 17:06:27.364162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa89e00 with addr=10.0.0.2, port=4420 00:30:41.918 [2024-11-16 17:06:27.364182] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa89e00 is same with the state(5) to be set 00:30:41.918 [2024-11-16 17:06:27.364211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa89e00 (9): Bad file descriptor 00:30:41.918 [2024-11-16 17:06:27.364230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:41.918 [2024-11-16 17:06:27.364245] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:41.918 [2024-11-16 17:06:27.364263] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:41.918 Unable to reset the controller. 00:30:42.487 17:06:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:42.487 17:06:28 -- common/autotest_common.sh@862 -- # return 0 00:30:42.487 17:06:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:42.487 17:06:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:42.487 17:06:28 -- common/autotest_common.sh@10 -- # set +x 00:30:42.487 17:06:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:42.487 17:06:28 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:42.487 17:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:42.487 17:06:28 -- common/autotest_common.sh@10 -- # set +x 00:30:42.487 Malloc0 00:30:42.487 17:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:42.487 17:06:28 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:42.487 17:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:42.487 17:06:28 -- common/autotest_common.sh@10 -- # set +x 00:30:42.487 [2024-11-16 17:06:28.125300] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:42.487 17:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:42.487 17:06:28 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:42.487 17:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:42.487 17:06:28 -- common/autotest_common.sh@10 -- # set +x 00:30:42.487 17:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:42.487 17:06:28 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:42.487 17:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:42.487 17:06:28 -- common/autotest_common.sh@10 -- # set +x 00:30:42.487 17:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:42.487 17:06:28 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:42.487 17:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:42.487 17:06:28 -- common/autotest_common.sh@10 -- # set +x 00:30:42.487 [2024-11-16 17:06:28.153626] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:42.487 17:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:42.487 17:06:28 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:42.487 17:06:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:42.487 17:06:28 -- common/autotest_common.sh@10 -- # set +x 00:30:42.487 17:06:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:42.487 17:06:28 -- host/target_disconnect.sh@58 -- # wait 1331663 00:30:42.746 Controller properly reset. 00:30:48.016 Initializing NVMe Controllers 00:30:48.016 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:48.016 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:48.016 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:48.016 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:48.016 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:48.016 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:48.016 Initialization complete. Launching workers. 00:30:48.016 Starting thread on core 1 00:30:48.016 Starting thread on core 2 00:30:48.016 Starting thread on core 3 00:30:48.016 Starting thread on core 0 00:30:48.016 17:06:33 -- host/target_disconnect.sh@59 -- # sync 00:30:48.016 00:30:48.016 real 0m11.360s 00:30:48.016 user 0m36.825s 00:30:48.016 sys 0m7.331s 00:30:48.016 17:06:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:48.016 17:06:33 -- common/autotest_common.sh@10 -- # set +x 00:30:48.016 ************************************ 00:30:48.016 END TEST nvmf_target_disconnect_tc2 00:30:48.016 ************************************ 00:30:48.016 17:06:33 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:48.016 17:06:33 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:48.016 17:06:33 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:48.016 17:06:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:48.016 17:06:33 -- nvmf/common.sh@116 -- # sync 00:30:48.016 17:06:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:48.016 17:06:33 -- nvmf/common.sh@119 -- # set +e 00:30:48.016 17:06:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:48.017 17:06:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:48.017 rmmod nvme_tcp 00:30:48.017 rmmod nvme_fabrics 00:30:48.017 rmmod nvme_keyring 00:30:48.017 17:06:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:48.017 17:06:33 -- nvmf/common.sh@123 -- # set -e 00:30:48.017 17:06:33 -- nvmf/common.sh@124 -- # return 0 00:30:48.017 17:06:33 -- nvmf/common.sh@477 -- # '[' -n 1332084 ']' 00:30:48.017 17:06:33 -- nvmf/common.sh@478 -- # killprocess 1332084 00:30:48.017 17:06:33 -- common/autotest_common.sh@936 -- # '[' -z 1332084 ']' 00:30:48.017 17:06:33 -- common/autotest_common.sh@940 -- # kill -0 1332084 00:30:48.017 17:06:33 -- common/autotest_common.sh@941 -- # uname 00:30:48.017 17:06:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:48.017 17:06:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1332084 00:30:48.017 17:06:33 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:48.017 17:06:33 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:48.017 17:06:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1332084' 00:30:48.017 killing process with pid 1332084 00:30:48.017 17:06:33 -- common/autotest_common.sh@955 -- # kill 1332084 00:30:48.017 17:06:33 -- common/autotest_common.sh@960 -- # wait 1332084 00:30:48.017 17:06:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:48.017 17:06:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:48.017 17:06:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:48.017 17:06:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:48.017 17:06:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:48.017 17:06:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:48.017 17:06:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:48.017 17:06:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:50.553 17:06:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:50.553 00:30:50.553 real 0m16.311s 00:30:50.553 user 1m2.284s 00:30:50.553 sys 0m9.791s 00:30:50.553 17:06:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:50.553 17:06:35 -- common/autotest_common.sh@10 -- # set +x 00:30:50.553 ************************************ 00:30:50.553 END TEST nvmf_target_disconnect 00:30:50.554 ************************************ 00:30:50.554 17:06:35 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:50.554 17:06:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:50.554 17:06:35 -- common/autotest_common.sh@10 -- # set +x 00:30:50.554 17:06:35 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:50.554 00:30:50.554 real 22m52.948s 00:30:50.554 user 66m43.197s 00:30:50.554 sys 5m29.924s 00:30:50.554 17:06:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:50.554 17:06:35 -- common/autotest_common.sh@10 -- # set +x 00:30:50.554 ************************************ 00:30:50.554 END TEST nvmf_tcp 00:30:50.554 ************************************ 00:30:50.554 17:06:35 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:30:50.554 17:06:35 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:50.554 17:06:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:50.554 17:06:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:50.554 17:06:35 -- common/autotest_common.sh@10 -- # set +x 00:30:50.554 ************************************ 00:30:50.554 START TEST spdkcli_nvmf_tcp 00:30:50.554 ************************************ 00:30:50.554 17:06:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:50.554 * Looking for test storage... 00:30:50.554 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:50.554 17:06:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:50.554 17:06:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:50.554 17:06:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:50.554 17:06:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:50.554 17:06:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:50.554 17:06:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:50.554 17:06:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:50.554 17:06:35 -- scripts/common.sh@335 -- # IFS=.-: 00:30:50.554 17:06:35 -- scripts/common.sh@335 -- # read -ra ver1 00:30:50.554 17:06:35 -- scripts/common.sh@336 -- # IFS=.-: 00:30:50.554 17:06:35 -- scripts/common.sh@336 -- # read -ra ver2 00:30:50.554 17:06:35 -- scripts/common.sh@337 -- # local 'op=<' 00:30:50.554 17:06:35 -- scripts/common.sh@339 -- # ver1_l=2 00:30:50.554 17:06:35 -- scripts/common.sh@340 -- # ver2_l=1 00:30:50.554 17:06:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:50.554 17:06:35 -- scripts/common.sh@343 -- # case "$op" in 00:30:50.554 17:06:35 -- scripts/common.sh@344 -- # : 1 00:30:50.554 17:06:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:50.554 17:06:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:50.554 17:06:35 -- scripts/common.sh@364 -- # decimal 1 00:30:50.554 17:06:35 -- scripts/common.sh@352 -- # local d=1 00:30:50.554 17:06:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:50.554 17:06:35 -- scripts/common.sh@354 -- # echo 1 00:30:50.554 17:06:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:50.554 17:06:35 -- scripts/common.sh@365 -- # decimal 2 00:30:50.554 17:06:35 -- scripts/common.sh@352 -- # local d=2 00:30:50.554 17:06:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:50.554 17:06:35 -- scripts/common.sh@354 -- # echo 2 00:30:50.554 17:06:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:50.554 17:06:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:50.554 17:06:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:50.554 17:06:35 -- scripts/common.sh@367 -- # return 0 00:30:50.554 17:06:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:50.554 17:06:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:50.554 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:50.554 --rc genhtml_branch_coverage=1 00:30:50.554 --rc genhtml_function_coverage=1 00:30:50.554 --rc genhtml_legend=1 00:30:50.554 --rc geninfo_all_blocks=1 00:30:50.554 --rc geninfo_unexecuted_blocks=1 00:30:50.554 00:30:50.554 ' 00:30:50.554 17:06:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:50.554 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:50.554 --rc genhtml_branch_coverage=1 00:30:50.554 --rc genhtml_function_coverage=1 00:30:50.554 --rc genhtml_legend=1 00:30:50.554 --rc geninfo_all_blocks=1 00:30:50.554 --rc geninfo_unexecuted_blocks=1 00:30:50.554 00:30:50.554 ' 00:30:50.554 17:06:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:50.554 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:50.554 --rc genhtml_branch_coverage=1 00:30:50.554 --rc genhtml_function_coverage=1 00:30:50.554 --rc genhtml_legend=1 00:30:50.554 --rc geninfo_all_blocks=1 00:30:50.554 --rc geninfo_unexecuted_blocks=1 00:30:50.554 00:30:50.554 ' 00:30:50.554 17:06:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:50.554 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:50.554 --rc genhtml_branch_coverage=1 00:30:50.554 --rc genhtml_function_coverage=1 00:30:50.554 --rc genhtml_legend=1 00:30:50.554 --rc geninfo_all_blocks=1 00:30:50.554 --rc geninfo_unexecuted_blocks=1 00:30:50.554 00:30:50.554 ' 00:30:50.554 17:06:35 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:50.554 17:06:35 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:50.554 17:06:35 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:50.554 17:06:35 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:50.554 17:06:35 -- nvmf/common.sh@7 -- # uname -s 00:30:50.554 17:06:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:50.554 17:06:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:50.554 17:06:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:50.554 17:06:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:50.554 17:06:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:50.554 17:06:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:50.554 17:06:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:50.554 17:06:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:50.554 17:06:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:50.554 17:06:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:50.554 17:06:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:50.554 17:06:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:50.554 17:06:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:50.554 17:06:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:50.554 17:06:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:50.554 17:06:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:50.554 17:06:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:50.554 17:06:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:50.554 17:06:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:50.554 17:06:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:50.554 17:06:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:50.554 17:06:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:50.554 17:06:35 -- paths/export.sh@5 -- # export PATH 00:30:50.554 17:06:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:50.554 17:06:35 -- nvmf/common.sh@46 -- # : 0 00:30:50.554 17:06:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:50.554 17:06:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:50.554 17:06:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:50.554 17:06:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:50.554 17:06:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:50.554 17:06:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:50.554 17:06:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:50.554 17:06:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:50.554 17:06:35 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:50.554 17:06:35 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:50.554 17:06:35 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:50.554 17:06:35 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:50.554 17:06:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:50.554 17:06:35 -- common/autotest_common.sh@10 -- # set +x 00:30:50.554 17:06:35 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:50.554 17:06:35 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1333308 00:30:50.554 17:06:35 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:50.554 17:06:35 -- spdkcli/common.sh@34 -- # waitforlisten 1333308 00:30:50.554 17:06:35 -- common/autotest_common.sh@829 -- # '[' -z 1333308 ']' 00:30:50.554 17:06:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:50.554 17:06:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:50.554 17:06:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:50.554 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:50.554 17:06:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:50.554 17:06:35 -- common/autotest_common.sh@10 -- # set +x 00:30:50.554 [2024-11-16 17:06:35.969100] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:50.554 [2024-11-16 17:06:35.969189] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1333308 ] 00:30:50.554 EAL: No free 2048 kB hugepages reported on node 1 00:30:50.554 [2024-11-16 17:06:36.046563] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:50.554 [2024-11-16 17:06:36.140798] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:50.554 [2024-11-16 17:06:36.141018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:50.554 [2024-11-16 17:06:36.141027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:50.813 17:06:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:50.813 17:06:36 -- common/autotest_common.sh@862 -- # return 0 00:30:50.813 17:06:36 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:50.813 17:06:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:50.813 17:06:36 -- common/autotest_common.sh@10 -- # set +x 00:30:50.813 17:06:36 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:50.813 17:06:36 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:50.813 17:06:36 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:50.813 17:06:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:50.813 17:06:36 -- common/autotest_common.sh@10 -- # set +x 00:30:50.813 17:06:36 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:50.813 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:50.813 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:50.813 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:50.813 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:50.813 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:50.813 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:50.813 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:50.813 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:50.813 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:50.813 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:50.813 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:50.813 ' 00:30:51.073 [2024-11-16 17:06:36.732716] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:53.612 [2024-11-16 17:06:38.918900] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:54.551 [2024-11-16 17:06:40.163462] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:57.082 [2024-11-16 17:06:42.478927] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:30:58.990 [2024-11-16 17:06:44.477274] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:31:00.370 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:31:00.370 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:31:00.370 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:31:00.370 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:31:00.370 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:31:00.370 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:31:00.370 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:31:00.370 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:00.370 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:00.370 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:31:00.370 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:31:00.370 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:31:00.370 17:06:46 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:31:00.370 17:06:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:00.370 17:06:46 -- common/autotest_common.sh@10 -- # set +x 00:31:00.628 17:06:46 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:31:00.628 17:06:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:00.628 17:06:46 -- common/autotest_common.sh@10 -- # set +x 00:31:00.628 17:06:46 -- spdkcli/nvmf.sh@69 -- # check_match 00:31:00.628 17:06:46 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:31:00.887 17:06:46 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:31:00.887 17:06:46 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:31:00.887 17:06:46 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:31:00.887 17:06:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:00.887 17:06:46 -- common/autotest_common.sh@10 -- # set +x 00:31:00.887 17:06:46 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:31:00.887 17:06:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:00.887 17:06:46 -- common/autotest_common.sh@10 -- # set +x 00:31:00.887 17:06:46 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:31:00.887 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:31:00.887 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:00.887 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:31:00.887 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:31:00.887 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:31:00.887 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:31:00.887 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:00.887 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:31:00.887 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:31:00.887 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:31:00.887 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:31:00.887 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:31:00.887 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:31:00.887 ' 00:31:06.194 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:31:06.194 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:31:06.194 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:06.194 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:31:06.194 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:31:06.194 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:31:06.194 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:31:06.194 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:06.194 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:31:06.194 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:31:06.194 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:31:06.194 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:31:06.194 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:31:06.194 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:31:06.194 17:06:51 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:31:06.194 17:06:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:06.194 17:06:51 -- common/autotest_common.sh@10 -- # set +x 00:31:06.194 17:06:51 -- spdkcli/nvmf.sh@90 -- # killprocess 1333308 00:31:06.194 17:06:51 -- common/autotest_common.sh@936 -- # '[' -z 1333308 ']' 00:31:06.194 17:06:51 -- common/autotest_common.sh@940 -- # kill -0 1333308 00:31:06.194 17:06:51 -- common/autotest_common.sh@941 -- # uname 00:31:06.194 17:06:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:06.194 17:06:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1333308 00:31:06.453 17:06:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:06.453 17:06:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:06.453 17:06:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1333308' 00:31:06.453 killing process with pid 1333308 00:31:06.453 17:06:51 -- common/autotest_common.sh@955 -- # kill 1333308 00:31:06.453 [2024-11-16 17:06:51.959395] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:06.453 17:06:51 -- common/autotest_common.sh@960 -- # wait 1333308 00:31:06.453 17:06:52 -- spdkcli/nvmf.sh@1 -- # cleanup 00:31:06.453 17:06:52 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:31:06.453 17:06:52 -- spdkcli/common.sh@13 -- # '[' -n 1333308 ']' 00:31:06.453 17:06:52 -- spdkcli/common.sh@14 -- # killprocess 1333308 00:31:06.453 17:06:52 -- common/autotest_common.sh@936 -- # '[' -z 1333308 ']' 00:31:06.453 17:06:52 -- common/autotest_common.sh@940 -- # kill -0 1333308 00:31:06.453 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1333308) - No such process 00:31:06.453 17:06:52 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1333308 is not found' 00:31:06.453 Process with pid 1333308 is not found 00:31:06.453 17:06:52 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:31:06.453 17:06:52 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:31:06.453 17:06:52 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:31:06.453 00:31:06.453 real 0m16.404s 00:31:06.453 user 0m34.991s 00:31:06.453 sys 0m0.799s 00:31:06.453 17:06:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:06.453 17:06:52 -- common/autotest_common.sh@10 -- # set +x 00:31:06.453 ************************************ 00:31:06.453 END TEST spdkcli_nvmf_tcp 00:31:06.453 ************************************ 00:31:06.453 17:06:52 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:06.453 17:06:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:06.453 17:06:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:06.453 17:06:52 -- common/autotest_common.sh@10 -- # set +x 00:31:06.453 ************************************ 00:31:06.453 START TEST nvmf_identify_passthru 00:31:06.453 ************************************ 00:31:06.453 17:06:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:06.713 * Looking for test storage... 00:31:06.713 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:06.713 17:06:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:06.713 17:06:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:06.713 17:06:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:06.713 17:06:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:06.713 17:06:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:06.713 17:06:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:06.713 17:06:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:06.713 17:06:52 -- scripts/common.sh@335 -- # IFS=.-: 00:31:06.713 17:06:52 -- scripts/common.sh@335 -- # read -ra ver1 00:31:06.713 17:06:52 -- scripts/common.sh@336 -- # IFS=.-: 00:31:06.713 17:06:52 -- scripts/common.sh@336 -- # read -ra ver2 00:31:06.713 17:06:52 -- scripts/common.sh@337 -- # local 'op=<' 00:31:06.713 17:06:52 -- scripts/common.sh@339 -- # ver1_l=2 00:31:06.713 17:06:52 -- scripts/common.sh@340 -- # ver2_l=1 00:31:06.713 17:06:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:06.713 17:06:52 -- scripts/common.sh@343 -- # case "$op" in 00:31:06.713 17:06:52 -- scripts/common.sh@344 -- # : 1 00:31:06.713 17:06:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:06.713 17:06:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:06.713 17:06:52 -- scripts/common.sh@364 -- # decimal 1 00:31:06.713 17:06:52 -- scripts/common.sh@352 -- # local d=1 00:31:06.713 17:06:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:06.713 17:06:52 -- scripts/common.sh@354 -- # echo 1 00:31:06.713 17:06:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:06.713 17:06:52 -- scripts/common.sh@365 -- # decimal 2 00:31:06.713 17:06:52 -- scripts/common.sh@352 -- # local d=2 00:31:06.713 17:06:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:06.713 17:06:52 -- scripts/common.sh@354 -- # echo 2 00:31:06.713 17:06:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:06.714 17:06:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:06.714 17:06:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:06.714 17:06:52 -- scripts/common.sh@367 -- # return 0 00:31:06.714 17:06:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:06.714 17:06:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:06.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:06.714 --rc genhtml_branch_coverage=1 00:31:06.714 --rc genhtml_function_coverage=1 00:31:06.714 --rc genhtml_legend=1 00:31:06.714 --rc geninfo_all_blocks=1 00:31:06.714 --rc geninfo_unexecuted_blocks=1 00:31:06.714 00:31:06.714 ' 00:31:06.714 17:06:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:06.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:06.714 --rc genhtml_branch_coverage=1 00:31:06.714 --rc genhtml_function_coverage=1 00:31:06.714 --rc genhtml_legend=1 00:31:06.714 --rc geninfo_all_blocks=1 00:31:06.714 --rc geninfo_unexecuted_blocks=1 00:31:06.714 00:31:06.714 ' 00:31:06.714 17:06:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:06.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:06.714 --rc genhtml_branch_coverage=1 00:31:06.714 --rc genhtml_function_coverage=1 00:31:06.714 --rc genhtml_legend=1 00:31:06.714 --rc geninfo_all_blocks=1 00:31:06.714 --rc geninfo_unexecuted_blocks=1 00:31:06.714 00:31:06.714 ' 00:31:06.714 17:06:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:06.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:06.714 --rc genhtml_branch_coverage=1 00:31:06.714 --rc genhtml_function_coverage=1 00:31:06.714 --rc genhtml_legend=1 00:31:06.714 --rc geninfo_all_blocks=1 00:31:06.714 --rc geninfo_unexecuted_blocks=1 00:31:06.714 00:31:06.714 ' 00:31:06.714 17:06:52 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:06.714 17:06:52 -- nvmf/common.sh@7 -- # uname -s 00:31:06.714 17:06:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:06.714 17:06:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:06.714 17:06:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:06.714 17:06:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:06.714 17:06:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:06.714 17:06:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:06.714 17:06:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:06.714 17:06:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:06.714 17:06:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:06.714 17:06:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:06.714 17:06:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:06.714 17:06:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:06.714 17:06:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:06.714 17:06:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:06.714 17:06:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:06.714 17:06:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:06.714 17:06:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:06.714 17:06:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:06.714 17:06:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:06.714 17:06:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.714 17:06:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.714 17:06:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.714 17:06:52 -- paths/export.sh@5 -- # export PATH 00:31:06.714 17:06:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.714 17:06:52 -- nvmf/common.sh@46 -- # : 0 00:31:06.714 17:06:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:06.714 17:06:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:06.714 17:06:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:06.714 17:06:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:06.714 17:06:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:06.714 17:06:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:06.714 17:06:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:06.714 17:06:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:06.714 17:06:52 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:06.714 17:06:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:06.714 17:06:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:06.714 17:06:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:06.714 17:06:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.714 17:06:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.714 17:06:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.714 17:06:52 -- paths/export.sh@5 -- # export PATH 00:31:06.714 17:06:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.714 17:06:52 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:31:06.714 17:06:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:06.714 17:06:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:06.714 17:06:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:06.714 17:06:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:06.714 17:06:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:06.714 17:06:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:06.714 17:06:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:06.714 17:06:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:06.714 17:06:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:06.714 17:06:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:06.714 17:06:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:06.714 17:06:52 -- common/autotest_common.sh@10 -- # set +x 00:31:08.618 17:06:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:08.618 17:06:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:08.618 17:06:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:08.618 17:06:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:08.618 17:06:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:08.618 17:06:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:08.618 17:06:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:08.618 17:06:54 -- nvmf/common.sh@294 -- # net_devs=() 00:31:08.618 17:06:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:08.618 17:06:54 -- nvmf/common.sh@295 -- # e810=() 00:31:08.618 17:06:54 -- nvmf/common.sh@295 -- # local -ga e810 00:31:08.618 17:06:54 -- nvmf/common.sh@296 -- # x722=() 00:31:08.618 17:06:54 -- nvmf/common.sh@296 -- # local -ga x722 00:31:08.618 17:06:54 -- nvmf/common.sh@297 -- # mlx=() 00:31:08.618 17:06:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:08.618 17:06:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:08.618 17:06:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:08.618 17:06:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:08.618 17:06:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:08.618 17:06:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:08.618 17:06:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:08.618 17:06:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:08.618 17:06:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:08.618 17:06:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:08.618 17:06:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:08.618 17:06:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:08.618 17:06:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:08.618 17:06:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:08.618 17:06:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:08.618 17:06:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:08.618 17:06:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:08.618 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:08.618 17:06:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:08.618 17:06:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:08.618 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:08.618 17:06:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:08.618 17:06:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:08.618 17:06:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:08.618 17:06:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:08.618 17:06:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:08.618 17:06:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:08.618 17:06:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:08.618 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:08.618 17:06:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:08.619 17:06:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:08.619 17:06:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:08.619 17:06:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:08.619 17:06:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:08.619 17:06:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:08.619 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:08.619 17:06:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:08.619 17:06:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:08.619 17:06:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:08.619 17:06:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:08.619 17:06:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:08.619 17:06:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:08.619 17:06:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:08.619 17:06:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:08.619 17:06:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:08.619 17:06:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:08.619 17:06:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:08.619 17:06:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:08.619 17:06:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:08.619 17:06:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:08.619 17:06:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:08.619 17:06:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:08.619 17:06:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:08.619 17:06:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:08.619 17:06:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:08.619 17:06:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:08.619 17:06:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:08.619 17:06:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:08.619 17:06:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:08.619 17:06:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:08.619 17:06:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:08.619 17:06:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:08.619 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:08.619 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:31:08.619 00:31:08.619 --- 10.0.0.2 ping statistics --- 00:31:08.619 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:08.619 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:31:08.619 17:06:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:08.619 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:08.619 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:31:08.619 00:31:08.619 --- 10.0.0.1 ping statistics --- 00:31:08.619 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:08.619 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:31:08.619 17:06:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:08.619 17:06:54 -- nvmf/common.sh@410 -- # return 0 00:31:08.619 17:06:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:08.619 17:06:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:08.619 17:06:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:08.619 17:06:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:08.619 17:06:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:08.619 17:06:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:08.619 17:06:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:08.619 17:06:54 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:31:08.619 17:06:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:08.619 17:06:54 -- common/autotest_common.sh@10 -- # set +x 00:31:08.619 17:06:54 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:31:08.619 17:06:54 -- common/autotest_common.sh@1519 -- # bdfs=() 00:31:08.619 17:06:54 -- common/autotest_common.sh@1519 -- # local bdfs 00:31:08.619 17:06:54 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:31:08.619 17:06:54 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:31:08.619 17:06:54 -- common/autotest_common.sh@1508 -- # bdfs=() 00:31:08.619 17:06:54 -- common/autotest_common.sh@1508 -- # local bdfs 00:31:08.619 17:06:54 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:31:08.619 17:06:54 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:31:08.619 17:06:54 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:31:08.619 17:06:54 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:31:08.619 17:06:54 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:31:08.619 17:06:54 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:31:08.619 17:06:54 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:31:08.619 17:06:54 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:31:08.619 17:06:54 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:08.619 17:06:54 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:31:08.619 17:06:54 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:31:08.879 EAL: No free 2048 kB hugepages reported on node 1 00:31:13.077 17:06:58 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:31:13.077 17:06:58 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:13.077 17:06:58 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:31:13.077 17:06:58 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:31:13.077 EAL: No free 2048 kB hugepages reported on node 1 00:31:17.274 17:07:02 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:31:17.274 17:07:02 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:31:17.274 17:07:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:17.274 17:07:02 -- common/autotest_common.sh@10 -- # set +x 00:31:17.274 17:07:02 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:31:17.274 17:07:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:17.274 17:07:02 -- common/autotest_common.sh@10 -- # set +x 00:31:17.274 17:07:02 -- target/identify_passthru.sh@31 -- # nvmfpid=1338037 00:31:17.274 17:07:02 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:31:17.274 17:07:02 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:17.274 17:07:02 -- target/identify_passthru.sh@35 -- # waitforlisten 1338037 00:31:17.274 17:07:02 -- common/autotest_common.sh@829 -- # '[' -z 1338037 ']' 00:31:17.274 17:07:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:17.274 17:07:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:17.274 17:07:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:17.274 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:17.274 17:07:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:17.274 17:07:02 -- common/autotest_common.sh@10 -- # set +x 00:31:17.274 [2024-11-16 17:07:02.824165] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:17.274 [2024-11-16 17:07:02.824259] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:17.274 EAL: No free 2048 kB hugepages reported on node 1 00:31:17.274 [2024-11-16 17:07:02.896783] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:17.274 [2024-11-16 17:07:02.991050] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:17.274 [2024-11-16 17:07:02.991191] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:17.274 [2024-11-16 17:07:02.991208] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:17.274 [2024-11-16 17:07:02.991222] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:17.274 [2024-11-16 17:07:02.994640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:17.274 [2024-11-16 17:07:02.994691] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:17.274 [2024-11-16 17:07:02.994713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:17.274 [2024-11-16 17:07:02.994716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:17.533 17:07:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:17.533 17:07:03 -- common/autotest_common.sh@862 -- # return 0 00:31:17.533 17:07:03 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:31:17.533 17:07:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:17.533 17:07:03 -- common/autotest_common.sh@10 -- # set +x 00:31:17.533 INFO: Log level set to 20 00:31:17.533 INFO: Requests: 00:31:17.533 { 00:31:17.533 "jsonrpc": "2.0", 00:31:17.533 "method": "nvmf_set_config", 00:31:17.533 "id": 1, 00:31:17.533 "params": { 00:31:17.533 "admin_cmd_passthru": { 00:31:17.533 "identify_ctrlr": true 00:31:17.533 } 00:31:17.533 } 00:31:17.533 } 00:31:17.533 00:31:17.533 INFO: response: 00:31:17.533 { 00:31:17.533 "jsonrpc": "2.0", 00:31:17.533 "id": 1, 00:31:17.533 "result": true 00:31:17.533 } 00:31:17.533 00:31:17.533 17:07:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:17.533 17:07:03 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:31:17.533 17:07:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:17.533 17:07:03 -- common/autotest_common.sh@10 -- # set +x 00:31:17.533 INFO: Setting log level to 20 00:31:17.533 INFO: Setting log level to 20 00:31:17.533 INFO: Log level set to 20 00:31:17.533 INFO: Log level set to 20 00:31:17.533 INFO: Requests: 00:31:17.533 { 00:31:17.533 "jsonrpc": "2.0", 00:31:17.533 "method": "framework_start_init", 00:31:17.533 "id": 1 00:31:17.533 } 00:31:17.533 00:31:17.533 INFO: Requests: 00:31:17.533 { 00:31:17.533 "jsonrpc": "2.0", 00:31:17.533 "method": "framework_start_init", 00:31:17.533 "id": 1 00:31:17.533 } 00:31:17.533 00:31:17.533 [2024-11-16 17:07:03.168808] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:31:17.533 INFO: response: 00:31:17.533 { 00:31:17.533 "jsonrpc": "2.0", 00:31:17.533 "id": 1, 00:31:17.533 "result": true 00:31:17.533 } 00:31:17.533 00:31:17.533 INFO: response: 00:31:17.533 { 00:31:17.533 "jsonrpc": "2.0", 00:31:17.533 "id": 1, 00:31:17.533 "result": true 00:31:17.533 } 00:31:17.533 00:31:17.533 17:07:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:17.533 17:07:03 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:17.533 17:07:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:17.533 17:07:03 -- common/autotest_common.sh@10 -- # set +x 00:31:17.533 INFO: Setting log level to 40 00:31:17.533 INFO: Setting log level to 40 00:31:17.533 INFO: Setting log level to 40 00:31:17.533 [2024-11-16 17:07:03.178623] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:17.533 17:07:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:17.533 17:07:03 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:31:17.533 17:07:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:17.533 17:07:03 -- common/autotest_common.sh@10 -- # set +x 00:31:17.534 17:07:03 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:31:17.534 17:07:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:17.534 17:07:03 -- common/autotest_common.sh@10 -- # set +x 00:31:20.828 Nvme0n1 00:31:20.828 17:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.828 17:07:06 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:20.828 17:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.828 17:07:06 -- common/autotest_common.sh@10 -- # set +x 00:31:20.828 17:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.828 17:07:06 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:20.828 17:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.828 17:07:06 -- common/autotest_common.sh@10 -- # set +x 00:31:20.828 17:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.828 17:07:06 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:20.828 17:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.828 17:07:06 -- common/autotest_common.sh@10 -- # set +x 00:31:20.828 [2024-11-16 17:07:06.065779] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:20.828 17:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.828 17:07:06 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:20.828 17:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.828 17:07:06 -- common/autotest_common.sh@10 -- # set +x 00:31:20.828 [2024-11-16 17:07:06.073467] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:20.828 [ 00:31:20.828 { 00:31:20.828 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:20.828 "subtype": "Discovery", 00:31:20.828 "listen_addresses": [], 00:31:20.828 "allow_any_host": true, 00:31:20.828 "hosts": [] 00:31:20.828 }, 00:31:20.828 { 00:31:20.828 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:20.828 "subtype": "NVMe", 00:31:20.828 "listen_addresses": [ 00:31:20.828 { 00:31:20.828 "transport": "TCP", 00:31:20.828 "trtype": "TCP", 00:31:20.828 "adrfam": "IPv4", 00:31:20.828 "traddr": "10.0.0.2", 00:31:20.828 "trsvcid": "4420" 00:31:20.828 } 00:31:20.828 ], 00:31:20.828 "allow_any_host": true, 00:31:20.828 "hosts": [], 00:31:20.828 "serial_number": "SPDK00000000000001", 00:31:20.828 "model_number": "SPDK bdev Controller", 00:31:20.828 "max_namespaces": 1, 00:31:20.828 "min_cntlid": 1, 00:31:20.828 "max_cntlid": 65519, 00:31:20.828 "namespaces": [ 00:31:20.828 { 00:31:20.828 "nsid": 1, 00:31:20.828 "bdev_name": "Nvme0n1", 00:31:20.828 "name": "Nvme0n1", 00:31:20.828 "nguid": "8738A4B3D9D843ABB88EEFDAB0EFDBF4", 00:31:20.828 "uuid": "8738a4b3-d9d8-43ab-b88e-efdab0efdbf4" 00:31:20.828 } 00:31:20.828 ] 00:31:20.828 } 00:31:20.828 ] 00:31:20.828 17:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.828 17:07:06 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:20.828 17:07:06 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:20.828 17:07:06 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:20.828 EAL: No free 2048 kB hugepages reported on node 1 00:31:20.828 17:07:06 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:31:20.828 17:07:06 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:20.828 17:07:06 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:20.828 17:07:06 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:20.828 EAL: No free 2048 kB hugepages reported on node 1 00:31:20.828 17:07:06 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:31:20.828 17:07:06 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:31:20.828 17:07:06 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:31:20.828 17:07:06 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:20.828 17:07:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.828 17:07:06 -- common/autotest_common.sh@10 -- # set +x 00:31:20.828 17:07:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.828 17:07:06 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:20.828 17:07:06 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:20.828 17:07:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:20.828 17:07:06 -- nvmf/common.sh@116 -- # sync 00:31:20.828 17:07:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:20.828 17:07:06 -- nvmf/common.sh@119 -- # set +e 00:31:20.828 17:07:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:20.828 17:07:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:20.828 rmmod nvme_tcp 00:31:20.828 rmmod nvme_fabrics 00:31:20.828 rmmod nvme_keyring 00:31:20.828 17:07:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:20.828 17:07:06 -- nvmf/common.sh@123 -- # set -e 00:31:20.828 17:07:06 -- nvmf/common.sh@124 -- # return 0 00:31:20.828 17:07:06 -- nvmf/common.sh@477 -- # '[' -n 1338037 ']' 00:31:20.828 17:07:06 -- nvmf/common.sh@478 -- # killprocess 1338037 00:31:20.828 17:07:06 -- common/autotest_common.sh@936 -- # '[' -z 1338037 ']' 00:31:20.828 17:07:06 -- common/autotest_common.sh@940 -- # kill -0 1338037 00:31:20.828 17:07:06 -- common/autotest_common.sh@941 -- # uname 00:31:20.828 17:07:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:20.828 17:07:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1338037 00:31:20.828 17:07:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:20.828 17:07:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:20.828 17:07:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1338037' 00:31:20.828 killing process with pid 1338037 00:31:20.828 17:07:06 -- common/autotest_common.sh@955 -- # kill 1338037 00:31:20.828 [2024-11-16 17:07:06.414279] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:20.828 17:07:06 -- common/autotest_common.sh@960 -- # wait 1338037 00:31:22.733 17:07:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:22.733 17:07:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:22.733 17:07:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:22.733 17:07:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:22.733 17:07:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:22.733 17:07:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:22.733 17:07:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:22.733 17:07:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:24.637 17:07:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:24.637 00:31:24.637 real 0m17.838s 00:31:24.637 user 0m26.456s 00:31:24.637 sys 0m2.163s 00:31:24.637 17:07:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:24.637 17:07:10 -- common/autotest_common.sh@10 -- # set +x 00:31:24.637 ************************************ 00:31:24.637 END TEST nvmf_identify_passthru 00:31:24.637 ************************************ 00:31:24.637 17:07:10 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:24.637 17:07:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:24.637 17:07:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:24.637 17:07:10 -- common/autotest_common.sh@10 -- # set +x 00:31:24.637 ************************************ 00:31:24.637 START TEST nvmf_dif 00:31:24.637 ************************************ 00:31:24.637 17:07:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:24.637 * Looking for test storage... 00:31:24.637 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:24.637 17:07:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:24.637 17:07:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:24.637 17:07:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:24.637 17:07:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:24.637 17:07:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:24.637 17:07:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:24.637 17:07:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:24.637 17:07:10 -- scripts/common.sh@335 -- # IFS=.-: 00:31:24.637 17:07:10 -- scripts/common.sh@335 -- # read -ra ver1 00:31:24.637 17:07:10 -- scripts/common.sh@336 -- # IFS=.-: 00:31:24.637 17:07:10 -- scripts/common.sh@336 -- # read -ra ver2 00:31:24.637 17:07:10 -- scripts/common.sh@337 -- # local 'op=<' 00:31:24.637 17:07:10 -- scripts/common.sh@339 -- # ver1_l=2 00:31:24.637 17:07:10 -- scripts/common.sh@340 -- # ver2_l=1 00:31:24.637 17:07:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:24.637 17:07:10 -- scripts/common.sh@343 -- # case "$op" in 00:31:24.637 17:07:10 -- scripts/common.sh@344 -- # : 1 00:31:24.637 17:07:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:24.637 17:07:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:24.637 17:07:10 -- scripts/common.sh@364 -- # decimal 1 00:31:24.637 17:07:10 -- scripts/common.sh@352 -- # local d=1 00:31:24.637 17:07:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:24.637 17:07:10 -- scripts/common.sh@354 -- # echo 1 00:31:24.637 17:07:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:24.637 17:07:10 -- scripts/common.sh@365 -- # decimal 2 00:31:24.637 17:07:10 -- scripts/common.sh@352 -- # local d=2 00:31:24.637 17:07:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:24.637 17:07:10 -- scripts/common.sh@354 -- # echo 2 00:31:24.637 17:07:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:24.637 17:07:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:24.637 17:07:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:24.637 17:07:10 -- scripts/common.sh@367 -- # return 0 00:31:24.637 17:07:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:24.637 17:07:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:24.637 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:24.637 --rc genhtml_branch_coverage=1 00:31:24.637 --rc genhtml_function_coverage=1 00:31:24.637 --rc genhtml_legend=1 00:31:24.637 --rc geninfo_all_blocks=1 00:31:24.637 --rc geninfo_unexecuted_blocks=1 00:31:24.637 00:31:24.637 ' 00:31:24.637 17:07:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:24.637 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:24.637 --rc genhtml_branch_coverage=1 00:31:24.637 --rc genhtml_function_coverage=1 00:31:24.637 --rc genhtml_legend=1 00:31:24.637 --rc geninfo_all_blocks=1 00:31:24.637 --rc geninfo_unexecuted_blocks=1 00:31:24.637 00:31:24.637 ' 00:31:24.637 17:07:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:24.637 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:24.637 --rc genhtml_branch_coverage=1 00:31:24.637 --rc genhtml_function_coverage=1 00:31:24.637 --rc genhtml_legend=1 00:31:24.637 --rc geninfo_all_blocks=1 00:31:24.637 --rc geninfo_unexecuted_blocks=1 00:31:24.637 00:31:24.637 ' 00:31:24.637 17:07:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:24.638 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:24.638 --rc genhtml_branch_coverage=1 00:31:24.638 --rc genhtml_function_coverage=1 00:31:24.638 --rc genhtml_legend=1 00:31:24.638 --rc geninfo_all_blocks=1 00:31:24.638 --rc geninfo_unexecuted_blocks=1 00:31:24.638 00:31:24.638 ' 00:31:24.638 17:07:10 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:24.638 17:07:10 -- nvmf/common.sh@7 -- # uname -s 00:31:24.638 17:07:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:24.638 17:07:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:24.638 17:07:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:24.638 17:07:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:24.638 17:07:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:24.638 17:07:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:24.638 17:07:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:24.638 17:07:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:24.638 17:07:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:24.638 17:07:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:24.638 17:07:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:24.638 17:07:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:24.638 17:07:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:24.638 17:07:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:24.638 17:07:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:24.638 17:07:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:24.638 17:07:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:24.638 17:07:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:24.638 17:07:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:24.638 17:07:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:24.638 17:07:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:24.638 17:07:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:24.638 17:07:10 -- paths/export.sh@5 -- # export PATH 00:31:24.638 17:07:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:24.638 17:07:10 -- nvmf/common.sh@46 -- # : 0 00:31:24.638 17:07:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:24.638 17:07:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:24.638 17:07:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:24.638 17:07:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:24.638 17:07:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:24.638 17:07:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:24.638 17:07:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:24.638 17:07:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:24.638 17:07:10 -- target/dif.sh@15 -- # NULL_META=16 00:31:24.638 17:07:10 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:24.638 17:07:10 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:24.638 17:07:10 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:24.638 17:07:10 -- target/dif.sh@135 -- # nvmftestinit 00:31:24.638 17:07:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:24.638 17:07:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:24.638 17:07:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:24.638 17:07:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:24.638 17:07:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:24.638 17:07:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:24.638 17:07:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:24.638 17:07:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:24.638 17:07:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:24.638 17:07:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:24.638 17:07:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:24.638 17:07:10 -- common/autotest_common.sh@10 -- # set +x 00:31:27.171 17:07:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:27.171 17:07:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:27.171 17:07:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:27.171 17:07:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:27.171 17:07:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:27.171 17:07:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:27.171 17:07:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:27.171 17:07:12 -- nvmf/common.sh@294 -- # net_devs=() 00:31:27.171 17:07:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:27.171 17:07:12 -- nvmf/common.sh@295 -- # e810=() 00:31:27.171 17:07:12 -- nvmf/common.sh@295 -- # local -ga e810 00:31:27.171 17:07:12 -- nvmf/common.sh@296 -- # x722=() 00:31:27.171 17:07:12 -- nvmf/common.sh@296 -- # local -ga x722 00:31:27.171 17:07:12 -- nvmf/common.sh@297 -- # mlx=() 00:31:27.171 17:07:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:27.171 17:07:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:27.171 17:07:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:27.171 17:07:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:27.171 17:07:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:27.171 17:07:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:27.171 17:07:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:27.171 17:07:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:27.171 17:07:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:27.171 17:07:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:27.171 17:07:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:27.171 17:07:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:27.171 17:07:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:27.171 17:07:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:27.171 17:07:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:27.171 17:07:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:27.171 17:07:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:27.171 17:07:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:27.171 17:07:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:27.171 17:07:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:27.171 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:27.171 17:07:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:27.171 17:07:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:27.171 17:07:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:27.171 17:07:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:27.171 17:07:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:27.171 17:07:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:27.171 17:07:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:27.171 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:27.171 17:07:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:27.171 17:07:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:27.172 17:07:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:27.172 17:07:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:27.172 17:07:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:27.172 17:07:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:27.172 17:07:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:27.172 17:07:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:27.172 17:07:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:27.172 17:07:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:27.172 17:07:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:27.172 17:07:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:27.172 17:07:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:27.172 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:27.172 17:07:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:27.172 17:07:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:27.172 17:07:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:27.172 17:07:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:27.172 17:07:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:27.172 17:07:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:27.172 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:27.172 17:07:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:27.172 17:07:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:27.172 17:07:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:27.172 17:07:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:27.172 17:07:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:27.172 17:07:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:27.172 17:07:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:27.172 17:07:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:27.172 17:07:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:27.172 17:07:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:27.172 17:07:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:27.172 17:07:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:27.172 17:07:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:27.172 17:07:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:27.172 17:07:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:27.172 17:07:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:27.172 17:07:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:27.172 17:07:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:27.172 17:07:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:27.172 17:07:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:27.172 17:07:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:27.172 17:07:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:27.172 17:07:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:27.172 17:07:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:27.172 17:07:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:27.172 17:07:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:27.172 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:27.172 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:31:27.172 00:31:27.172 --- 10.0.0.2 ping statistics --- 00:31:27.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:27.172 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:31:27.172 17:07:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:27.172 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:27.172 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:31:27.172 00:31:27.172 --- 10.0.0.1 ping statistics --- 00:31:27.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:27.172 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:31:27.172 17:07:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:27.172 17:07:12 -- nvmf/common.sh@410 -- # return 0 00:31:27.172 17:07:12 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:27.172 17:07:12 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:28.109 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:28.109 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:28.109 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:28.109 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:28.109 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:28.109 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:28.109 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:28.109 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:28.109 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:28.109 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:28.109 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:28.109 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:28.109 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:28.109 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:28.109 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:28.109 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:28.109 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:28.109 17:07:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:28.109 17:07:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:28.109 17:07:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:28.109 17:07:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:28.109 17:07:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:28.109 17:07:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:28.109 17:07:13 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:28.109 17:07:13 -- target/dif.sh@137 -- # nvmfappstart 00:31:28.109 17:07:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:28.109 17:07:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:28.109 17:07:13 -- common/autotest_common.sh@10 -- # set +x 00:31:28.109 17:07:13 -- nvmf/common.sh@469 -- # nvmfpid=1341246 00:31:28.109 17:07:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:28.109 17:07:13 -- nvmf/common.sh@470 -- # waitforlisten 1341246 00:31:28.109 17:07:13 -- common/autotest_common.sh@829 -- # '[' -z 1341246 ']' 00:31:28.109 17:07:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:28.109 17:07:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:28.109 17:07:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:28.109 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:28.109 17:07:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:28.109 17:07:13 -- common/autotest_common.sh@10 -- # set +x 00:31:28.109 [2024-11-16 17:07:13.834048] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:28.109 [2024-11-16 17:07:13.834129] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:28.369 EAL: No free 2048 kB hugepages reported on node 1 00:31:28.369 [2024-11-16 17:07:13.903437] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:28.369 [2024-11-16 17:07:13.995211] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:28.369 [2024-11-16 17:07:13.995381] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:28.370 [2024-11-16 17:07:13.995403] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:28.370 [2024-11-16 17:07:13.995419] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:28.370 [2024-11-16 17:07:13.995449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:29.307 17:07:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:29.307 17:07:14 -- common/autotest_common.sh@862 -- # return 0 00:31:29.307 17:07:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:29.307 17:07:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:29.307 17:07:14 -- common/autotest_common.sh@10 -- # set +x 00:31:29.307 17:07:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:29.307 17:07:14 -- target/dif.sh@139 -- # create_transport 00:31:29.307 17:07:14 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:29.307 17:07:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:29.307 17:07:14 -- common/autotest_common.sh@10 -- # set +x 00:31:29.307 [2024-11-16 17:07:14.873404] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:29.307 17:07:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:29.307 17:07:14 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:29.307 17:07:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:29.307 17:07:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:29.307 17:07:14 -- common/autotest_common.sh@10 -- # set +x 00:31:29.307 ************************************ 00:31:29.307 START TEST fio_dif_1_default 00:31:29.307 ************************************ 00:31:29.307 17:07:14 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:31:29.307 17:07:14 -- target/dif.sh@86 -- # create_subsystems 0 00:31:29.307 17:07:14 -- target/dif.sh@28 -- # local sub 00:31:29.307 17:07:14 -- target/dif.sh@30 -- # for sub in "$@" 00:31:29.307 17:07:14 -- target/dif.sh@31 -- # create_subsystem 0 00:31:29.307 17:07:14 -- target/dif.sh@18 -- # local sub_id=0 00:31:29.307 17:07:14 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:29.307 17:07:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:29.307 17:07:14 -- common/autotest_common.sh@10 -- # set +x 00:31:29.307 bdev_null0 00:31:29.307 17:07:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:29.307 17:07:14 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:29.307 17:07:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:29.307 17:07:14 -- common/autotest_common.sh@10 -- # set +x 00:31:29.307 17:07:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:29.307 17:07:14 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:29.307 17:07:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:29.307 17:07:14 -- common/autotest_common.sh@10 -- # set +x 00:31:29.307 17:07:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:29.307 17:07:14 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:29.307 17:07:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:29.307 17:07:14 -- common/autotest_common.sh@10 -- # set +x 00:31:29.307 [2024-11-16 17:07:14.909730] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:29.307 17:07:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:29.307 17:07:14 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:29.307 17:07:14 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:29.307 17:07:14 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:29.307 17:07:14 -- nvmf/common.sh@520 -- # config=() 00:31:29.307 17:07:14 -- nvmf/common.sh@520 -- # local subsystem config 00:31:29.307 17:07:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:29.307 17:07:14 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:29.307 17:07:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:29.307 { 00:31:29.307 "params": { 00:31:29.307 "name": "Nvme$subsystem", 00:31:29.307 "trtype": "$TEST_TRANSPORT", 00:31:29.307 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:29.307 "adrfam": "ipv4", 00:31:29.307 "trsvcid": "$NVMF_PORT", 00:31:29.307 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:29.307 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:29.307 "hdgst": ${hdgst:-false}, 00:31:29.307 "ddgst": ${ddgst:-false} 00:31:29.307 }, 00:31:29.307 "method": "bdev_nvme_attach_controller" 00:31:29.307 } 00:31:29.307 EOF 00:31:29.307 )") 00:31:29.307 17:07:14 -- target/dif.sh@82 -- # gen_fio_conf 00:31:29.307 17:07:14 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:29.307 17:07:14 -- target/dif.sh@54 -- # local file 00:31:29.307 17:07:14 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:29.307 17:07:14 -- target/dif.sh@56 -- # cat 00:31:29.307 17:07:14 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:29.307 17:07:14 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:29.307 17:07:14 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:29.307 17:07:14 -- common/autotest_common.sh@1330 -- # shift 00:31:29.307 17:07:14 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:29.307 17:07:14 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:29.307 17:07:14 -- nvmf/common.sh@542 -- # cat 00:31:29.307 17:07:14 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:29.307 17:07:14 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:29.307 17:07:14 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:29.307 17:07:14 -- target/dif.sh@72 -- # (( file <= files )) 00:31:29.307 17:07:14 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:29.307 17:07:14 -- nvmf/common.sh@544 -- # jq . 00:31:29.307 17:07:14 -- nvmf/common.sh@545 -- # IFS=, 00:31:29.307 17:07:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:29.307 "params": { 00:31:29.307 "name": "Nvme0", 00:31:29.307 "trtype": "tcp", 00:31:29.307 "traddr": "10.0.0.2", 00:31:29.307 "adrfam": "ipv4", 00:31:29.307 "trsvcid": "4420", 00:31:29.307 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:29.307 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:29.307 "hdgst": false, 00:31:29.307 "ddgst": false 00:31:29.307 }, 00:31:29.307 "method": "bdev_nvme_attach_controller" 00:31:29.307 }' 00:31:29.307 17:07:14 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:29.307 17:07:14 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:29.307 17:07:14 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:29.307 17:07:14 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:29.307 17:07:14 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:29.307 17:07:14 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:29.307 17:07:14 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:29.307 17:07:14 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:29.308 17:07:14 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:29.308 17:07:14 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:29.565 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:29.565 fio-3.35 00:31:29.565 Starting 1 thread 00:31:29.565 EAL: No free 2048 kB hugepages reported on node 1 00:31:30.132 [2024-11-16 17:07:15.647459] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:30.132 [2024-11-16 17:07:15.647521] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:40.113 00:31:40.113 filename0: (groupid=0, jobs=1): err= 0: pid=1341609: Sat Nov 16 17:07:25 2024 00:31:40.113 read: IOPS=97, BW=391KiB/s (401kB/s)(3920KiB/10013msec) 00:31:40.113 slat (nsec): min=4118, max=25422, avg=9173.90, stdev=2428.89 00:31:40.113 clat (usec): min=737, max=47697, avg=40839.48, stdev=2604.01 00:31:40.113 lat (usec): min=745, max=47712, avg=40848.65, stdev=2604.04 00:31:40.113 clat percentiles (usec): 00:31:40.113 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:40.113 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:40.113 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:40.113 | 99.00th=[41157], 99.50th=[42206], 99.90th=[47449], 99.95th=[47449], 00:31:40.113 | 99.99th=[47449] 00:31:40.113 bw ( KiB/s): min= 384, max= 416, per=99.62%, avg=390.40, stdev=13.13, samples=20 00:31:40.113 iops : min= 96, max= 104, avg=97.60, stdev= 3.28, samples=20 00:31:40.113 lat (usec) : 750=0.20%, 1000=0.20% 00:31:40.113 lat (msec) : 50=99.59% 00:31:40.113 cpu : usr=91.35%, sys=8.37%, ctx=14, majf=0, minf=256 00:31:40.113 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:40.113 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:40.113 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:40.113 issued rwts: total=980,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:40.113 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:40.113 00:31:40.113 Run status group 0 (all jobs): 00:31:40.113 READ: bw=391KiB/s (401kB/s), 391KiB/s-391KiB/s (401kB/s-401kB/s), io=3920KiB (4014kB), run=10013-10013msec 00:31:40.372 17:07:25 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:40.372 17:07:25 -- target/dif.sh@43 -- # local sub 00:31:40.372 17:07:25 -- target/dif.sh@45 -- # for sub in "$@" 00:31:40.372 17:07:25 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:40.372 17:07:25 -- target/dif.sh@36 -- # local sub_id=0 00:31:40.372 17:07:25 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:40.372 17:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.372 17:07:25 -- common/autotest_common.sh@10 -- # set +x 00:31:40.372 17:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.372 17:07:25 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:40.372 17:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.372 17:07:25 -- common/autotest_common.sh@10 -- # set +x 00:31:40.372 17:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.372 00:31:40.372 real 0m11.108s 00:31:40.372 user 0m10.185s 00:31:40.372 sys 0m1.088s 00:31:40.372 17:07:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:40.372 17:07:25 -- common/autotest_common.sh@10 -- # set +x 00:31:40.372 ************************************ 00:31:40.372 END TEST fio_dif_1_default 00:31:40.372 ************************************ 00:31:40.372 17:07:26 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:40.372 17:07:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:40.372 17:07:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:40.372 17:07:26 -- common/autotest_common.sh@10 -- # set +x 00:31:40.372 ************************************ 00:31:40.372 START TEST fio_dif_1_multi_subsystems 00:31:40.372 ************************************ 00:31:40.372 17:07:26 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:31:40.372 17:07:26 -- target/dif.sh@92 -- # local files=1 00:31:40.372 17:07:26 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:40.372 17:07:26 -- target/dif.sh@28 -- # local sub 00:31:40.372 17:07:26 -- target/dif.sh@30 -- # for sub in "$@" 00:31:40.372 17:07:26 -- target/dif.sh@31 -- # create_subsystem 0 00:31:40.372 17:07:26 -- target/dif.sh@18 -- # local sub_id=0 00:31:40.373 17:07:26 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:40.373 17:07:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.373 17:07:26 -- common/autotest_common.sh@10 -- # set +x 00:31:40.373 bdev_null0 00:31:40.373 17:07:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.373 17:07:26 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:40.373 17:07:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.373 17:07:26 -- common/autotest_common.sh@10 -- # set +x 00:31:40.373 17:07:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.373 17:07:26 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:40.373 17:07:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.373 17:07:26 -- common/autotest_common.sh@10 -- # set +x 00:31:40.373 17:07:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.373 17:07:26 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:40.373 17:07:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.373 17:07:26 -- common/autotest_common.sh@10 -- # set +x 00:31:40.373 [2024-11-16 17:07:26.046168] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:40.373 17:07:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.373 17:07:26 -- target/dif.sh@30 -- # for sub in "$@" 00:31:40.373 17:07:26 -- target/dif.sh@31 -- # create_subsystem 1 00:31:40.373 17:07:26 -- target/dif.sh@18 -- # local sub_id=1 00:31:40.373 17:07:26 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:40.373 17:07:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.373 17:07:26 -- common/autotest_common.sh@10 -- # set +x 00:31:40.373 bdev_null1 00:31:40.373 17:07:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.373 17:07:26 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:40.373 17:07:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.373 17:07:26 -- common/autotest_common.sh@10 -- # set +x 00:31:40.373 17:07:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.373 17:07:26 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:40.373 17:07:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.373 17:07:26 -- common/autotest_common.sh@10 -- # set +x 00:31:40.373 17:07:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.373 17:07:26 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:40.373 17:07:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:40.373 17:07:26 -- common/autotest_common.sh@10 -- # set +x 00:31:40.373 17:07:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:40.373 17:07:26 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:40.373 17:07:26 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:40.373 17:07:26 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:40.373 17:07:26 -- nvmf/common.sh@520 -- # config=() 00:31:40.373 17:07:26 -- nvmf/common.sh@520 -- # local subsystem config 00:31:40.373 17:07:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:40.373 17:07:26 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:40.373 17:07:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:40.373 { 00:31:40.373 "params": { 00:31:40.373 "name": "Nvme$subsystem", 00:31:40.373 "trtype": "$TEST_TRANSPORT", 00:31:40.373 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:40.373 "adrfam": "ipv4", 00:31:40.373 "trsvcid": "$NVMF_PORT", 00:31:40.373 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:40.373 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:40.373 "hdgst": ${hdgst:-false}, 00:31:40.373 "ddgst": ${ddgst:-false} 00:31:40.373 }, 00:31:40.373 "method": "bdev_nvme_attach_controller" 00:31:40.373 } 00:31:40.373 EOF 00:31:40.373 )") 00:31:40.373 17:07:26 -- target/dif.sh@82 -- # gen_fio_conf 00:31:40.373 17:07:26 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:40.373 17:07:26 -- target/dif.sh@54 -- # local file 00:31:40.373 17:07:26 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:40.373 17:07:26 -- target/dif.sh@56 -- # cat 00:31:40.373 17:07:26 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:40.373 17:07:26 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:40.373 17:07:26 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:40.373 17:07:26 -- common/autotest_common.sh@1330 -- # shift 00:31:40.373 17:07:26 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:40.373 17:07:26 -- nvmf/common.sh@542 -- # cat 00:31:40.373 17:07:26 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:40.373 17:07:26 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:40.373 17:07:26 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:40.373 17:07:26 -- target/dif.sh@72 -- # (( file <= files )) 00:31:40.373 17:07:26 -- target/dif.sh@73 -- # cat 00:31:40.373 17:07:26 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:40.373 17:07:26 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:40.373 17:07:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:40.373 17:07:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:40.373 { 00:31:40.373 "params": { 00:31:40.373 "name": "Nvme$subsystem", 00:31:40.373 "trtype": "$TEST_TRANSPORT", 00:31:40.373 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:40.373 "adrfam": "ipv4", 00:31:40.373 "trsvcid": "$NVMF_PORT", 00:31:40.373 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:40.373 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:40.373 "hdgst": ${hdgst:-false}, 00:31:40.373 "ddgst": ${ddgst:-false} 00:31:40.373 }, 00:31:40.373 "method": "bdev_nvme_attach_controller" 00:31:40.373 } 00:31:40.373 EOF 00:31:40.373 )") 00:31:40.373 17:07:26 -- nvmf/common.sh@542 -- # cat 00:31:40.373 17:07:26 -- target/dif.sh@72 -- # (( file++ )) 00:31:40.373 17:07:26 -- target/dif.sh@72 -- # (( file <= files )) 00:31:40.373 17:07:26 -- nvmf/common.sh@544 -- # jq . 00:31:40.373 17:07:26 -- nvmf/common.sh@545 -- # IFS=, 00:31:40.373 17:07:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:40.373 "params": { 00:31:40.373 "name": "Nvme0", 00:31:40.373 "trtype": "tcp", 00:31:40.373 "traddr": "10.0.0.2", 00:31:40.373 "adrfam": "ipv4", 00:31:40.373 "trsvcid": "4420", 00:31:40.373 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:40.373 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:40.373 "hdgst": false, 00:31:40.373 "ddgst": false 00:31:40.373 }, 00:31:40.373 "method": "bdev_nvme_attach_controller" 00:31:40.373 },{ 00:31:40.373 "params": { 00:31:40.373 "name": "Nvme1", 00:31:40.373 "trtype": "tcp", 00:31:40.373 "traddr": "10.0.0.2", 00:31:40.373 "adrfam": "ipv4", 00:31:40.373 "trsvcid": "4420", 00:31:40.373 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:40.373 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:40.373 "hdgst": false, 00:31:40.373 "ddgst": false 00:31:40.373 }, 00:31:40.373 "method": "bdev_nvme_attach_controller" 00:31:40.373 }' 00:31:40.373 17:07:26 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:40.373 17:07:26 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:40.373 17:07:26 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:40.373 17:07:26 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:40.373 17:07:26 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:40.373 17:07:26 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:40.632 17:07:26 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:40.632 17:07:26 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:40.632 17:07:26 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:40.632 17:07:26 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:40.632 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:40.632 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:40.632 fio-3.35 00:31:40.632 Starting 2 threads 00:31:40.632 EAL: No free 2048 kB hugepages reported on node 1 00:31:41.199 [2024-11-16 17:07:26.911209] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:41.199 [2024-11-16 17:07:26.911264] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:53.415 00:31:53.415 filename0: (groupid=0, jobs=1): err= 0: pid=1343046: Sat Nov 16 17:07:37 2024 00:31:53.415 read: IOPS=140, BW=564KiB/s (577kB/s)(5648KiB/10017msec) 00:31:53.415 slat (nsec): min=7659, max=64549, avg=10467.16, stdev=4900.52 00:31:53.415 clat (usec): min=531, max=48137, avg=28340.57, stdev=19126.63 00:31:53.415 lat (usec): min=539, max=48172, avg=28351.04, stdev=19126.79 00:31:53.415 clat percentiles (usec): 00:31:53.415 | 1.00th=[ 545], 5.00th=[ 578], 10.00th=[ 611], 20.00th=[ 725], 00:31:53.415 | 30.00th=[ 758], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:53.415 | 70.00th=[41157], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:31:53.415 | 99.00th=[42206], 99.50th=[42206], 99.90th=[47973], 99.95th=[47973], 00:31:53.415 | 99.99th=[47973] 00:31:53.415 bw ( KiB/s): min= 384, max= 768, per=58.94%, avg=563.20, stdev=169.77, samples=20 00:31:53.415 iops : min= 96, max= 192, avg=140.80, stdev=42.44, samples=20 00:31:53.415 lat (usec) : 750=28.33%, 1000=3.97% 00:31:53.415 lat (msec) : 50=67.71% 00:31:53.415 cpu : usr=95.53%, sys=4.19%, ctx=11, majf=0, minf=199 00:31:53.415 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:53.415 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.415 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.415 issued rwts: total=1412,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.415 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:53.415 filename1: (groupid=0, jobs=1): err= 0: pid=1343047: Sat Nov 16 17:07:37 2024 00:31:53.415 read: IOPS=97, BW=391KiB/s (401kB/s)(3920KiB/10013msec) 00:31:53.415 slat (nsec): min=4390, max=40931, avg=10168.52, stdev=3225.20 00:31:53.415 clat (usec): min=560, max=47153, avg=40833.65, stdev=2609.05 00:31:53.415 lat (usec): min=569, max=47182, avg=40843.82, stdev=2609.16 00:31:53.415 clat percentiles (usec): 00:31:53.415 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:53.415 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:53.415 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:53.415 | 99.00th=[41681], 99.50th=[41681], 99.90th=[46924], 99.95th=[46924], 00:31:53.415 | 99.99th=[46924] 00:31:53.415 bw ( KiB/s): min= 384, max= 416, per=40.83%, avg=390.40, stdev=13.13, samples=20 00:31:53.415 iops : min= 96, max= 104, avg=97.60, stdev= 3.28, samples=20 00:31:53.415 lat (usec) : 750=0.41% 00:31:53.415 lat (msec) : 50=99.59% 00:31:53.415 cpu : usr=95.55%, sys=4.11%, ctx=13, majf=0, minf=131 00:31:53.415 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:53.415 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.415 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.415 issued rwts: total=980,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.415 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:53.415 00:31:53.415 Run status group 0 (all jobs): 00:31:53.415 READ: bw=955KiB/s (978kB/s), 391KiB/s-564KiB/s (401kB/s-577kB/s), io=9568KiB (9798kB), run=10013-10017msec 00:31:53.415 17:07:37 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:53.415 17:07:37 -- target/dif.sh@43 -- # local sub 00:31:53.415 17:07:37 -- target/dif.sh@45 -- # for sub in "$@" 00:31:53.415 17:07:37 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:53.415 17:07:37 -- target/dif.sh@36 -- # local sub_id=0 00:31:53.415 17:07:37 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:53.415 17:07:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.415 17:07:37 -- common/autotest_common.sh@10 -- # set +x 00:31:53.415 17:07:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.415 17:07:37 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:53.415 17:07:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.415 17:07:37 -- common/autotest_common.sh@10 -- # set +x 00:31:53.415 17:07:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.415 17:07:37 -- target/dif.sh@45 -- # for sub in "$@" 00:31:53.415 17:07:37 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:53.415 17:07:37 -- target/dif.sh@36 -- # local sub_id=1 00:31:53.415 17:07:37 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:53.415 17:07:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.415 17:07:37 -- common/autotest_common.sh@10 -- # set +x 00:31:53.415 17:07:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.415 17:07:37 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:53.415 17:07:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.415 17:07:37 -- common/autotest_common.sh@10 -- # set +x 00:31:53.415 17:07:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.415 00:31:53.415 real 0m11.279s 00:31:53.415 user 0m20.319s 00:31:53.415 sys 0m1.175s 00:31:53.415 17:07:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:53.415 17:07:37 -- common/autotest_common.sh@10 -- # set +x 00:31:53.415 ************************************ 00:31:53.415 END TEST fio_dif_1_multi_subsystems 00:31:53.415 ************************************ 00:31:53.415 17:07:37 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:53.415 17:07:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:53.415 17:07:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:53.415 17:07:37 -- common/autotest_common.sh@10 -- # set +x 00:31:53.415 ************************************ 00:31:53.415 START TEST fio_dif_rand_params 00:31:53.415 ************************************ 00:31:53.415 17:07:37 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:31:53.415 17:07:37 -- target/dif.sh@100 -- # local NULL_DIF 00:31:53.415 17:07:37 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:53.415 17:07:37 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:53.415 17:07:37 -- target/dif.sh@103 -- # bs=128k 00:31:53.415 17:07:37 -- target/dif.sh@103 -- # numjobs=3 00:31:53.415 17:07:37 -- target/dif.sh@103 -- # iodepth=3 00:31:53.415 17:07:37 -- target/dif.sh@103 -- # runtime=5 00:31:53.415 17:07:37 -- target/dif.sh@105 -- # create_subsystems 0 00:31:53.415 17:07:37 -- target/dif.sh@28 -- # local sub 00:31:53.415 17:07:37 -- target/dif.sh@30 -- # for sub in "$@" 00:31:53.415 17:07:37 -- target/dif.sh@31 -- # create_subsystem 0 00:31:53.415 17:07:37 -- target/dif.sh@18 -- # local sub_id=0 00:31:53.415 17:07:37 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:53.415 17:07:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.415 17:07:37 -- common/autotest_common.sh@10 -- # set +x 00:31:53.415 bdev_null0 00:31:53.415 17:07:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.415 17:07:37 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:53.415 17:07:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.415 17:07:37 -- common/autotest_common.sh@10 -- # set +x 00:31:53.415 17:07:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.415 17:07:37 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:53.415 17:07:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.415 17:07:37 -- common/autotest_common.sh@10 -- # set +x 00:31:53.415 17:07:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.415 17:07:37 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:53.415 17:07:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.415 17:07:37 -- common/autotest_common.sh@10 -- # set +x 00:31:53.415 [2024-11-16 17:07:37.354709] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:53.415 17:07:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.415 17:07:37 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:53.415 17:07:37 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:53.415 17:07:37 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:53.415 17:07:37 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:53.415 17:07:37 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:53.415 17:07:37 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:53.415 17:07:37 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:53.415 17:07:37 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:53.415 17:07:37 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:53.415 17:07:37 -- target/dif.sh@82 -- # gen_fio_conf 00:31:53.415 17:07:37 -- nvmf/common.sh@520 -- # config=() 00:31:53.415 17:07:37 -- common/autotest_common.sh@1330 -- # shift 00:31:53.415 17:07:37 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:53.415 17:07:37 -- target/dif.sh@54 -- # local file 00:31:53.415 17:07:37 -- nvmf/common.sh@520 -- # local subsystem config 00:31:53.415 17:07:37 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:53.415 17:07:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:53.415 17:07:37 -- target/dif.sh@56 -- # cat 00:31:53.415 17:07:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:53.415 { 00:31:53.415 "params": { 00:31:53.415 "name": "Nvme$subsystem", 00:31:53.415 "trtype": "$TEST_TRANSPORT", 00:31:53.415 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:53.415 "adrfam": "ipv4", 00:31:53.415 "trsvcid": "$NVMF_PORT", 00:31:53.415 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:53.415 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:53.415 "hdgst": ${hdgst:-false}, 00:31:53.415 "ddgst": ${ddgst:-false} 00:31:53.415 }, 00:31:53.415 "method": "bdev_nvme_attach_controller" 00:31:53.415 } 00:31:53.415 EOF 00:31:53.415 )") 00:31:53.415 17:07:37 -- nvmf/common.sh@542 -- # cat 00:31:53.415 17:07:37 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:53.415 17:07:37 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:53.415 17:07:37 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:53.415 17:07:37 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:53.415 17:07:37 -- target/dif.sh@72 -- # (( file <= files )) 00:31:53.415 17:07:37 -- nvmf/common.sh@544 -- # jq . 00:31:53.415 17:07:37 -- nvmf/common.sh@545 -- # IFS=, 00:31:53.415 17:07:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:53.415 "params": { 00:31:53.415 "name": "Nvme0", 00:31:53.415 "trtype": "tcp", 00:31:53.415 "traddr": "10.0.0.2", 00:31:53.415 "adrfam": "ipv4", 00:31:53.415 "trsvcid": "4420", 00:31:53.415 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:53.415 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:53.416 "hdgst": false, 00:31:53.416 "ddgst": false 00:31:53.416 }, 00:31:53.416 "method": "bdev_nvme_attach_controller" 00:31:53.416 }' 00:31:53.416 17:07:37 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:53.416 17:07:37 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:53.416 17:07:37 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:53.416 17:07:37 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:53.416 17:07:37 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:53.416 17:07:37 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:53.416 17:07:37 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:53.416 17:07:37 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:53.416 17:07:37 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:53.416 17:07:37 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:53.416 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:53.416 ... 00:31:53.416 fio-3.35 00:31:53.416 Starting 3 threads 00:31:53.416 EAL: No free 2048 kB hugepages reported on node 1 00:31:53.416 [2024-11-16 17:07:38.049373] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:53.416 [2024-11-16 17:07:38.049441] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:57.612 00:31:57.612 filename0: (groupid=0, jobs=1): err= 0: pid=1344498: Sat Nov 16 17:07:43 2024 00:31:57.612 read: IOPS=221, BW=27.7MiB/s (29.1MB/s)(140MiB/5044msec) 00:31:57.612 slat (usec): min=4, max=104, avg=14.78, stdev= 4.34 00:31:57.612 clat (usec): min=4091, max=53051, avg=13464.75, stdev=4515.73 00:31:57.612 lat (usec): min=4104, max=53068, avg=13479.52, stdev=4516.61 00:31:57.612 clat percentiles (usec): 00:31:57.612 | 1.00th=[ 4948], 5.00th=[ 7439], 10.00th=[ 8979], 20.00th=[11076], 00:31:57.612 | 30.00th=[12649], 40.00th=[13304], 50.00th=[13960], 60.00th=[14353], 00:31:57.612 | 70.00th=[14615], 80.00th=[15139], 90.00th=[15795], 95.00th=[16450], 00:31:57.612 | 99.00th=[20055], 99.50th=[50594], 99.90th=[53216], 99.95th=[53216], 00:31:57.612 | 99.99th=[53216] 00:31:57.612 bw ( KiB/s): min=26368, max=33536, per=31.36%, avg=28595.20, stdev=2383.38, samples=10 00:31:57.612 iops : min= 206, max= 262, avg=223.40, stdev=18.62, samples=10 00:31:57.612 lat (msec) : 10=14.30%, 20=84.63%, 50=0.45%, 100=0.63% 00:31:57.612 cpu : usr=86.60%, sys=8.94%, ctx=280, majf=0, minf=144 00:31:57.612 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:57.612 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:57.612 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:57.612 issued rwts: total=1119,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:57.612 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:57.612 filename0: (groupid=0, jobs=1): err= 0: pid=1344499: Sat Nov 16 17:07:43 2024 00:31:57.612 read: IOPS=253, BW=31.7MiB/s (33.3MB/s)(159MiB/5005msec) 00:31:57.612 slat (nsec): min=4812, max=36014, avg=14313.03, stdev=2624.75 00:31:57.612 clat (usec): min=4402, max=90474, avg=11803.45, stdev=7120.97 00:31:57.612 lat (usec): min=4410, max=90488, avg=11817.76, stdev=7120.78 00:31:57.612 clat percentiles (usec): 00:31:57.612 | 1.00th=[ 7767], 5.00th=[ 8848], 10.00th=[ 9241], 20.00th=[ 9634], 00:31:57.612 | 30.00th=[ 9896], 40.00th=[10290], 50.00th=[10552], 60.00th=[10945], 00:31:57.612 | 70.00th=[11207], 80.00th=[11731], 90.00th=[12780], 95.00th=[13698], 00:31:57.612 | 99.00th=[52167], 99.50th=[53740], 99.90th=[56361], 99.95th=[90702], 00:31:57.612 | 99.99th=[90702] 00:31:57.612 bw ( KiB/s): min=15903, max=37888, per=35.57%, avg=32438.30, stdev=6752.90, samples=10 00:31:57.612 iops : min= 124, max= 296, avg=253.40, stdev=52.82, samples=10 00:31:57.612 lat (msec) : 10=33.46%, 20=63.78%, 50=0.39%, 100=2.36% 00:31:57.612 cpu : usr=94.20%, sys=5.24%, ctx=15, majf=0, minf=90 00:31:57.612 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:57.613 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:57.613 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:57.613 issued rwts: total=1270,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:57.613 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:57.613 filename0: (groupid=0, jobs=1): err= 0: pid=1344500: Sat Nov 16 17:07:43 2024 00:31:57.613 read: IOPS=239, BW=29.9MiB/s (31.3MB/s)(151MiB/5046msec) 00:31:57.613 slat (nsec): min=4221, max=24479, avg=13837.27, stdev=1338.65 00:31:57.613 clat (usec): min=5777, max=52918, avg=12499.57, stdev=4479.28 00:31:57.613 lat (usec): min=5790, max=52931, avg=12513.41, stdev=4479.17 00:31:57.613 clat percentiles (usec): 00:31:57.613 | 1.00th=[ 6587], 5.00th=[ 7963], 10.00th=[ 9241], 20.00th=[10552], 00:31:57.613 | 30.00th=[10945], 40.00th=[11338], 50.00th=[12125], 60.00th=[12911], 00:31:57.613 | 70.00th=[13698], 80.00th=[14222], 90.00th=[14746], 95.00th=[15270], 00:31:57.613 | 99.00th=[46924], 99.50th=[47973], 99.90th=[51119], 99.95th=[52691], 00:31:57.613 | 99.99th=[52691] 00:31:57.613 bw ( KiB/s): min=27904, max=35072, per=33.77%, avg=30796.80, stdev=2619.19, samples=10 00:31:57.613 iops : min= 218, max= 274, avg=240.60, stdev=20.46, samples=10 00:31:57.613 lat (msec) : 10=13.85%, 20=84.99%, 50=0.83%, 100=0.33% 00:31:57.613 cpu : usr=93.91%, sys=5.59%, ctx=7, majf=0, minf=85 00:31:57.613 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:57.613 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:57.613 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:57.613 issued rwts: total=1206,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:57.613 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:57.613 00:31:57.613 Run status group 0 (all jobs): 00:31:57.613 READ: bw=89.1MiB/s (93.4MB/s), 27.7MiB/s-31.7MiB/s (29.1MB/s-33.3MB/s), io=449MiB (471MB), run=5005-5046msec 00:31:57.928 17:07:43 -- target/dif.sh@107 -- # destroy_subsystems 0 00:31:57.928 17:07:43 -- target/dif.sh@43 -- # local sub 00:31:57.928 17:07:43 -- target/dif.sh@45 -- # for sub in "$@" 00:31:57.928 17:07:43 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:57.928 17:07:43 -- target/dif.sh@36 -- # local sub_id=0 00:31:57.928 17:07:43 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:57.928 17:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.928 17:07:43 -- common/autotest_common.sh@10 -- # set +x 00:31:57.928 17:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.928 17:07:43 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:57.928 17:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.928 17:07:43 -- common/autotest_common.sh@10 -- # set +x 00:31:57.928 17:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.928 17:07:43 -- target/dif.sh@109 -- # NULL_DIF=2 00:31:57.928 17:07:43 -- target/dif.sh@109 -- # bs=4k 00:31:57.928 17:07:43 -- target/dif.sh@109 -- # numjobs=8 00:31:57.928 17:07:43 -- target/dif.sh@109 -- # iodepth=16 00:31:57.928 17:07:43 -- target/dif.sh@109 -- # runtime= 00:31:57.928 17:07:43 -- target/dif.sh@109 -- # files=2 00:31:57.928 17:07:43 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:31:57.928 17:07:43 -- target/dif.sh@28 -- # local sub 00:31:57.928 17:07:43 -- target/dif.sh@30 -- # for sub in "$@" 00:31:57.928 17:07:43 -- target/dif.sh@31 -- # create_subsystem 0 00:31:57.928 17:07:43 -- target/dif.sh@18 -- # local sub_id=0 00:31:57.928 17:07:43 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:31:57.928 17:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.928 17:07:43 -- common/autotest_common.sh@10 -- # set +x 00:31:57.928 bdev_null0 00:31:57.928 17:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.928 17:07:43 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:57.928 17:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.928 17:07:43 -- common/autotest_common.sh@10 -- # set +x 00:31:57.929 17:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.929 17:07:43 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:57.929 17:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.929 17:07:43 -- common/autotest_common.sh@10 -- # set +x 00:31:57.929 17:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.929 17:07:43 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:57.929 17:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.929 17:07:43 -- common/autotest_common.sh@10 -- # set +x 00:31:57.929 [2024-11-16 17:07:43.509627] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:57.929 17:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.929 17:07:43 -- target/dif.sh@30 -- # for sub in "$@" 00:31:57.929 17:07:43 -- target/dif.sh@31 -- # create_subsystem 1 00:31:57.929 17:07:43 -- target/dif.sh@18 -- # local sub_id=1 00:31:57.929 17:07:43 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:31:57.929 17:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.929 17:07:43 -- common/autotest_common.sh@10 -- # set +x 00:31:57.929 bdev_null1 00:31:57.929 17:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.929 17:07:43 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:57.929 17:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.929 17:07:43 -- common/autotest_common.sh@10 -- # set +x 00:31:57.929 17:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.929 17:07:43 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:57.929 17:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.929 17:07:43 -- common/autotest_common.sh@10 -- # set +x 00:31:57.929 17:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.929 17:07:43 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:57.929 17:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.929 17:07:43 -- common/autotest_common.sh@10 -- # set +x 00:31:57.929 17:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.929 17:07:43 -- target/dif.sh@30 -- # for sub in "$@" 00:31:57.929 17:07:43 -- target/dif.sh@31 -- # create_subsystem 2 00:31:57.929 17:07:43 -- target/dif.sh@18 -- # local sub_id=2 00:31:57.929 17:07:43 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:31:57.929 17:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.929 17:07:43 -- common/autotest_common.sh@10 -- # set +x 00:31:57.929 bdev_null2 00:31:57.929 17:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.929 17:07:43 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:31:57.929 17:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.929 17:07:43 -- common/autotest_common.sh@10 -- # set +x 00:31:57.929 17:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.929 17:07:43 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:31:57.929 17:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.929 17:07:43 -- common/autotest_common.sh@10 -- # set +x 00:31:57.929 17:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.929 17:07:43 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:31:57.929 17:07:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.929 17:07:43 -- common/autotest_common.sh@10 -- # set +x 00:31:57.929 17:07:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.929 17:07:43 -- target/dif.sh@112 -- # fio /dev/fd/62 00:31:57.929 17:07:43 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:31:57.929 17:07:43 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:31:57.929 17:07:43 -- nvmf/common.sh@520 -- # config=() 00:31:57.929 17:07:43 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:57.929 17:07:43 -- nvmf/common.sh@520 -- # local subsystem config 00:31:57.929 17:07:43 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:57.929 17:07:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:57.929 17:07:43 -- target/dif.sh@82 -- # gen_fio_conf 00:31:57.929 17:07:43 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:57.929 17:07:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:57.929 { 00:31:57.929 "params": { 00:31:57.929 "name": "Nvme$subsystem", 00:31:57.929 "trtype": "$TEST_TRANSPORT", 00:31:57.929 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:57.929 "adrfam": "ipv4", 00:31:57.929 "trsvcid": "$NVMF_PORT", 00:31:57.929 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:57.929 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:57.929 "hdgst": ${hdgst:-false}, 00:31:57.929 "ddgst": ${ddgst:-false} 00:31:57.929 }, 00:31:57.929 "method": "bdev_nvme_attach_controller" 00:31:57.929 } 00:31:57.929 EOF 00:31:57.929 )") 00:31:57.929 17:07:43 -- target/dif.sh@54 -- # local file 00:31:57.929 17:07:43 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:57.929 17:07:43 -- target/dif.sh@56 -- # cat 00:31:57.929 17:07:43 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:57.929 17:07:43 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:57.929 17:07:43 -- common/autotest_common.sh@1330 -- # shift 00:31:57.929 17:07:43 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:57.929 17:07:43 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:57.929 17:07:43 -- nvmf/common.sh@542 -- # cat 00:31:57.929 17:07:43 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:57.929 17:07:43 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:57.929 17:07:43 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:57.929 17:07:43 -- target/dif.sh@72 -- # (( file <= files )) 00:31:57.929 17:07:43 -- target/dif.sh@73 -- # cat 00:31:57.929 17:07:43 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:57.929 17:07:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:57.929 17:07:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:57.929 { 00:31:57.929 "params": { 00:31:57.929 "name": "Nvme$subsystem", 00:31:57.929 "trtype": "$TEST_TRANSPORT", 00:31:57.929 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:57.929 "adrfam": "ipv4", 00:31:57.929 "trsvcid": "$NVMF_PORT", 00:31:57.929 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:57.929 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:57.929 "hdgst": ${hdgst:-false}, 00:31:57.929 "ddgst": ${ddgst:-false} 00:31:57.929 }, 00:31:57.929 "method": "bdev_nvme_attach_controller" 00:31:57.929 } 00:31:57.929 EOF 00:31:57.929 )") 00:31:57.929 17:07:43 -- target/dif.sh@72 -- # (( file++ )) 00:31:57.929 17:07:43 -- target/dif.sh@72 -- # (( file <= files )) 00:31:57.929 17:07:43 -- target/dif.sh@73 -- # cat 00:31:57.929 17:07:43 -- nvmf/common.sh@542 -- # cat 00:31:57.929 17:07:43 -- target/dif.sh@72 -- # (( file++ )) 00:31:57.929 17:07:43 -- target/dif.sh@72 -- # (( file <= files )) 00:31:57.929 17:07:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:57.929 17:07:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:57.929 { 00:31:57.929 "params": { 00:31:57.929 "name": "Nvme$subsystem", 00:31:57.929 "trtype": "$TEST_TRANSPORT", 00:31:57.929 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:57.929 "adrfam": "ipv4", 00:31:57.929 "trsvcid": "$NVMF_PORT", 00:31:57.929 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:57.929 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:57.929 "hdgst": ${hdgst:-false}, 00:31:57.929 "ddgst": ${ddgst:-false} 00:31:57.929 }, 00:31:57.929 "method": "bdev_nvme_attach_controller" 00:31:57.929 } 00:31:57.929 EOF 00:31:57.929 )") 00:31:57.929 17:07:43 -- nvmf/common.sh@542 -- # cat 00:31:57.929 17:07:43 -- nvmf/common.sh@544 -- # jq . 00:31:57.929 17:07:43 -- nvmf/common.sh@545 -- # IFS=, 00:31:57.929 17:07:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:57.929 "params": { 00:31:57.929 "name": "Nvme0", 00:31:57.929 "trtype": "tcp", 00:31:57.929 "traddr": "10.0.0.2", 00:31:57.929 "adrfam": "ipv4", 00:31:57.929 "trsvcid": "4420", 00:31:57.929 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:57.929 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:57.929 "hdgst": false, 00:31:57.929 "ddgst": false 00:31:57.929 }, 00:31:57.929 "method": "bdev_nvme_attach_controller" 00:31:57.929 },{ 00:31:57.929 "params": { 00:31:57.929 "name": "Nvme1", 00:31:57.929 "trtype": "tcp", 00:31:57.929 "traddr": "10.0.0.2", 00:31:57.929 "adrfam": "ipv4", 00:31:57.929 "trsvcid": "4420", 00:31:57.929 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:57.929 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:57.929 "hdgst": false, 00:31:57.929 "ddgst": false 00:31:57.929 }, 00:31:57.929 "method": "bdev_nvme_attach_controller" 00:31:57.929 },{ 00:31:57.929 "params": { 00:31:57.929 "name": "Nvme2", 00:31:57.929 "trtype": "tcp", 00:31:57.929 "traddr": "10.0.0.2", 00:31:57.929 "adrfam": "ipv4", 00:31:57.929 "trsvcid": "4420", 00:31:57.929 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:31:57.929 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:31:57.929 "hdgst": false, 00:31:57.929 "ddgst": false 00:31:57.929 }, 00:31:57.929 "method": "bdev_nvme_attach_controller" 00:31:57.929 }' 00:31:57.929 17:07:43 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:57.929 17:07:43 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:57.929 17:07:43 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:57.929 17:07:43 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:57.929 17:07:43 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:57.929 17:07:43 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:57.929 17:07:43 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:57.930 17:07:43 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:57.930 17:07:43 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:57.930 17:07:43 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:58.213 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:58.213 ... 00:31:58.213 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:58.213 ... 00:31:58.213 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:58.213 ... 00:31:58.213 fio-3.35 00:31:58.213 Starting 24 threads 00:31:58.213 EAL: No free 2048 kB hugepages reported on node 1 00:31:59.150 [2024-11-16 17:07:44.589892] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:59.150 [2024-11-16 17:07:44.589979] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:11.357 00:32:11.357 filename0: (groupid=0, jobs=1): err= 0: pid=1345286: Sat Nov 16 17:07:54 2024 00:32:11.357 read: IOPS=245, BW=980KiB/s (1004kB/s)(9920KiB/10118msec) 00:32:11.357 slat (usec): min=8, max=144, avg=50.88, stdev=19.64 00:32:11.357 clat (msec): min=30, max=568, avg=64.77, stdev=102.24 00:32:11.357 lat (msec): min=30, max=568, avg=64.82, stdev=102.24 00:32:11.357 clat percentiles (msec): 00:32:11.357 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:11.357 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.357 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 53], 95.00th=[ 363], 00:32:11.357 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 460], 99.95th=[ 567], 00:32:11.357 | 99.99th=[ 567] 00:32:11.357 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=985.75, stdev=936.02, samples=20 00:32:11.357 iops : min= 32, max= 512, avg=246.40, stdev=233.97, samples=20 00:32:11.357 lat (msec) : 50=89.68%, 100=0.65%, 250=0.08%, 500=9.52%, 750=0.08% 00:32:11.357 cpu : usr=98.43%, sys=0.93%, ctx=53, majf=0, minf=28 00:32:11.357 IO depths : 1=6.0%, 2=12.2%, 4=24.9%, 8=50.4%, 16=6.5%, 32=0.0%, >=64=0.0% 00:32:11.357 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.357 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.357 issued rwts: total=2480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.357 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.357 filename0: (groupid=0, jobs=1): err= 0: pid=1345287: Sat Nov 16 17:07:54 2024 00:32:11.357 read: IOPS=245, BW=981KiB/s (1004kB/s)(9920KiB/10116msec) 00:32:11.357 slat (nsec): min=8173, max=98368, avg=40951.54, stdev=17958.22 00:32:11.357 clat (msec): min=20, max=580, avg=64.90, stdev=102.65 00:32:11.357 lat (msec): min=20, max=580, avg=64.94, stdev=102.65 00:32:11.357 clat percentiles (msec): 00:32:11.357 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:11.357 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.357 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 50], 95.00th=[ 363], 00:32:11.357 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 575], 99.95th=[ 584], 00:32:11.357 | 99.99th=[ 584] 00:32:11.357 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=985.60, stdev=935.08, samples=20 00:32:11.357 iops : min= 32, max= 512, avg=246.40, stdev=233.77, samples=20 00:32:11.357 lat (msec) : 50=90.32%, 250=0.16%, 500=9.35%, 750=0.16% 00:32:11.357 cpu : usr=98.85%, sys=0.75%, ctx=11, majf=0, minf=17 00:32:11.357 IO depths : 1=5.6%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.9%, 32=0.0%, >=64=0.0% 00:32:11.357 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.357 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.357 issued rwts: total=2480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.357 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.357 filename0: (groupid=0, jobs=1): err= 0: pid=1345288: Sat Nov 16 17:07:54 2024 00:32:11.357 read: IOPS=246, BW=986KiB/s (1010kB/s)(9984KiB/10125msec) 00:32:11.357 slat (usec): min=8, max=154, avg=62.42, stdev=29.89 00:32:11.357 clat (msec): min=29, max=419, avg=64.37, stdev=101.67 00:32:11.357 lat (msec): min=29, max=419, avg=64.44, stdev=101.66 00:32:11.357 clat percentiles (msec): 00:32:11.357 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.357 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.357 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 35], 95.00th=[ 363], 00:32:11.357 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], 00:32:11.357 | 99.99th=[ 418] 00:32:11.357 bw ( KiB/s): min= 128, max= 2048, per=4.16%, avg=992.00, stdev=942.32, samples=20 00:32:11.357 iops : min= 32, max= 512, avg=248.00, stdev=235.58, samples=20 00:32:11.357 lat (msec) : 50=90.38%, 500=9.62% 00:32:11.357 cpu : usr=98.78%, sys=0.79%, ctx=36, majf=0, minf=15 00:32:11.357 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:11.357 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.357 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.357 issued rwts: total=2496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.357 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.357 filename0: (groupid=0, jobs=1): err= 0: pid=1345289: Sat Nov 16 17:07:54 2024 00:32:11.357 read: IOPS=257, BW=1028KiB/s (1053kB/s)(10.2MiB/10147msec) 00:32:11.357 slat (usec): min=6, max=190, avg=35.12, stdev=39.04 00:32:11.357 clat (msec): min=29, max=355, avg=61.89, stdev=81.78 00:32:11.357 lat (msec): min=29, max=355, avg=61.93, stdev=81.77 00:32:11.357 clat percentiles (msec): 00:32:11.357 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:11.357 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.357 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 178], 95.00th=[ 309], 00:32:11.357 | 99.00th=[ 334], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], 00:32:11.357 | 99.99th=[ 355] 00:32:11.357 bw ( KiB/s): min= 128, max= 2048, per=4.35%, avg=1036.80, stdev=888.66, samples=20 00:32:11.357 iops : min= 32, max= 512, avg=259.20, stdev=222.16, samples=20 00:32:11.357 lat (msec) : 50=86.50%, 250=4.29%, 500=9.20% 00:32:11.357 cpu : usr=98.26%, sys=1.17%, ctx=53, majf=0, minf=25 00:32:11.357 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:11.357 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.357 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.357 issued rwts: total=2608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.357 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.357 filename0: (groupid=0, jobs=1): err= 0: pid=1345290: Sat Nov 16 17:07:54 2024 00:32:11.357 read: IOPS=246, BW=985KiB/s (1009kB/s)(9984KiB/10131msec) 00:32:11.357 slat (usec): min=7, max=168, avg=67.13, stdev=37.84 00:32:11.357 clat (msec): min=27, max=459, avg=64.30, stdev=100.09 00:32:11.357 lat (msec): min=27, max=459, avg=64.37, stdev=100.08 00:32:11.357 clat percentiles (msec): 00:32:11.357 | 1.00th=[ 29], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.357 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.357 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 113], 95.00th=[ 359], 00:32:11.357 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 460], 00:32:11.357 | 99.99th=[ 460] 00:32:11.357 bw ( KiB/s): min= 128, max= 2048, per=4.16%, avg=992.00, stdev=929.42, samples=20 00:32:11.357 iops : min= 32, max= 512, avg=248.00, stdev=232.36, samples=20 00:32:11.357 lat (msec) : 50=89.74%, 250=0.64%, 500=9.62% 00:32:11.357 cpu : usr=98.47%, sys=0.91%, ctx=30, majf=0, minf=23 00:32:11.357 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:11.357 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.357 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.357 issued rwts: total=2496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.357 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.357 filename0: (groupid=0, jobs=1): err= 0: pid=1345291: Sat Nov 16 17:07:54 2024 00:32:11.357 read: IOPS=245, BW=980KiB/s (1004kB/s)(9920KiB/10119msec) 00:32:11.357 slat (usec): min=10, max=160, avg=53.54, stdev=23.69 00:32:11.357 clat (msec): min=26, max=589, avg=64.77, stdev=102.32 00:32:11.357 lat (msec): min=26, max=589, avg=64.83, stdev=102.32 00:32:11.357 clat percentiles (msec): 00:32:11.357 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:11.357 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.357 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 51], 95.00th=[ 363], 00:32:11.357 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 592], 00:32:11.357 | 99.99th=[ 592] 00:32:11.357 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=985.60, stdev=936.10, samples=20 00:32:11.357 iops : min= 32, max= 512, avg=246.40, stdev=234.03, samples=20 00:32:11.357 lat (msec) : 50=89.68%, 100=0.65%, 250=0.08%, 500=9.52%, 750=0.08% 00:32:11.357 cpu : usr=98.50%, sys=1.02%, ctx=22, majf=0, minf=27 00:32:11.357 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:32:11.357 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.357 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.357 issued rwts: total=2480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.357 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.357 filename0: (groupid=0, jobs=1): err= 0: pid=1345292: Sat Nov 16 17:07:54 2024 00:32:11.357 read: IOPS=245, BW=981KiB/s (1004kB/s)(9920KiB/10116msec) 00:32:11.357 slat (usec): min=8, max=123, avg=41.82, stdev=13.50 00:32:11.357 clat (msec): min=30, max=460, avg=64.88, stdev=102.05 00:32:11.358 lat (msec): min=30, max=460, avg=64.92, stdev=102.05 00:32:11.358 clat percentiles (msec): 00:32:11.358 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:11.358 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.358 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 50], 95.00th=[ 363], 00:32:11.358 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 460], 00:32:11.358 | 99.99th=[ 460] 00:32:11.358 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=985.75, stdev=935.34, samples=20 00:32:11.358 iops : min= 32, max= 512, avg=246.40, stdev=233.79, samples=20 00:32:11.358 lat (msec) : 50=90.32%, 500=9.68% 00:32:11.358 cpu : usr=97.50%, sys=1.38%, ctx=123, majf=0, minf=23 00:32:11.358 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:11.358 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.358 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.358 issued rwts: total=2480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.358 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.358 filename0: (groupid=0, jobs=1): err= 0: pid=1345293: Sat Nov 16 17:07:54 2024 00:32:11.358 read: IOPS=257, BW=1029KiB/s (1053kB/s)(10.2MiB/10142msec) 00:32:11.358 slat (usec): min=4, max=189, avg=34.14, stdev=26.63 00:32:11.358 clat (msec): min=12, max=418, avg=61.93, stdev=84.62 00:32:11.358 lat (msec): min=12, max=418, avg=61.96, stdev=84.62 00:32:11.358 clat percentiles (msec): 00:32:11.358 | 1.00th=[ 29], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:11.358 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.358 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 178], 95.00th=[ 309], 00:32:11.358 | 99.00th=[ 355], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], 00:32:11.358 | 99.99th=[ 418] 00:32:11.358 bw ( KiB/s): min= 128, max= 2048, per=4.35%, avg=1036.80, stdev=900.12, samples=20 00:32:11.358 iops : min= 32, max= 512, avg=259.20, stdev=225.03, samples=20 00:32:11.358 lat (msec) : 20=0.08%, 50=87.04%, 250=3.68%, 500=9.20% 00:32:11.358 cpu : usr=97.85%, sys=1.45%, ctx=87, majf=0, minf=52 00:32:11.358 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:32:11.358 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.358 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.358 issued rwts: total=2608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.358 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.358 filename1: (groupid=0, jobs=1): err= 0: pid=1345294: Sat Nov 16 17:07:54 2024 00:32:11.358 read: IOPS=246, BW=988KiB/s (1011kB/s)(9992KiB/10117msec) 00:32:11.358 slat (usec): min=8, max=126, avg=43.85, stdev=20.08 00:32:11.358 clat (msec): min=19, max=579, avg=64.46, stdev=101.86 00:32:11.358 lat (msec): min=19, max=579, avg=64.51, stdev=101.86 00:32:11.358 clat percentiles (msec): 00:32:11.358 | 1.00th=[ 20], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:11.358 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.358 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 51], 95.00th=[ 363], 00:32:11.358 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 468], 99.95th=[ 584], 00:32:11.358 | 99.99th=[ 584] 00:32:11.358 bw ( KiB/s): min= 128, max= 2176, per=4.17%, avg=992.80, stdev=942.19, samples=20 00:32:11.358 iops : min= 32, max= 544, avg=248.20, stdev=235.55, samples=20 00:32:11.358 lat (msec) : 20=1.44%, 50=88.23%, 100=0.64%, 250=0.24%, 500=9.37% 00:32:11.358 lat (msec) : 750=0.08% 00:32:11.358 cpu : usr=98.30%, sys=1.03%, ctx=113, majf=0, minf=35 00:32:11.358 IO depths : 1=0.1%, 2=6.0%, 4=24.0%, 8=57.4%, 16=12.4%, 32=0.0%, >=64=0.0% 00:32:11.358 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.358 complete : 0=0.0%, 4=94.1%, 8=0.4%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.358 issued rwts: total=2498,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.358 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.358 filename1: (groupid=0, jobs=1): err= 0: pid=1345295: Sat Nov 16 17:07:54 2024 00:32:11.358 read: IOPS=261, BW=1045KiB/s (1070kB/s)(10.4MiB/10154msec) 00:32:11.358 slat (usec): min=4, max=151, avg=47.08, stdev=29.90 00:32:11.358 clat (msec): min=3, max=405, avg=60.67, stdev=80.51 00:32:11.358 lat (msec): min=3, max=405, avg=60.72, stdev=80.50 00:32:11.358 clat percentiles (msec): 00:32:11.358 | 1.00th=[ 4], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.358 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.358 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 218], 95.00th=[ 296], 00:32:11.358 | 99.00th=[ 334], 99.50th=[ 347], 99.90th=[ 405], 99.95th=[ 405], 00:32:11.358 | 99.99th=[ 405] 00:32:11.358 bw ( KiB/s): min= 144, max= 2176, per=4.43%, avg=1054.40, stdev=911.37, samples=20 00:32:11.358 iops : min= 36, max= 544, avg=263.60, stdev=227.84, samples=20 00:32:11.358 lat (msec) : 4=1.21%, 20=0.60%, 50=85.07%, 250=5.35%, 500=7.77% 00:32:11.358 cpu : usr=98.77%, sys=0.81%, ctx=18, majf=0, minf=24 00:32:11.358 IO depths : 1=5.3%, 2=11.0%, 4=23.2%, 8=53.3%, 16=7.2%, 32=0.0%, >=64=0.0% 00:32:11.358 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.358 complete : 0=0.0%, 4=93.6%, 8=0.7%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.358 issued rwts: total=2652,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.358 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.358 filename1: (groupid=0, jobs=1): err= 0: pid=1345297: Sat Nov 16 17:07:54 2024 00:32:11.358 read: IOPS=244, BW=979KiB/s (1003kB/s)(9920KiB/10131msec) 00:32:11.358 slat (usec): min=10, max=134, avg=55.08, stdev=22.71 00:32:11.358 clat (msec): min=29, max=553, avg=64.84, stdev=102.21 00:32:11.358 lat (msec): min=29, max=553, avg=64.89, stdev=102.21 00:32:11.358 clat percentiles (msec): 00:32:11.358 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:11.358 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.358 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 63], 95.00th=[ 363], 00:32:11.358 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 460], 99.95th=[ 558], 00:32:11.358 | 99.99th=[ 558] 00:32:11.358 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=985.60, stdev=935.89, samples=20 00:32:11.358 iops : min= 32, max= 512, avg=246.40, stdev=233.97, samples=20 00:32:11.358 lat (msec) : 50=89.68%, 100=0.65%, 250=0.08%, 500=9.52%, 750=0.08% 00:32:11.358 cpu : usr=98.30%, sys=1.04%, ctx=88, majf=0, minf=22 00:32:11.358 IO depths : 1=5.5%, 2=11.7%, 4=24.9%, 8=50.9%, 16=7.0%, 32=0.0%, >=64=0.0% 00:32:11.358 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.358 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.358 issued rwts: total=2480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.358 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.358 filename1: (groupid=0, jobs=1): err= 0: pid=1345298: Sat Nov 16 17:07:54 2024 00:32:11.358 read: IOPS=256, BW=1026KiB/s (1050kB/s)(10.2MiB/10141msec) 00:32:11.358 slat (usec): min=8, max=157, avg=56.91, stdev=36.21 00:32:11.358 clat (msec): min=18, max=436, avg=61.77, stdev=80.45 00:32:11.358 lat (msec): min=18, max=436, avg=61.82, stdev=80.45 00:32:11.358 clat percentiles (msec): 00:32:11.358 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:11.358 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.358 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 218], 95.00th=[ 288], 00:32:11.358 | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 435], 99.95th=[ 439], 00:32:11.358 | 99.99th=[ 439] 00:32:11.358 bw ( KiB/s): min= 176, max= 2048, per=4.34%, avg=1033.60, stdev=895.03, samples=20 00:32:11.358 iops : min= 44, max= 512, avg=258.40, stdev=223.76, samples=20 00:32:11.358 lat (msec) : 20=0.46%, 50=86.19%, 100=0.35%, 250=6.31%, 500=6.69% 00:32:11.358 cpu : usr=98.65%, sys=0.88%, ctx=26, majf=0, minf=25 00:32:11.358 IO depths : 1=0.8%, 2=6.1%, 4=21.9%, 8=59.4%, 16=11.8%, 32=0.0%, >=64=0.0% 00:32:11.358 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.358 complete : 0=0.0%, 4=93.5%, 8=1.0%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.358 issued rwts: total=2600,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.358 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.358 filename1: (groupid=0, jobs=1): err= 0: pid=1345299: Sat Nov 16 17:07:54 2024 00:32:11.358 read: IOPS=246, BW=986KiB/s (1010kB/s)(9984KiB/10125msec) 00:32:11.358 slat (usec): min=9, max=143, avg=61.06, stdev=29.78 00:32:11.358 clat (msec): min=19, max=524, avg=64.39, stdev=101.88 00:32:11.358 lat (msec): min=19, max=524, avg=64.45, stdev=101.87 00:32:11.358 clat percentiles (msec): 00:32:11.358 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.358 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.358 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 35], 95.00th=[ 363], 00:32:11.358 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 460], 99.95th=[ 523], 00:32:11.358 | 99.99th=[ 527] 00:32:11.358 bw ( KiB/s): min= 128, max= 2048, per=4.16%, avg=992.00, stdev=942.00, samples=20 00:32:11.358 iops : min= 32, max= 512, avg=247.90, stdev=235.39, samples=20 00:32:11.358 lat (msec) : 20=0.08%, 50=90.22%, 100=0.08%, 500=9.54%, 750=0.08% 00:32:11.358 cpu : usr=99.00%, sys=0.59%, ctx=13, majf=0, minf=29 00:32:11.358 IO depths : 1=5.8%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.7%, 32=0.0%, >=64=0.0% 00:32:11.358 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.358 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.358 issued rwts: total=2496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.358 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.358 filename1: (groupid=0, jobs=1): err= 0: pid=1345300: Sat Nov 16 17:07:54 2024 00:32:11.358 read: IOPS=245, BW=980KiB/s (1004kB/s)(9920KiB/10120msec) 00:32:11.358 slat (nsec): min=4164, max=61401, avg=27695.27, stdev=11649.77 00:32:11.358 clat (msec): min=29, max=671, avg=64.47, stdev=104.86 00:32:11.358 lat (msec): min=29, max=671, avg=64.50, stdev=104.86 00:32:11.358 clat percentiles (msec): 00:32:11.358 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:11.358 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.358 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 58], 95.00th=[ 372], 00:32:11.358 | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 625], 99.95th=[ 676], 00:32:11.358 | 99.99th=[ 676] 00:32:11.359 bw ( KiB/s): min= 112, max= 2048, per=4.14%, avg=985.60, stdev=936.03, samples=20 00:32:11.359 iops : min= 28, max= 512, avg=246.40, stdev=234.01, samples=20 00:32:11.359 lat (msec) : 50=89.68%, 100=0.65%, 250=0.97%, 500=7.58%, 750=1.13% 00:32:11.359 cpu : usr=98.63%, sys=0.98%, ctx=14, majf=0, minf=22 00:32:11.359 IO depths : 1=5.0%, 2=11.2%, 4=25.0%, 8=51.2%, 16=7.5%, 32=0.0%, >=64=0.0% 00:32:11.359 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.359 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.359 issued rwts: total=2480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.359 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.359 filename1: (groupid=0, jobs=1): err= 0: pid=1345301: Sat Nov 16 17:07:54 2024 00:32:11.359 read: IOPS=245, BW=981KiB/s (1005kB/s)(9920KiB/10110msec) 00:32:11.359 slat (usec): min=6, max=104, avg=41.56, stdev=13.47 00:32:11.359 clat (msec): min=19, max=566, avg=64.85, stdev=102.26 00:32:11.359 lat (msec): min=19, max=567, avg=64.90, stdev=102.25 00:32:11.359 clat percentiles (msec): 00:32:11.359 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:11.359 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.359 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 51], 95.00th=[ 372], 00:32:11.359 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 464], 99.95th=[ 567], 00:32:11.359 | 99.99th=[ 567] 00:32:11.359 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=985.60, stdev=935.08, samples=20 00:32:11.359 iops : min= 32, max= 512, avg=246.40, stdev=233.77, samples=20 00:32:11.359 lat (msec) : 20=0.08%, 50=90.16%, 100=0.08%, 250=0.08%, 500=9.52% 00:32:11.359 lat (msec) : 750=0.08% 00:32:11.359 cpu : usr=97.96%, sys=1.33%, ctx=130, majf=0, minf=24 00:32:11.359 IO depths : 1=5.8%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.7%, 32=0.0%, >=64=0.0% 00:32:11.359 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.359 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.359 issued rwts: total=2480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.359 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.359 filename1: (groupid=0, jobs=1): err= 0: pid=1345302: Sat Nov 16 17:07:54 2024 00:32:11.359 read: IOPS=246, BW=984KiB/s (1008kB/s)(9984KiB/10146msec) 00:32:11.359 slat (usec): min=7, max=136, avg=45.05, stdev=24.80 00:32:11.359 clat (msec): min=30, max=461, avg=64.59, stdev=101.90 00:32:11.359 lat (msec): min=30, max=461, avg=64.63, stdev=101.89 00:32:11.359 clat percentiles (msec): 00:32:11.359 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:11.359 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.359 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 49], 95.00th=[ 363], 00:32:11.359 | 99.00th=[ 418], 99.50th=[ 451], 99.90th=[ 456], 99.95th=[ 464], 00:32:11.359 | 99.99th=[ 464] 00:32:11.359 bw ( KiB/s): min= 128, max= 2048, per=4.17%, avg=992.15, stdev=929.58, samples=20 00:32:11.359 iops : min= 32, max= 512, avg=248.00, stdev=232.36, samples=20 00:32:11.359 lat (msec) : 50=90.38%, 500=9.62% 00:32:11.359 cpu : usr=98.42%, sys=0.98%, ctx=45, majf=0, minf=22 00:32:11.359 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:32:11.359 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.359 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.359 issued rwts: total=2496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.359 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.359 filename2: (groupid=0, jobs=1): err= 0: pid=1345303: Sat Nov 16 17:07:54 2024 00:32:11.359 read: IOPS=245, BW=981KiB/s (1005kB/s)(9920KiB/10110msec) 00:32:11.359 slat (usec): min=8, max=171, avg=46.56, stdev=19.66 00:32:11.359 clat (msec): min=29, max=463, avg=64.80, stdev=101.99 00:32:11.359 lat (msec): min=30, max=463, avg=64.85, stdev=101.99 00:32:11.359 clat percentiles (msec): 00:32:11.359 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:11.359 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.359 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 50], 95.00th=[ 372], 00:32:11.359 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 422], 99.95th=[ 464], 00:32:11.359 | 99.99th=[ 464] 00:32:11.359 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=985.60, stdev=935.18, samples=20 00:32:11.359 iops : min= 32, max= 512, avg=246.40, stdev=233.79, samples=20 00:32:11.359 lat (msec) : 50=90.32%, 500=9.68% 00:32:11.359 cpu : usr=99.04%, sys=0.55%, ctx=14, majf=0, minf=25 00:32:11.359 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:11.359 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.359 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.359 issued rwts: total=2480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.359 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.359 filename2: (groupid=0, jobs=1): err= 0: pid=1345305: Sat Nov 16 17:07:54 2024 00:32:11.359 read: IOPS=256, BW=1028KiB/s (1052kB/s)(10.2MiB/10152msec) 00:32:11.359 slat (usec): min=4, max=165, avg=29.59, stdev=16.29 00:32:11.359 clat (msec): min=5, max=509, avg=61.99, stdev=88.30 00:32:11.359 lat (msec): min=5, max=509, avg=62.02, stdev=88.30 00:32:11.359 clat percentiles (msec): 00:32:11.359 | 1.00th=[ 18], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:11.359 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.359 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 178], 95.00th=[ 321], 00:32:11.359 | 99.00th=[ 363], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], 00:32:11.359 | 99.99th=[ 510] 00:32:11.359 bw ( KiB/s): min= 144, max= 2048, per=4.35%, avg=1036.80, stdev=914.77, samples=20 00:32:11.359 iops : min= 36, max= 512, avg=259.20, stdev=228.69, samples=20 00:32:11.359 lat (msec) : 10=0.61%, 20=0.61%, 50=86.50%, 250=3.53%, 500=8.21% 00:32:11.359 lat (msec) : 750=0.54% 00:32:11.359 cpu : usr=97.46%, sys=1.46%, ctx=344, majf=0, minf=27 00:32:11.359 IO depths : 1=4.4%, 2=10.6%, 4=25.0%, 8=51.9%, 16=8.1%, 32=0.0%, >=64=0.0% 00:32:11.359 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.359 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.359 issued rwts: total=2608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.359 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.359 filename2: (groupid=0, jobs=1): err= 0: pid=1345306: Sat Nov 16 17:07:54 2024 00:32:11.359 read: IOPS=245, BW=981KiB/s (1004kB/s)(9920KiB/10115msec) 00:32:11.359 slat (usec): min=9, max=188, avg=58.55, stdev=33.85 00:32:11.359 clat (msec): min=19, max=590, avg=64.78, stdev=102.38 00:32:11.359 lat (msec): min=20, max=590, avg=64.84, stdev=102.37 00:32:11.359 clat percentiles (msec): 00:32:11.359 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:11.359 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.359 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 50], 95.00th=[ 363], 00:32:11.359 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 422], 99.95th=[ 592], 00:32:11.359 | 99.99th=[ 592] 00:32:11.359 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=985.75, stdev=935.03, samples=20 00:32:11.359 iops : min= 32, max= 512, avg=246.40, stdev=233.72, samples=20 00:32:11.359 lat (msec) : 20=0.04%, 50=90.28%, 250=0.08%, 500=9.52%, 750=0.08% 00:32:11.359 cpu : usr=98.71%, sys=0.86%, ctx=17, majf=0, minf=29 00:32:11.359 IO depths : 1=1.7%, 2=8.0%, 4=25.0%, 8=54.5%, 16=10.8%, 32=0.0%, >=64=0.0% 00:32:11.359 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.359 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.359 issued rwts: total=2480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.359 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.359 filename2: (groupid=0, jobs=1): err= 0: pid=1345307: Sat Nov 16 17:07:54 2024 00:32:11.359 read: IOPS=245, BW=981KiB/s (1004kB/s)(9920KiB/10113msec) 00:32:11.359 slat (usec): min=6, max=117, avg=43.29, stdev=16.16 00:32:11.359 clat (msec): min=20, max=430, avg=64.87, stdev=101.89 00:32:11.359 lat (msec): min=20, max=430, avg=64.91, stdev=101.89 00:32:11.359 clat percentiles (msec): 00:32:11.359 | 1.00th=[ 27], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:32:11.359 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.359 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 51], 95.00th=[ 363], 00:32:11.359 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 430], 00:32:11.359 | 99.99th=[ 430] 00:32:11.359 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=985.60, stdev=936.00, samples=20 00:32:11.359 iops : min= 32, max= 512, avg=246.40, stdev=234.00, samples=20 00:32:11.359 lat (msec) : 50=89.68%, 100=0.65%, 500=9.68% 00:32:11.359 cpu : usr=98.10%, sys=1.17%, ctx=113, majf=0, minf=20 00:32:11.359 IO depths : 1=5.1%, 2=11.3%, 4=24.8%, 8=51.4%, 16=7.4%, 32=0.0%, >=64=0.0% 00:32:11.359 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.359 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.359 issued rwts: total=2480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.359 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.359 filename2: (groupid=0, jobs=1): err= 0: pid=1345308: Sat Nov 16 17:07:54 2024 00:32:11.359 read: IOPS=249, BW=997KiB/s (1021kB/s)(9.88MiB/10138msec) 00:32:11.359 slat (usec): min=6, max=140, avg=48.32, stdev=26.22 00:32:11.359 clat (msec): min=29, max=635, avg=63.74, stdev=97.24 00:32:11.359 lat (msec): min=29, max=635, avg=63.79, stdev=97.23 00:32:11.359 clat percentiles (msec): 00:32:11.359 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:11.359 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.359 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 127], 95.00th=[ 355], 00:32:11.359 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 439], 99.95th=[ 634], 00:32:11.359 | 99.99th=[ 634] 00:32:11.359 bw ( KiB/s): min= 112, max= 2048, per=4.22%, avg=1004.80, stdev=917.67, samples=20 00:32:11.359 iops : min= 28, max= 512, avg=251.20, stdev=229.42, samples=20 00:32:11.359 lat (msec) : 50=89.24%, 250=1.34%, 500=9.34%, 750=0.08% 00:32:11.359 cpu : usr=98.84%, sys=0.75%, ctx=12, majf=0, minf=21 00:32:11.359 IO depths : 1=5.8%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.7%, 32=0.0%, >=64=0.0% 00:32:11.360 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.360 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.360 issued rwts: total=2528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.360 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.360 filename2: (groupid=0, jobs=1): err= 0: pid=1345309: Sat Nov 16 17:07:54 2024 00:32:11.360 read: IOPS=250, BW=1003KiB/s (1027kB/s)(9.94MiB/10146msec) 00:32:11.360 slat (usec): min=8, max=147, avg=33.76, stdev=18.41 00:32:11.360 clat (msec): min=25, max=509, avg=63.51, stdev=94.04 00:32:11.360 lat (msec): min=25, max=509, avg=63.55, stdev=94.04 00:32:11.360 clat percentiles (msec): 00:32:11.360 | 1.00th=[ 26], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:11.360 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.360 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 178], 95.00th=[ 334], 00:32:11.360 | 99.00th=[ 414], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], 00:32:11.360 | 99.99th=[ 510] 00:32:11.360 bw ( KiB/s): min= 128, max= 2048, per=4.25%, avg=1011.35, stdev=912.42, samples=20 00:32:11.360 iops : min= 32, max= 512, avg=252.80, stdev=228.07, samples=20 00:32:11.360 lat (msec) : 50=88.68%, 250=2.67%, 500=8.02%, 750=0.63% 00:32:11.360 cpu : usr=97.71%, sys=1.34%, ctx=105, majf=0, minf=34 00:32:11.360 IO depths : 1=5.3%, 2=11.6%, 4=25.0%, 8=50.9%, 16=7.2%, 32=0.0%, >=64=0.0% 00:32:11.360 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.360 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.360 issued rwts: total=2544,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.360 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.360 filename2: (groupid=0, jobs=1): err= 0: pid=1345310: Sat Nov 16 17:07:54 2024 00:32:11.360 read: IOPS=245, BW=980KiB/s (1004kB/s)(9920KiB/10122msec) 00:32:11.360 slat (usec): min=8, max=127, avg=50.38, stdev=19.10 00:32:11.360 clat (msec): min=30, max=419, avg=64.86, stdev=101.85 00:32:11.360 lat (msec): min=30, max=419, avg=64.91, stdev=101.85 00:32:11.360 clat percentiles (msec): 00:32:11.360 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:11.360 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.360 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 60], 95.00th=[ 363], 00:32:11.360 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], 00:32:11.360 | 99.99th=[ 418] 00:32:11.360 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=985.60, stdev=936.10, samples=20 00:32:11.360 iops : min= 32, max= 512, avg=246.40, stdev=234.03, samples=20 00:32:11.360 lat (msec) : 50=89.68%, 100=0.65%, 500=9.68% 00:32:11.360 cpu : usr=98.71%, sys=0.86%, ctx=15, majf=0, minf=27 00:32:11.360 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:11.360 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.360 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.360 issued rwts: total=2480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.360 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.360 filename2: (groupid=0, jobs=1): err= 0: pid=1345311: Sat Nov 16 17:07:54 2024 00:32:11.360 read: IOPS=246, BW=985KiB/s (1009kB/s)(9984KiB/10131msec) 00:32:11.360 slat (nsec): min=8300, max=70538, avg=30328.82, stdev=10785.12 00:32:11.360 clat (msec): min=27, max=417, avg=64.67, stdev=98.92 00:32:11.360 lat (msec): min=27, max=417, avg=64.70, stdev=98.91 00:32:11.360 clat percentiles (msec): 00:32:11.360 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:32:11.360 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.360 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 153], 95.00th=[ 355], 00:32:11.360 | 99.00th=[ 409], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], 00:32:11.360 | 99.99th=[ 418] 00:32:11.360 bw ( KiB/s): min= 128, max= 2048, per=4.16%, avg=992.00, stdev=930.25, samples=20 00:32:11.360 iops : min= 32, max= 512, avg=248.00, stdev=232.56, samples=20 00:32:11.360 lat (msec) : 50=89.10%, 100=0.64%, 250=0.64%, 500=9.62% 00:32:11.360 cpu : usr=98.93%, sys=0.66%, ctx=16, majf=0, minf=28 00:32:11.360 IO depths : 1=2.0%, 2=8.2%, 4=25.0%, 8=54.3%, 16=10.5%, 32=0.0%, >=64=0.0% 00:32:11.360 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.360 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.360 issued rwts: total=2496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.360 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.360 00:32:11.360 Run status group 0 (all jobs): 00:32:11.360 READ: bw=23.2MiB/s (24.4MB/s), 979KiB/s-1045KiB/s (1003kB/s-1070kB/s), io=236MiB (247MB), run=10110-10154msec 00:32:11.360 17:07:55 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:32:11.360 17:07:55 -- target/dif.sh@43 -- # local sub 00:32:11.360 17:07:55 -- target/dif.sh@45 -- # for sub in "$@" 00:32:11.360 17:07:55 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:11.360 17:07:55 -- target/dif.sh@36 -- # local sub_id=0 00:32:11.360 17:07:55 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:11.360 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.360 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:32:11.360 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.360 17:07:55 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:11.360 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.360 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:32:11.360 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.360 17:07:55 -- target/dif.sh@45 -- # for sub in "$@" 00:32:11.360 17:07:55 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:11.360 17:07:55 -- target/dif.sh@36 -- # local sub_id=1 00:32:11.360 17:07:55 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:11.360 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.360 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:32:11.360 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.360 17:07:55 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:11.360 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.360 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:32:11.360 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.360 17:07:55 -- target/dif.sh@45 -- # for sub in "$@" 00:32:11.360 17:07:55 -- target/dif.sh@46 -- # destroy_subsystem 2 00:32:11.360 17:07:55 -- target/dif.sh@36 -- # local sub_id=2 00:32:11.360 17:07:55 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:32:11.360 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.360 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:32:11.360 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.360 17:07:55 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:32:11.360 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.360 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:32:11.360 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.360 17:07:55 -- target/dif.sh@115 -- # NULL_DIF=1 00:32:11.360 17:07:55 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:32:11.360 17:07:55 -- target/dif.sh@115 -- # numjobs=2 00:32:11.360 17:07:55 -- target/dif.sh@115 -- # iodepth=8 00:32:11.360 17:07:55 -- target/dif.sh@115 -- # runtime=5 00:32:11.360 17:07:55 -- target/dif.sh@115 -- # files=1 00:32:11.360 17:07:55 -- target/dif.sh@117 -- # create_subsystems 0 1 00:32:11.360 17:07:55 -- target/dif.sh@28 -- # local sub 00:32:11.360 17:07:55 -- target/dif.sh@30 -- # for sub in "$@" 00:32:11.360 17:07:55 -- target/dif.sh@31 -- # create_subsystem 0 00:32:11.360 17:07:55 -- target/dif.sh@18 -- # local sub_id=0 00:32:11.360 17:07:55 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:11.360 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.360 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:32:11.360 bdev_null0 00:32:11.360 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.360 17:07:55 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:11.360 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.360 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:32:11.360 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.360 17:07:55 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:11.360 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.360 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:32:11.360 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.360 17:07:55 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:11.360 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.360 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:32:11.360 [2024-11-16 17:07:55.242727] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:11.360 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.360 17:07:55 -- target/dif.sh@30 -- # for sub in "$@" 00:32:11.360 17:07:55 -- target/dif.sh@31 -- # create_subsystem 1 00:32:11.360 17:07:55 -- target/dif.sh@18 -- # local sub_id=1 00:32:11.360 17:07:55 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:11.360 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.360 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:32:11.360 bdev_null1 00:32:11.360 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.360 17:07:55 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:11.360 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.360 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:32:11.360 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.360 17:07:55 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:11.360 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.360 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:32:11.360 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.360 17:07:55 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:11.360 17:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.360 17:07:55 -- common/autotest_common.sh@10 -- # set +x 00:32:11.361 17:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.361 17:07:55 -- target/dif.sh@118 -- # fio /dev/fd/62 00:32:11.361 17:07:55 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:32:11.361 17:07:55 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:11.361 17:07:55 -- nvmf/common.sh@520 -- # config=() 00:32:11.361 17:07:55 -- nvmf/common.sh@520 -- # local subsystem config 00:32:11.361 17:07:55 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:11.361 17:07:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:11.361 17:07:55 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:11.361 17:07:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:11.361 { 00:32:11.361 "params": { 00:32:11.361 "name": "Nvme$subsystem", 00:32:11.361 "trtype": "$TEST_TRANSPORT", 00:32:11.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:11.361 "adrfam": "ipv4", 00:32:11.361 "trsvcid": "$NVMF_PORT", 00:32:11.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:11.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:11.361 "hdgst": ${hdgst:-false}, 00:32:11.361 "ddgst": ${ddgst:-false} 00:32:11.361 }, 00:32:11.361 "method": "bdev_nvme_attach_controller" 00:32:11.361 } 00:32:11.361 EOF 00:32:11.361 )") 00:32:11.361 17:07:55 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:11.361 17:07:55 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:11.361 17:07:55 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:11.361 17:07:55 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:11.361 17:07:55 -- common/autotest_common.sh@1330 -- # shift 00:32:11.361 17:07:55 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:11.361 17:07:55 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:11.361 17:07:55 -- target/dif.sh@82 -- # gen_fio_conf 00:32:11.361 17:07:55 -- target/dif.sh@54 -- # local file 00:32:11.361 17:07:55 -- target/dif.sh@56 -- # cat 00:32:11.361 17:07:55 -- nvmf/common.sh@542 -- # cat 00:32:11.361 17:07:55 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:11.361 17:07:55 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:11.361 17:07:55 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:11.361 17:07:55 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:11.361 17:07:55 -- target/dif.sh@72 -- # (( file <= files )) 00:32:11.361 17:07:55 -- target/dif.sh@73 -- # cat 00:32:11.361 17:07:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:11.361 17:07:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:11.361 { 00:32:11.361 "params": { 00:32:11.361 "name": "Nvme$subsystem", 00:32:11.361 "trtype": "$TEST_TRANSPORT", 00:32:11.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:11.361 "adrfam": "ipv4", 00:32:11.361 "trsvcid": "$NVMF_PORT", 00:32:11.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:11.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:11.361 "hdgst": ${hdgst:-false}, 00:32:11.361 "ddgst": ${ddgst:-false} 00:32:11.361 }, 00:32:11.361 "method": "bdev_nvme_attach_controller" 00:32:11.361 } 00:32:11.361 EOF 00:32:11.361 )") 00:32:11.361 17:07:55 -- nvmf/common.sh@542 -- # cat 00:32:11.361 17:07:55 -- target/dif.sh@72 -- # (( file++ )) 00:32:11.361 17:07:55 -- target/dif.sh@72 -- # (( file <= files )) 00:32:11.361 17:07:55 -- nvmf/common.sh@544 -- # jq . 00:32:11.361 17:07:55 -- nvmf/common.sh@545 -- # IFS=, 00:32:11.361 17:07:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:11.361 "params": { 00:32:11.361 "name": "Nvme0", 00:32:11.361 "trtype": "tcp", 00:32:11.361 "traddr": "10.0.0.2", 00:32:11.361 "adrfam": "ipv4", 00:32:11.361 "trsvcid": "4420", 00:32:11.361 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:11.361 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:11.361 "hdgst": false, 00:32:11.361 "ddgst": false 00:32:11.361 }, 00:32:11.361 "method": "bdev_nvme_attach_controller" 00:32:11.361 },{ 00:32:11.361 "params": { 00:32:11.361 "name": "Nvme1", 00:32:11.361 "trtype": "tcp", 00:32:11.361 "traddr": "10.0.0.2", 00:32:11.361 "adrfam": "ipv4", 00:32:11.361 "trsvcid": "4420", 00:32:11.361 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:11.361 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:11.361 "hdgst": false, 00:32:11.361 "ddgst": false 00:32:11.361 }, 00:32:11.361 "method": "bdev_nvme_attach_controller" 00:32:11.361 }' 00:32:11.361 17:07:55 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:11.361 17:07:55 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:11.361 17:07:55 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:11.361 17:07:55 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:11.361 17:07:55 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:11.361 17:07:55 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:11.361 17:07:55 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:11.361 17:07:55 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:11.361 17:07:55 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:11.361 17:07:55 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:11.361 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:11.361 ... 00:32:11.361 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:11.361 ... 00:32:11.361 fio-3.35 00:32:11.361 Starting 4 threads 00:32:11.361 EAL: No free 2048 kB hugepages reported on node 1 00:32:11.361 [2024-11-16 17:07:56.070520] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:11.361 [2024-11-16 17:07:56.070576] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:15.551 00:32:15.551 filename0: (groupid=0, jobs=1): err= 0: pid=1346708: Sat Nov 16 17:08:01 2024 00:32:15.551 read: IOPS=1976, BW=15.4MiB/s (16.2MB/s)(77.3MiB/5003msec) 00:32:15.551 slat (nsec): min=3667, max=66591, avg=15067.77, stdev=4718.10 00:32:15.551 clat (usec): min=795, max=7318, avg=3989.29, stdev=399.99 00:32:15.551 lat (usec): min=808, max=7332, avg=4004.36, stdev=400.22 00:32:15.551 clat percentiles (usec): 00:32:15.551 | 1.00th=[ 2900], 5.00th=[ 3425], 10.00th=[ 3687], 20.00th=[ 3916], 00:32:15.551 | 30.00th=[ 3949], 40.00th=[ 3982], 50.00th=[ 4015], 60.00th=[ 4047], 00:32:15.551 | 70.00th=[ 4047], 80.00th=[ 4113], 90.00th=[ 4146], 95.00th=[ 4293], 00:32:15.551 | 99.00th=[ 5735], 99.50th=[ 6063], 99.90th=[ 7046], 99.95th=[ 7046], 00:32:15.551 | 99.99th=[ 7308] 00:32:15.551 bw ( KiB/s): min=15440, max=16368, per=25.16%, avg=15814.30, stdev=293.86, samples=10 00:32:15.551 iops : min= 1930, max= 2046, avg=1976.70, stdev=36.79, samples=10 00:32:15.551 lat (usec) : 1000=0.09% 00:32:15.551 lat (msec) : 2=0.29%, 4=46.21%, 10=53.40% 00:32:15.551 cpu : usr=88.56%, sys=7.78%, ctx=397, majf=0, minf=0 00:32:15.551 IO depths : 1=0.2%, 2=21.2%, 4=52.5%, 8=26.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:15.551 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.551 complete : 0=0.0%, 4=91.1%, 8=8.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.551 issued rwts: total=9889,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:15.551 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:15.551 filename0: (groupid=0, jobs=1): err= 0: pid=1346709: Sat Nov 16 17:08:01 2024 00:32:15.551 read: IOPS=1973, BW=15.4MiB/s (16.2MB/s)(77.1MiB/5002msec) 00:32:15.551 slat (usec): min=3, max=256, avg=14.57, stdev= 5.06 00:32:15.551 clat (usec): min=756, max=7323, avg=3995.86, stdev=446.11 00:32:15.551 lat (usec): min=769, max=7338, avg=4010.43, stdev=446.25 00:32:15.551 clat percentiles (usec): 00:32:15.551 | 1.00th=[ 2704], 5.00th=[ 3458], 10.00th=[ 3687], 20.00th=[ 3916], 00:32:15.551 | 30.00th=[ 3949], 40.00th=[ 3982], 50.00th=[ 4015], 60.00th=[ 4047], 00:32:15.551 | 70.00th=[ 4047], 80.00th=[ 4113], 90.00th=[ 4146], 95.00th=[ 4293], 00:32:15.551 | 99.00th=[ 5997], 99.50th=[ 6521], 99.90th=[ 7046], 99.95th=[ 7111], 00:32:15.551 | 99.99th=[ 7308] 00:32:15.551 bw ( KiB/s): min=15504, max=16128, per=25.11%, avg=15783.00, stdev=221.81, samples=9 00:32:15.551 iops : min= 1938, max= 2016, avg=1972.78, stdev=27.81, samples=9 00:32:15.551 lat (usec) : 1000=0.11% 00:32:15.551 lat (msec) : 2=0.55%, 4=45.78%, 10=53.56% 00:32:15.551 cpu : usr=94.80%, sys=4.66%, ctx=8, majf=0, minf=9 00:32:15.551 IO depths : 1=0.1%, 2=21.2%, 4=52.5%, 8=26.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:15.551 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.551 complete : 0=0.0%, 4=91.1%, 8=8.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.551 issued rwts: total=9873,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:15.551 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:15.551 filename1: (groupid=0, jobs=1): err= 0: pid=1346710: Sat Nov 16 17:08:01 2024 00:32:15.551 read: IOPS=1951, BW=15.2MiB/s (16.0MB/s)(76.3MiB/5002msec) 00:32:15.551 slat (nsec): min=3632, max=49154, avg=15399.87, stdev=5355.19 00:32:15.551 clat (usec): min=719, max=7373, avg=4037.25, stdev=456.88 00:32:15.551 lat (usec): min=732, max=7388, avg=4052.65, stdev=456.78 00:32:15.551 clat percentiles (usec): 00:32:15.551 | 1.00th=[ 2966], 5.00th=[ 3589], 10.00th=[ 3818], 20.00th=[ 3916], 00:32:15.551 | 30.00th=[ 3949], 40.00th=[ 3982], 50.00th=[ 4015], 60.00th=[ 4047], 00:32:15.551 | 70.00th=[ 4080], 80.00th=[ 4113], 90.00th=[ 4178], 95.00th=[ 4555], 00:32:15.551 | 99.00th=[ 6128], 99.50th=[ 6587], 99.90th=[ 6980], 99.95th=[ 7111], 00:32:15.551 | 99.99th=[ 7373] 00:32:15.551 bw ( KiB/s): min=15056, max=15888, per=24.84%, avg=15616.00, stdev=249.29, samples=9 00:32:15.551 iops : min= 1882, max= 1986, avg=1952.00, stdev=31.16, samples=9 00:32:15.551 lat (usec) : 750=0.03%, 1000=0.07% 00:32:15.551 lat (msec) : 2=0.50%, 4=45.04%, 10=54.36% 00:32:15.551 cpu : usr=92.36%, sys=5.96%, ctx=297, majf=0, minf=0 00:32:15.551 IO depths : 1=0.1%, 2=20.5%, 4=53.3%, 8=26.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:15.551 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.551 complete : 0=0.0%, 4=91.0%, 8=9.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.551 issued rwts: total=9763,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:15.551 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:15.551 filename1: (groupid=0, jobs=1): err= 0: pid=1346711: Sat Nov 16 17:08:01 2024 00:32:15.551 read: IOPS=1957, BW=15.3MiB/s (16.0MB/s)(76.5MiB/5004msec) 00:32:15.551 slat (nsec): min=3711, max=52654, avg=13559.95, stdev=5540.81 00:32:15.551 clat (usec): min=1107, max=7156, avg=4042.66, stdev=390.55 00:32:15.551 lat (usec): min=1121, max=7171, avg=4056.22, stdev=390.60 00:32:15.551 clat percentiles (usec): 00:32:15.551 | 1.00th=[ 3032], 5.00th=[ 3589], 10.00th=[ 3818], 20.00th=[ 3949], 00:32:15.551 | 30.00th=[ 3982], 40.00th=[ 4015], 50.00th=[ 4015], 60.00th=[ 4047], 00:32:15.551 | 70.00th=[ 4080], 80.00th=[ 4113], 90.00th=[ 4178], 95.00th=[ 4359], 00:32:15.551 | 99.00th=[ 5800], 99.50th=[ 6521], 99.90th=[ 7046], 99.95th=[ 7046], 00:32:15.551 | 99.99th=[ 7177] 00:32:15.551 bw ( KiB/s): min=15408, max=16144, per=24.91%, avg=15656.00, stdev=202.28, samples=10 00:32:15.551 iops : min= 1926, max= 2018, avg=1957.00, stdev=25.29, samples=10 00:32:15.551 lat (msec) : 2=0.06%, 4=36.46%, 10=63.47% 00:32:15.551 cpu : usr=91.25%, sys=6.60%, ctx=195, majf=0, minf=9 00:32:15.551 IO depths : 1=0.3%, 2=12.2%, 4=60.6%, 8=26.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:15.551 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.551 complete : 0=0.0%, 4=91.7%, 8=8.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.551 issued rwts: total=9793,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:15.551 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:15.551 00:32:15.551 Run status group 0 (all jobs): 00:32:15.551 READ: bw=61.4MiB/s (64.4MB/s), 15.2MiB/s-15.4MiB/s (16.0MB/s-16.2MB/s), io=307MiB (322MB), run=5002-5004msec 00:32:15.810 17:08:01 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:32:15.810 17:08:01 -- target/dif.sh@43 -- # local sub 00:32:15.810 17:08:01 -- target/dif.sh@45 -- # for sub in "$@" 00:32:15.810 17:08:01 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:15.810 17:08:01 -- target/dif.sh@36 -- # local sub_id=0 00:32:15.810 17:08:01 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:15.810 17:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.810 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:32:15.810 17:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.810 17:08:01 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:15.810 17:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.810 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:32:15.810 17:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.810 17:08:01 -- target/dif.sh@45 -- # for sub in "$@" 00:32:15.810 17:08:01 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:15.810 17:08:01 -- target/dif.sh@36 -- # local sub_id=1 00:32:15.810 17:08:01 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:15.810 17:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.810 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:32:15.810 17:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.810 17:08:01 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:15.810 17:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.810 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:32:15.810 17:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.810 00:32:15.810 real 0m24.188s 00:32:15.810 user 4m35.918s 00:32:15.810 sys 0m5.641s 00:32:15.810 17:08:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:15.810 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:32:15.810 ************************************ 00:32:15.810 END TEST fio_dif_rand_params 00:32:15.810 ************************************ 00:32:15.810 17:08:01 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:32:15.810 17:08:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:15.810 17:08:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:15.810 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:32:15.810 ************************************ 00:32:15.810 START TEST fio_dif_digest 00:32:15.810 ************************************ 00:32:15.810 17:08:01 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:32:15.810 17:08:01 -- target/dif.sh@123 -- # local NULL_DIF 00:32:15.810 17:08:01 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:32:15.810 17:08:01 -- target/dif.sh@125 -- # local hdgst ddgst 00:32:15.810 17:08:01 -- target/dif.sh@127 -- # NULL_DIF=3 00:32:15.810 17:08:01 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:32:15.810 17:08:01 -- target/dif.sh@127 -- # numjobs=3 00:32:15.810 17:08:01 -- target/dif.sh@127 -- # iodepth=3 00:32:15.810 17:08:01 -- target/dif.sh@127 -- # runtime=10 00:32:15.810 17:08:01 -- target/dif.sh@128 -- # hdgst=true 00:32:15.810 17:08:01 -- target/dif.sh@128 -- # ddgst=true 00:32:15.810 17:08:01 -- target/dif.sh@130 -- # create_subsystems 0 00:32:15.810 17:08:01 -- target/dif.sh@28 -- # local sub 00:32:15.810 17:08:01 -- target/dif.sh@30 -- # for sub in "$@" 00:32:15.810 17:08:01 -- target/dif.sh@31 -- # create_subsystem 0 00:32:15.810 17:08:01 -- target/dif.sh@18 -- # local sub_id=0 00:32:15.810 17:08:01 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:15.810 17:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.810 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:32:15.810 bdev_null0 00:32:15.810 17:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.810 17:08:01 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:15.810 17:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.810 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:32:15.810 17:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:16.068 17:08:01 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:16.068 17:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:16.068 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:32:16.068 17:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:16.068 17:08:01 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:16.068 17:08:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:16.068 17:08:01 -- common/autotest_common.sh@10 -- # set +x 00:32:16.068 [2024-11-16 17:08:01.572270] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:16.068 17:08:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:16.068 17:08:01 -- target/dif.sh@131 -- # fio /dev/fd/62 00:32:16.068 17:08:01 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:32:16.068 17:08:01 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:16.068 17:08:01 -- nvmf/common.sh@520 -- # config=() 00:32:16.068 17:08:01 -- nvmf/common.sh@520 -- # local subsystem config 00:32:16.068 17:08:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:16.068 17:08:01 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:16.068 17:08:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:16.068 { 00:32:16.068 "params": { 00:32:16.068 "name": "Nvme$subsystem", 00:32:16.068 "trtype": "$TEST_TRANSPORT", 00:32:16.068 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:16.068 "adrfam": "ipv4", 00:32:16.068 "trsvcid": "$NVMF_PORT", 00:32:16.068 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:16.068 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:16.068 "hdgst": ${hdgst:-false}, 00:32:16.068 "ddgst": ${ddgst:-false} 00:32:16.068 }, 00:32:16.068 "method": "bdev_nvme_attach_controller" 00:32:16.068 } 00:32:16.068 EOF 00:32:16.068 )") 00:32:16.068 17:08:01 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:16.068 17:08:01 -- target/dif.sh@82 -- # gen_fio_conf 00:32:16.068 17:08:01 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:16.068 17:08:01 -- target/dif.sh@54 -- # local file 00:32:16.068 17:08:01 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:16.068 17:08:01 -- target/dif.sh@56 -- # cat 00:32:16.068 17:08:01 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:16.068 17:08:01 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:16.068 17:08:01 -- common/autotest_common.sh@1330 -- # shift 00:32:16.068 17:08:01 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:16.068 17:08:01 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:16.068 17:08:01 -- nvmf/common.sh@542 -- # cat 00:32:16.068 17:08:01 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:16.068 17:08:01 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:16.068 17:08:01 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:16.068 17:08:01 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:16.068 17:08:01 -- target/dif.sh@72 -- # (( file <= files )) 00:32:16.068 17:08:01 -- nvmf/common.sh@544 -- # jq . 00:32:16.068 17:08:01 -- nvmf/common.sh@545 -- # IFS=, 00:32:16.068 17:08:01 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:16.068 "params": { 00:32:16.068 "name": "Nvme0", 00:32:16.068 "trtype": "tcp", 00:32:16.068 "traddr": "10.0.0.2", 00:32:16.068 "adrfam": "ipv4", 00:32:16.068 "trsvcid": "4420", 00:32:16.068 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:16.068 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:16.068 "hdgst": true, 00:32:16.068 "ddgst": true 00:32:16.068 }, 00:32:16.068 "method": "bdev_nvme_attach_controller" 00:32:16.068 }' 00:32:16.068 17:08:01 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:16.068 17:08:01 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:16.068 17:08:01 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:16.068 17:08:01 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:16.068 17:08:01 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:16.068 17:08:01 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:16.068 17:08:01 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:16.069 17:08:01 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:16.069 17:08:01 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:16.069 17:08:01 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:16.326 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:16.326 ... 00:32:16.326 fio-3.35 00:32:16.326 Starting 3 threads 00:32:16.327 EAL: No free 2048 kB hugepages reported on node 1 00:32:16.584 [2024-11-16 17:08:02.312803] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:16.584 [2024-11-16 17:08:02.312870] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:28.812 00:32:28.812 filename0: (groupid=0, jobs=1): err= 0: pid=1347495: Sat Nov 16 17:08:12 2024 00:32:28.812 read: IOPS=215, BW=26.9MiB/s (28.3MB/s)(271MiB/10047msec) 00:32:28.812 slat (usec): min=4, max=130, avg=21.76, stdev= 5.13 00:32:28.812 clat (usec): min=10236, max=51491, avg=13870.68, stdev=1450.61 00:32:28.812 lat (usec): min=10262, max=51511, avg=13892.44, stdev=1450.53 00:32:28.812 clat percentiles (usec): 00:32:28.812 | 1.00th=[11600], 5.00th=[12256], 10.00th=[12649], 20.00th=[13042], 00:32:28.812 | 30.00th=[13435], 40.00th=[13698], 50.00th=[13829], 60.00th=[14091], 00:32:28.812 | 70.00th=[14222], 80.00th=[14615], 90.00th=[15008], 95.00th=[15401], 00:32:28.812 | 99.00th=[16188], 99.50th=[16450], 99.90th=[20579], 99.95th=[48497], 00:32:28.812 | 99.99th=[51643] 00:32:28.812 bw ( KiB/s): min=26880, max=28416, per=34.54%, avg=27686.40, stdev=400.70, samples=20 00:32:28.812 iops : min= 210, max= 222, avg=216.30, stdev= 3.13, samples=20 00:32:28.812 lat (msec) : 20=99.77%, 50=0.18%, 100=0.05% 00:32:28.812 cpu : usr=94.54%, sys=4.69%, ctx=121, majf=0, minf=191 00:32:28.812 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:28.812 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:28.812 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:28.812 issued rwts: total=2166,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:28.812 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:28.812 filename0: (groupid=0, jobs=1): err= 0: pid=1347496: Sat Nov 16 17:08:12 2024 00:32:28.812 read: IOPS=203, BW=25.4MiB/s (26.6MB/s)(255MiB/10046msec) 00:32:28.812 slat (nsec): min=4283, max=46657, avg=16319.99, stdev=4840.37 00:32:28.812 clat (usec): min=11635, max=55592, avg=14732.00, stdev=1572.27 00:32:28.812 lat (usec): min=11650, max=55610, avg=14748.32, stdev=1572.20 00:32:28.812 clat percentiles (usec): 00:32:28.812 | 1.00th=[12387], 5.00th=[13173], 10.00th=[13435], 20.00th=[13960], 00:32:28.812 | 30.00th=[14222], 40.00th=[14484], 50.00th=[14615], 60.00th=[14877], 00:32:28.812 | 70.00th=[15139], 80.00th=[15533], 90.00th=[15926], 95.00th=[16319], 00:32:28.812 | 99.00th=[17433], 99.50th=[17695], 99.90th=[25035], 99.95th=[49021], 00:32:28.812 | 99.99th=[55837] 00:32:28.812 bw ( KiB/s): min=25088, max=26880, per=32.54%, avg=26086.40, stdev=422.70, samples=20 00:32:28.812 iops : min= 196, max= 210, avg=203.80, stdev= 3.30, samples=20 00:32:28.812 lat (msec) : 20=99.75%, 50=0.20%, 100=0.05% 00:32:28.812 cpu : usr=94.68%, sys=4.81%, ctx=21, majf=0, minf=145 00:32:28.812 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:28.812 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:28.812 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:28.812 issued rwts: total=2040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:28.812 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:28.812 filename0: (groupid=0, jobs=1): err= 0: pid=1347497: Sat Nov 16 17:08:12 2024 00:32:28.812 read: IOPS=207, BW=26.0MiB/s (27.2MB/s)(261MiB/10047msec) 00:32:28.812 slat (nsec): min=4741, max=48769, avg=16396.59, stdev=4660.09 00:32:28.812 clat (usec): min=10675, max=52238, avg=14407.36, stdev=1491.34 00:32:28.812 lat (usec): min=10690, max=52251, avg=14423.76, stdev=1491.37 00:32:28.812 clat percentiles (usec): 00:32:28.812 | 1.00th=[12125], 5.00th=[12780], 10.00th=[13173], 20.00th=[13566], 00:32:28.812 | 30.00th=[13829], 40.00th=[14091], 50.00th=[14353], 60.00th=[14615], 00:32:28.812 | 70.00th=[14746], 80.00th=[15139], 90.00th=[15664], 95.00th=[16057], 00:32:28.812 | 99.00th=[17171], 99.50th=[17433], 99.90th=[19530], 99.95th=[47973], 00:32:28.812 | 99.99th=[52167] 00:32:28.812 bw ( KiB/s): min=25907, max=27392, per=33.28%, avg=26677.75, stdev=406.74, samples=20 00:32:28.812 iops : min= 202, max= 214, avg=208.40, stdev= 3.22, samples=20 00:32:28.812 lat (msec) : 20=99.90%, 50=0.05%, 100=0.05% 00:32:28.812 cpu : usr=95.14%, sys=4.35%, ctx=27, majf=0, minf=86 00:32:28.812 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:28.812 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:28.812 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:28.812 issued rwts: total=2086,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:28.812 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:28.812 00:32:28.812 Run status group 0 (all jobs): 00:32:28.812 READ: bw=78.3MiB/s (82.1MB/s), 25.4MiB/s-26.9MiB/s (26.6MB/s-28.3MB/s), io=787MiB (825MB), run=10046-10047msec 00:32:28.812 17:08:12 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:28.812 17:08:12 -- target/dif.sh@43 -- # local sub 00:32:28.812 17:08:12 -- target/dif.sh@45 -- # for sub in "$@" 00:32:28.812 17:08:12 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:28.812 17:08:12 -- target/dif.sh@36 -- # local sub_id=0 00:32:28.812 17:08:12 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:28.812 17:08:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:28.812 17:08:12 -- common/autotest_common.sh@10 -- # set +x 00:32:28.812 17:08:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:28.812 17:08:12 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:28.812 17:08:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:28.812 17:08:12 -- common/autotest_common.sh@10 -- # set +x 00:32:28.812 17:08:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:28.812 00:32:28.812 real 0m11.227s 00:32:28.812 user 0m29.801s 00:32:28.812 sys 0m1.643s 00:32:28.812 17:08:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:28.812 17:08:12 -- common/autotest_common.sh@10 -- # set +x 00:32:28.812 ************************************ 00:32:28.812 END TEST fio_dif_digest 00:32:28.812 ************************************ 00:32:28.812 17:08:12 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:28.812 17:08:12 -- target/dif.sh@147 -- # nvmftestfini 00:32:28.812 17:08:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:28.812 17:08:12 -- nvmf/common.sh@116 -- # sync 00:32:28.812 17:08:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:28.812 17:08:12 -- nvmf/common.sh@119 -- # set +e 00:32:28.812 17:08:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:28.812 17:08:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:28.812 rmmod nvme_tcp 00:32:28.812 rmmod nvme_fabrics 00:32:28.812 rmmod nvme_keyring 00:32:28.812 17:08:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:28.812 17:08:12 -- nvmf/common.sh@123 -- # set -e 00:32:28.812 17:08:12 -- nvmf/common.sh@124 -- # return 0 00:32:28.812 17:08:12 -- nvmf/common.sh@477 -- # '[' -n 1341246 ']' 00:32:28.812 17:08:12 -- nvmf/common.sh@478 -- # killprocess 1341246 00:32:28.812 17:08:12 -- common/autotest_common.sh@936 -- # '[' -z 1341246 ']' 00:32:28.812 17:08:12 -- common/autotest_common.sh@940 -- # kill -0 1341246 00:32:28.812 17:08:12 -- common/autotest_common.sh@941 -- # uname 00:32:28.812 17:08:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:28.812 17:08:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1341246 00:32:28.812 17:08:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:28.812 17:08:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:28.812 17:08:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1341246' 00:32:28.812 killing process with pid 1341246 00:32:28.812 17:08:12 -- common/autotest_common.sh@955 -- # kill 1341246 00:32:28.812 17:08:12 -- common/autotest_common.sh@960 -- # wait 1341246 00:32:28.812 17:08:13 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:28.812 17:08:13 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:28.812 Waiting for block devices as requested 00:32:28.812 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:28.812 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:28.812 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:29.078 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:29.078 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:29.078 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:29.078 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:29.078 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:29.337 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:29.337 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:29.337 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:29.337 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:29.595 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:29.595 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:29.595 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:29.595 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:29.853 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:29.853 17:08:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:29.853 17:08:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:29.853 17:08:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:29.853 17:08:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:29.853 17:08:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:29.853 17:08:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:29.853 17:08:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:32.386 17:08:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:32.386 00:32:32.386 real 1m7.515s 00:32:32.386 user 6m34.283s 00:32:32.386 sys 0m16.195s 00:32:32.386 17:08:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:32.386 17:08:17 -- common/autotest_common.sh@10 -- # set +x 00:32:32.386 ************************************ 00:32:32.386 END TEST nvmf_dif 00:32:32.386 ************************************ 00:32:32.386 17:08:17 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:32.386 17:08:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:32.386 17:08:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:32.386 17:08:17 -- common/autotest_common.sh@10 -- # set +x 00:32:32.386 ************************************ 00:32:32.386 START TEST nvmf_abort_qd_sizes 00:32:32.386 ************************************ 00:32:32.386 17:08:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:32.386 * Looking for test storage... 00:32:32.386 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:32.386 17:08:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:32.386 17:08:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:32.386 17:08:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:32.386 17:08:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:32.386 17:08:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:32.386 17:08:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:32.386 17:08:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:32.386 17:08:17 -- scripts/common.sh@335 -- # IFS=.-: 00:32:32.386 17:08:17 -- scripts/common.sh@335 -- # read -ra ver1 00:32:32.386 17:08:17 -- scripts/common.sh@336 -- # IFS=.-: 00:32:32.386 17:08:17 -- scripts/common.sh@336 -- # read -ra ver2 00:32:32.386 17:08:17 -- scripts/common.sh@337 -- # local 'op=<' 00:32:32.386 17:08:17 -- scripts/common.sh@339 -- # ver1_l=2 00:32:32.386 17:08:17 -- scripts/common.sh@340 -- # ver2_l=1 00:32:32.386 17:08:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:32.386 17:08:17 -- scripts/common.sh@343 -- # case "$op" in 00:32:32.386 17:08:17 -- scripts/common.sh@344 -- # : 1 00:32:32.386 17:08:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:32.386 17:08:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:32.386 17:08:17 -- scripts/common.sh@364 -- # decimal 1 00:32:32.386 17:08:17 -- scripts/common.sh@352 -- # local d=1 00:32:32.386 17:08:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:32.386 17:08:17 -- scripts/common.sh@354 -- # echo 1 00:32:32.386 17:08:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:32.386 17:08:17 -- scripts/common.sh@365 -- # decimal 2 00:32:32.386 17:08:17 -- scripts/common.sh@352 -- # local d=2 00:32:32.386 17:08:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:32.386 17:08:17 -- scripts/common.sh@354 -- # echo 2 00:32:32.386 17:08:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:32.386 17:08:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:32.386 17:08:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:32.386 17:08:17 -- scripts/common.sh@367 -- # return 0 00:32:32.386 17:08:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:32.386 17:08:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:32.386 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:32.386 --rc genhtml_branch_coverage=1 00:32:32.386 --rc genhtml_function_coverage=1 00:32:32.386 --rc genhtml_legend=1 00:32:32.386 --rc geninfo_all_blocks=1 00:32:32.386 --rc geninfo_unexecuted_blocks=1 00:32:32.386 00:32:32.386 ' 00:32:32.386 17:08:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:32.386 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:32.386 --rc genhtml_branch_coverage=1 00:32:32.386 --rc genhtml_function_coverage=1 00:32:32.386 --rc genhtml_legend=1 00:32:32.386 --rc geninfo_all_blocks=1 00:32:32.386 --rc geninfo_unexecuted_blocks=1 00:32:32.386 00:32:32.386 ' 00:32:32.386 17:08:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:32.386 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:32.386 --rc genhtml_branch_coverage=1 00:32:32.386 --rc genhtml_function_coverage=1 00:32:32.386 --rc genhtml_legend=1 00:32:32.386 --rc geninfo_all_blocks=1 00:32:32.386 --rc geninfo_unexecuted_blocks=1 00:32:32.386 00:32:32.386 ' 00:32:32.386 17:08:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:32.386 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:32.386 --rc genhtml_branch_coverage=1 00:32:32.386 --rc genhtml_function_coverage=1 00:32:32.386 --rc genhtml_legend=1 00:32:32.386 --rc geninfo_all_blocks=1 00:32:32.387 --rc geninfo_unexecuted_blocks=1 00:32:32.387 00:32:32.387 ' 00:32:32.387 17:08:17 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:32.387 17:08:17 -- nvmf/common.sh@7 -- # uname -s 00:32:32.387 17:08:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:32.387 17:08:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:32.387 17:08:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:32.387 17:08:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:32.387 17:08:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:32.387 17:08:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:32.387 17:08:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:32.387 17:08:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:32.387 17:08:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:32.387 17:08:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:32.387 17:08:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:32.387 17:08:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:32.387 17:08:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:32.387 17:08:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:32.387 17:08:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:32.387 17:08:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:32.387 17:08:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:32.387 17:08:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:32.387 17:08:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:32.387 17:08:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:32.387 17:08:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:32.387 17:08:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:32.387 17:08:17 -- paths/export.sh@5 -- # export PATH 00:32:32.387 17:08:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:32.387 17:08:17 -- nvmf/common.sh@46 -- # : 0 00:32:32.387 17:08:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:32.387 17:08:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:32.387 17:08:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:32.387 17:08:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:32.387 17:08:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:32.387 17:08:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:32.387 17:08:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:32.387 17:08:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:32.387 17:08:17 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:32.387 17:08:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:32.387 17:08:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:32.387 17:08:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:32.387 17:08:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:32.387 17:08:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:32.387 17:08:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:32.387 17:08:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:32.387 17:08:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:32.387 17:08:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:32.387 17:08:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:32.387 17:08:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:32.387 17:08:17 -- common/autotest_common.sh@10 -- # set +x 00:32:34.289 17:08:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:34.289 17:08:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:34.289 17:08:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:34.289 17:08:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:34.289 17:08:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:34.289 17:08:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:34.289 17:08:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:34.289 17:08:19 -- nvmf/common.sh@294 -- # net_devs=() 00:32:34.289 17:08:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:34.289 17:08:19 -- nvmf/common.sh@295 -- # e810=() 00:32:34.289 17:08:19 -- nvmf/common.sh@295 -- # local -ga e810 00:32:34.289 17:08:19 -- nvmf/common.sh@296 -- # x722=() 00:32:34.289 17:08:19 -- nvmf/common.sh@296 -- # local -ga x722 00:32:34.289 17:08:19 -- nvmf/common.sh@297 -- # mlx=() 00:32:34.289 17:08:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:34.289 17:08:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:34.289 17:08:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:34.289 17:08:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:34.289 17:08:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:34.289 17:08:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:34.289 17:08:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:34.289 17:08:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:34.289 17:08:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:34.289 17:08:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:34.289 17:08:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:34.289 17:08:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:34.289 17:08:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:34.289 17:08:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:34.289 17:08:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:34.289 17:08:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:34.289 17:08:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:34.289 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:34.289 17:08:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:34.289 17:08:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:34.289 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:34.289 17:08:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:34.289 17:08:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:34.289 17:08:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:34.289 17:08:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:34.289 17:08:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:34.289 17:08:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:34.289 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:34.289 17:08:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:34.289 17:08:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:34.289 17:08:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:34.289 17:08:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:34.289 17:08:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:34.289 17:08:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:34.289 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:34.289 17:08:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:34.289 17:08:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:34.289 17:08:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:34.289 17:08:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:34.289 17:08:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:34.289 17:08:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:34.289 17:08:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:34.289 17:08:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:34.289 17:08:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:34.289 17:08:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:34.289 17:08:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:34.289 17:08:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:34.289 17:08:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:34.289 17:08:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:34.289 17:08:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:34.289 17:08:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:34.289 17:08:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:34.290 17:08:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:34.290 17:08:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:34.290 17:08:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:34.290 17:08:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:34.290 17:08:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:34.290 17:08:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:34.290 17:08:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:34.290 17:08:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:34.290 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:34.290 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.252 ms 00:32:34.290 00:32:34.290 --- 10.0.0.2 ping statistics --- 00:32:34.290 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:34.290 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:32:34.290 17:08:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:34.290 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:34.290 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:32:34.290 00:32:34.290 --- 10.0.0.1 ping statistics --- 00:32:34.290 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:34.290 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:32:34.290 17:08:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:34.290 17:08:19 -- nvmf/common.sh@410 -- # return 0 00:32:34.290 17:08:19 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:34.290 17:08:19 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:35.665 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:35.665 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:35.665 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:35.665 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:35.665 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:35.665 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:35.665 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:35.665 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:35.665 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:35.665 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:35.665 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:35.665 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:35.665 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:35.665 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:35.665 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:35.665 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:36.603 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:36.603 17:08:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:36.603 17:08:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:36.603 17:08:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:36.603 17:08:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:36.603 17:08:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:36.603 17:08:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:36.603 17:08:22 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:36.603 17:08:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:36.603 17:08:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:36.603 17:08:22 -- common/autotest_common.sh@10 -- # set +x 00:32:36.603 17:08:22 -- nvmf/common.sh@469 -- # nvmfpid=1352507 00:32:36.603 17:08:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:36.603 17:08:22 -- nvmf/common.sh@470 -- # waitforlisten 1352507 00:32:36.603 17:08:22 -- common/autotest_common.sh@829 -- # '[' -z 1352507 ']' 00:32:36.603 17:08:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:36.603 17:08:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:36.603 17:08:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:36.603 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:36.603 17:08:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:36.603 17:08:22 -- common/autotest_common.sh@10 -- # set +x 00:32:36.603 [2024-11-16 17:08:22.337280] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:32:36.603 [2024-11-16 17:08:22.337367] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:36.861 EAL: No free 2048 kB hugepages reported on node 1 00:32:36.861 [2024-11-16 17:08:22.408478] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:36.861 [2024-11-16 17:08:22.502300] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:36.862 [2024-11-16 17:08:22.502444] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:36.862 [2024-11-16 17:08:22.502462] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:36.862 [2024-11-16 17:08:22.502476] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:36.862 [2024-11-16 17:08:22.502534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:36.862 [2024-11-16 17:08:22.502559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:36.862 [2024-11-16 17:08:22.502632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:36.862 [2024-11-16 17:08:22.502636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:37.795 17:08:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:37.795 17:08:23 -- common/autotest_common.sh@862 -- # return 0 00:32:37.795 17:08:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:37.795 17:08:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:37.795 17:08:23 -- common/autotest_common.sh@10 -- # set +x 00:32:37.795 17:08:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:37.795 17:08:23 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:37.795 17:08:23 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:37.795 17:08:23 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:37.795 17:08:23 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:37.795 17:08:23 -- scripts/common.sh@312 -- # local nvmes 00:32:37.795 17:08:23 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:37.795 17:08:23 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:37.795 17:08:23 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:37.795 17:08:23 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:37.795 17:08:23 -- scripts/common.sh@322 -- # uname -s 00:32:37.795 17:08:23 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:37.795 17:08:23 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:37.795 17:08:23 -- scripts/common.sh@327 -- # (( 1 )) 00:32:37.795 17:08:23 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:37.795 17:08:23 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:37.795 17:08:23 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:37.795 17:08:23 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:37.795 17:08:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:37.795 17:08:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:37.795 17:08:23 -- common/autotest_common.sh@10 -- # set +x 00:32:37.795 ************************************ 00:32:37.795 START TEST spdk_target_abort 00:32:37.795 ************************************ 00:32:37.795 17:08:23 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:37.795 17:08:23 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:37.795 17:08:23 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:37.795 17:08:23 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:37.795 17:08:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:37.795 17:08:23 -- common/autotest_common.sh@10 -- # set +x 00:32:41.075 spdk_targetn1 00:32:41.075 17:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:41.075 17:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:41.075 17:08:26 -- common/autotest_common.sh@10 -- # set +x 00:32:41.075 [2024-11-16 17:08:26.197385] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:41.075 17:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:41.075 17:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:41.075 17:08:26 -- common/autotest_common.sh@10 -- # set +x 00:32:41.075 17:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:41.075 17:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:41.075 17:08:26 -- common/autotest_common.sh@10 -- # set +x 00:32:41.075 17:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:41.075 17:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:41.075 17:08:26 -- common/autotest_common.sh@10 -- # set +x 00:32:41.075 [2024-11-16 17:08:26.229693] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:41.075 17:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:41.075 17:08:26 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:41.075 EAL: No free 2048 kB hugepages reported on node 1 00:32:44.355 Initializing NVMe Controllers 00:32:44.355 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:44.355 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:44.355 Initialization complete. Launching workers. 00:32:44.355 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 13453, failed: 0 00:32:44.355 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1185, failed to submit 12268 00:32:44.355 success 795, unsuccess 390, failed 0 00:32:44.355 17:08:29 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:44.355 17:08:29 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:44.355 EAL: No free 2048 kB hugepages reported on node 1 00:32:47.636 Initializing NVMe Controllers 00:32:47.636 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:47.636 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:47.636 Initialization complete. Launching workers. 00:32:47.636 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8673, failed: 0 00:32:47.636 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1230, failed to submit 7443 00:32:47.636 success 336, unsuccess 894, failed 0 00:32:47.636 17:08:32 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:47.636 17:08:32 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:47.636 EAL: No free 2048 kB hugepages reported on node 1 00:32:50.913 Initializing NVMe Controllers 00:32:50.913 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:50.913 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:50.913 Initialization complete. Launching workers. 00:32:50.913 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32068, failed: 0 00:32:50.913 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2806, failed to submit 29262 00:32:50.913 success 576, unsuccess 2230, failed 0 00:32:50.913 17:08:36 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:50.913 17:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:50.913 17:08:36 -- common/autotest_common.sh@10 -- # set +x 00:32:50.913 17:08:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:50.913 17:08:36 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:50.913 17:08:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:50.913 17:08:36 -- common/autotest_common.sh@10 -- # set +x 00:32:51.846 17:08:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:51.846 17:08:37 -- target/abort_qd_sizes.sh@62 -- # killprocess 1352507 00:32:51.846 17:08:37 -- common/autotest_common.sh@936 -- # '[' -z 1352507 ']' 00:32:51.846 17:08:37 -- common/autotest_common.sh@940 -- # kill -0 1352507 00:32:51.846 17:08:37 -- common/autotest_common.sh@941 -- # uname 00:32:51.846 17:08:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:51.846 17:08:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1352507 00:32:51.846 17:08:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:51.846 17:08:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:51.846 17:08:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1352507' 00:32:51.846 killing process with pid 1352507 00:32:51.846 17:08:37 -- common/autotest_common.sh@955 -- # kill 1352507 00:32:51.846 17:08:37 -- common/autotest_common.sh@960 -- # wait 1352507 00:32:52.104 00:32:52.104 real 0m14.251s 00:32:52.104 user 0m56.413s 00:32:52.104 sys 0m2.647s 00:32:52.104 17:08:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:52.104 17:08:37 -- common/autotest_common.sh@10 -- # set +x 00:32:52.104 ************************************ 00:32:52.104 END TEST spdk_target_abort 00:32:52.104 ************************************ 00:32:52.104 17:08:37 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:52.104 17:08:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:52.104 17:08:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:52.104 17:08:37 -- common/autotest_common.sh@10 -- # set +x 00:32:52.104 ************************************ 00:32:52.104 START TEST kernel_target_abort 00:32:52.104 ************************************ 00:32:52.104 17:08:37 -- common/autotest_common.sh@1114 -- # kernel_target 00:32:52.104 17:08:37 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:52.104 17:08:37 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:52.104 17:08:37 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:52.104 17:08:37 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:52.104 17:08:37 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:52.104 17:08:37 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:52.104 17:08:37 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:52.104 17:08:37 -- nvmf/common.sh@627 -- # local block nvme 00:32:52.104 17:08:37 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:52.104 17:08:37 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:52.104 17:08:37 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:52.104 17:08:37 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:53.040 Waiting for block devices as requested 00:32:53.299 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:53.299 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:53.557 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:53.557 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:53.557 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:53.815 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:53.815 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:53.815 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:53.815 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:53.815 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:54.073 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:54.073 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:54.073 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:54.332 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:54.332 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:54.332 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:54.332 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:54.591 17:08:40 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:54.591 17:08:40 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:54.591 17:08:40 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:54.591 17:08:40 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:54.591 17:08:40 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:54.591 No valid GPT data, bailing 00:32:54.591 17:08:40 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:54.591 17:08:40 -- scripts/common.sh@393 -- # pt= 00:32:54.591 17:08:40 -- scripts/common.sh@394 -- # return 1 00:32:54.591 17:08:40 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:54.591 17:08:40 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:54.591 17:08:40 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:54.591 17:08:40 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:54.591 17:08:40 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:54.591 17:08:40 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:54.591 17:08:40 -- nvmf/common.sh@654 -- # echo 1 00:32:54.591 17:08:40 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:54.591 17:08:40 -- nvmf/common.sh@656 -- # echo 1 00:32:54.591 17:08:40 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:54.591 17:08:40 -- nvmf/common.sh@663 -- # echo tcp 00:32:54.591 17:08:40 -- nvmf/common.sh@664 -- # echo 4420 00:32:54.591 17:08:40 -- nvmf/common.sh@665 -- # echo ipv4 00:32:54.591 17:08:40 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:54.591 17:08:40 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:32:54.856 00:32:54.856 Discovery Log Number of Records 2, Generation counter 2 00:32:54.856 =====Discovery Log Entry 0====== 00:32:54.856 trtype: tcp 00:32:54.856 adrfam: ipv4 00:32:54.856 subtype: current discovery subsystem 00:32:54.856 treq: not specified, sq flow control disable supported 00:32:54.856 portid: 1 00:32:54.856 trsvcid: 4420 00:32:54.856 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:54.856 traddr: 10.0.0.1 00:32:54.856 eflags: none 00:32:54.856 sectype: none 00:32:54.856 =====Discovery Log Entry 1====== 00:32:54.856 trtype: tcp 00:32:54.856 adrfam: ipv4 00:32:54.856 subtype: nvme subsystem 00:32:54.856 treq: not specified, sq flow control disable supported 00:32:54.856 portid: 1 00:32:54.856 trsvcid: 4420 00:32:54.856 subnqn: kernel_target 00:32:54.856 traddr: 10.0.0.1 00:32:54.856 eflags: none 00:32:54.856 sectype: none 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:54.856 17:08:40 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:54.856 EAL: No free 2048 kB hugepages reported on node 1 00:32:58.139 Initializing NVMe Controllers 00:32:58.139 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:58.139 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:58.139 Initialization complete. Launching workers. 00:32:58.139 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 46380, failed: 0 00:32:58.139 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 46380, failed to submit 0 00:32:58.139 success 0, unsuccess 46380, failed 0 00:32:58.139 17:08:43 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:58.139 17:08:43 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:58.139 EAL: No free 2048 kB hugepages reported on node 1 00:33:01.420 Initializing NVMe Controllers 00:33:01.420 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:01.421 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:01.421 Initialization complete. Launching workers. 00:33:01.421 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 83493, failed: 0 00:33:01.421 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 21034, failed to submit 62459 00:33:01.421 success 0, unsuccess 21034, failed 0 00:33:01.421 17:08:46 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:01.421 17:08:46 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:01.421 EAL: No free 2048 kB hugepages reported on node 1 00:33:03.948 Initializing NVMe Controllers 00:33:03.949 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:03.949 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:03.949 Initialization complete. Launching workers. 00:33:03.949 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 85565, failed: 0 00:33:03.949 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 21398, failed to submit 64167 00:33:03.949 success 0, unsuccess 21398, failed 0 00:33:03.949 17:08:49 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:33:03.949 17:08:49 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:33:03.949 17:08:49 -- nvmf/common.sh@677 -- # echo 0 00:33:03.949 17:08:49 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:33:03.949 17:08:49 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:03.949 17:08:49 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:33:03.949 17:08:49 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:03.949 17:08:49 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:33:03.949 17:08:49 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:33:04.207 00:33:04.207 real 0m12.080s 00:33:04.207 user 0m5.983s 00:33:04.207 sys 0m2.407s 00:33:04.207 17:08:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:04.207 17:08:49 -- common/autotest_common.sh@10 -- # set +x 00:33:04.207 ************************************ 00:33:04.207 END TEST kernel_target_abort 00:33:04.207 ************************************ 00:33:04.207 17:08:49 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:33:04.207 17:08:49 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:33:04.207 17:08:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:33:04.207 17:08:49 -- nvmf/common.sh@116 -- # sync 00:33:04.207 17:08:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:33:04.207 17:08:49 -- nvmf/common.sh@119 -- # set +e 00:33:04.207 17:08:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:33:04.207 17:08:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:33:04.207 rmmod nvme_tcp 00:33:04.207 rmmod nvme_fabrics 00:33:04.207 rmmod nvme_keyring 00:33:04.207 17:08:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:33:04.207 17:08:49 -- nvmf/common.sh@123 -- # set -e 00:33:04.207 17:08:49 -- nvmf/common.sh@124 -- # return 0 00:33:04.207 17:08:49 -- nvmf/common.sh@477 -- # '[' -n 1352507 ']' 00:33:04.207 17:08:49 -- nvmf/common.sh@478 -- # killprocess 1352507 00:33:04.207 17:08:49 -- common/autotest_common.sh@936 -- # '[' -z 1352507 ']' 00:33:04.207 17:08:49 -- common/autotest_common.sh@940 -- # kill -0 1352507 00:33:04.207 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1352507) - No such process 00:33:04.207 17:08:49 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1352507 is not found' 00:33:04.207 Process with pid 1352507 is not found 00:33:04.207 17:08:49 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:33:04.207 17:08:49 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:05.582 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:05.582 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:05.582 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:05.582 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:05.582 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:05.582 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:05.582 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:05.582 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:05.582 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:05.582 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:05.582 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:05.582 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:05.582 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:05.582 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:05.582 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:05.582 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:05.582 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:05.582 17:08:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:33:05.582 17:08:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:33:05.582 17:08:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:33:05.582 17:08:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:33:05.582 17:08:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:05.582 17:08:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:05.582 17:08:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:08.115 17:08:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:08.115 00:33:08.115 real 0m35.730s 00:33:08.115 user 1m4.867s 00:33:08.115 sys 0m8.585s 00:33:08.115 17:08:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:08.115 17:08:53 -- common/autotest_common.sh@10 -- # set +x 00:33:08.115 ************************************ 00:33:08.115 END TEST nvmf_abort_qd_sizes 00:33:08.115 ************************************ 00:33:08.115 17:08:53 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:33:08.115 17:08:53 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:33:08.116 17:08:53 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:33:08.116 17:08:53 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:33:08.116 17:08:53 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:33:08.116 17:08:53 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:33:08.116 17:08:53 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:33:08.116 17:08:53 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:33:08.116 17:08:53 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:33:08.116 17:08:53 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:33:08.116 17:08:53 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:33:08.116 17:08:53 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:33:08.116 17:08:53 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:33:08.116 17:08:53 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:33:08.116 17:08:53 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:33:08.116 17:08:53 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:33:08.116 17:08:53 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:33:08.116 17:08:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:33:08.116 17:08:53 -- common/autotest_common.sh@10 -- # set +x 00:33:08.116 17:08:53 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:33:08.116 17:08:53 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:33:08.116 17:08:53 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:33:08.116 17:08:53 -- common/autotest_common.sh@10 -- # set +x 00:33:09.493 INFO: APP EXITING 00:33:09.493 INFO: killing all VMs 00:33:09.493 INFO: killing vhost app 00:33:09.493 INFO: EXIT DONE 00:33:10.869 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:10.869 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:10.869 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:10.869 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:10.869 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:10.869 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:10.869 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:10.869 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:10.869 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:10.869 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:10.869 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:10.869 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:11.128 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:11.128 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:11.128 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:11.128 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:11.128 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:12.506 Cleaning 00:33:12.506 Removing: /var/run/dpdk/spdk0/config 00:33:12.506 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:33:12.506 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:33:12.506 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:33:12.506 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:33:12.506 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:33:12.506 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:33:12.506 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:33:12.506 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:33:12.506 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:33:12.506 Removing: /var/run/dpdk/spdk0/hugepage_info 00:33:12.506 Removing: /var/run/dpdk/spdk1/config 00:33:12.506 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:33:12.506 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:33:12.506 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:33:12.506 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:33:12.506 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:33:12.506 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:33:12.506 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:33:12.506 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:33:12.506 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:33:12.506 Removing: /var/run/dpdk/spdk1/hugepage_info 00:33:12.506 Removing: /var/run/dpdk/spdk1/mp_socket 00:33:12.506 Removing: /var/run/dpdk/spdk2/config 00:33:12.506 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:33:12.506 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:33:12.506 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:33:12.506 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:33:12.506 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:33:12.506 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:33:12.506 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:33:12.506 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:33:12.506 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:33:12.506 Removing: /var/run/dpdk/spdk2/hugepage_info 00:33:12.506 Removing: /var/run/dpdk/spdk3/config 00:33:12.506 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:33:12.506 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:33:12.506 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:33:12.506 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:33:12.507 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:33:12.507 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:33:12.507 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:33:12.507 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:33:12.507 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:33:12.507 Removing: /var/run/dpdk/spdk3/hugepage_info 00:33:12.507 Removing: /var/run/dpdk/spdk4/config 00:33:12.507 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:33:12.507 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:33:12.507 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:33:12.507 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:33:12.507 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:33:12.507 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:33:12.507 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:33:12.507 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:33:12.507 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:33:12.507 Removing: /var/run/dpdk/spdk4/hugepage_info 00:33:12.507 Removing: /dev/shm/bdev_svc_trace.1 00:33:12.507 Removing: /dev/shm/nvmf_trace.0 00:33:12.507 Removing: /dev/shm/spdk_tgt_trace.pid1073257 00:33:12.507 Removing: /var/run/dpdk/spdk0 00:33:12.507 Removing: /var/run/dpdk/spdk1 00:33:12.507 Removing: /var/run/dpdk/spdk2 00:33:12.507 Removing: /var/run/dpdk/spdk3 00:33:12.507 Removing: /var/run/dpdk/spdk4 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1071540 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1072307 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1073257 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1073760 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1075102 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1076053 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1076253 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1076578 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1076924 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1077129 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1077286 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1077445 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1077768 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1078230 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1081284 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1081565 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1081859 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1081881 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1082312 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1082452 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1082782 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1082922 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1083108 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1083230 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1083435 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1083538 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1084047 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1084202 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1084410 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1084647 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1084734 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1084789 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1085038 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1085217 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1085355 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1085516 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1085726 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1085935 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1086082 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1086235 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1086429 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1086661 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1086803 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1086965 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1087125 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1087390 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1087534 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1087687 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1087833 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1088107 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1088261 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1088414 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1088554 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1088832 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1088979 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1089141 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1089279 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1089553 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1089702 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1089862 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1090006 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1090280 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1090422 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1090589 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1090730 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1091013 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1091156 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1091322 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1091471 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1091744 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1091890 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1092054 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1092246 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1092457 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1094683 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1151745 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1154405 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1161515 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1164873 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1167259 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1167798 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1172316 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1172321 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1172995 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1173670 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1174295 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1174681 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1174764 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1174906 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1175048 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1175050 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1175733 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1176319 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1176962 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1177372 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1177384 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1177646 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1178700 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1179580 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1185159 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1185368 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1188056 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1191949 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1194189 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1201445 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1206976 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1208206 00:33:12.507 Removing: /var/run/dpdk/spdk_pid1208900 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1219654 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1221774 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1224690 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1225836 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1227318 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1227475 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1227749 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1227894 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1228493 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1229860 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1230875 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1231330 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1235476 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1239030 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1242732 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1267173 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1269951 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1273789 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1274880 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1276039 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1278719 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1281250 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1285699 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1285778 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1288600 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1288861 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1289001 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1289271 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1289283 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1290394 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1291746 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1292959 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1294176 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1295428 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1297232 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1301119 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1301586 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1302905 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1303662 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1307453 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1309617 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1313237 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1316872 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1320543 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1320966 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1321508 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1321929 00:33:12.765 Removing: /var/run/dpdk/spdk_pid1322524 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1323021 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1323506 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1324057 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1326736 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1327033 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1331474 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1331663 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1333308 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1338463 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1338468 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1341427 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1342867 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1344316 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1345199 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1346530 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1347423 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1352949 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1353353 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1353759 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1355353 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1355645 00:33:12.766 Removing: /var/run/dpdk/spdk_pid1356054 00:33:12.766 Clean 00:33:12.766 killing process with pid 1043565 00:33:22.745 killing process with pid 1043562 00:33:22.745 killing process with pid 1043564 00:33:22.745 killing process with pid 1043563 00:33:22.745 17:09:07 -- common/autotest_common.sh@1446 -- # return 0 00:33:22.745 17:09:07 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:33:22.745 17:09:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:22.745 17:09:07 -- common/autotest_common.sh@10 -- # set +x 00:33:22.745 17:09:07 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:33:22.745 17:09:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:22.746 17:09:07 -- common/autotest_common.sh@10 -- # set +x 00:33:22.746 17:09:07 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:22.746 17:09:07 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:22.746 17:09:07 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:22.746 17:09:07 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:33:22.746 17:09:07 -- spdk/autotest.sh@383 -- # hostname 00:33:22.746 17:09:07 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:22.746 geninfo: WARNING: invalid characters removed from testname! 00:33:49.300 17:09:34 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:53.484 17:09:38 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:55.380 17:09:41 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:58.788 17:09:43 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:01.316 17:09:46 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:03.845 17:09:49 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:06.429 17:09:51 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:06.429 17:09:51 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:34:06.429 17:09:51 -- common/autotest_common.sh@1690 -- $ lcov --version 00:34:06.429 17:09:51 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:34:06.429 17:09:52 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:34:06.429 17:09:52 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:34:06.429 17:09:52 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:34:06.429 17:09:52 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:34:06.429 17:09:52 -- scripts/common.sh@335 -- $ IFS=.-: 00:34:06.429 17:09:52 -- scripts/common.sh@335 -- $ read -ra ver1 00:34:06.429 17:09:52 -- scripts/common.sh@336 -- $ IFS=.-: 00:34:06.429 17:09:52 -- scripts/common.sh@336 -- $ read -ra ver2 00:34:06.429 17:09:52 -- scripts/common.sh@337 -- $ local 'op=<' 00:34:06.429 17:09:52 -- scripts/common.sh@339 -- $ ver1_l=2 00:34:06.429 17:09:52 -- scripts/common.sh@340 -- $ ver2_l=1 00:34:06.429 17:09:52 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:34:06.429 17:09:52 -- scripts/common.sh@343 -- $ case "$op" in 00:34:06.429 17:09:52 -- scripts/common.sh@344 -- $ : 1 00:34:06.429 17:09:52 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:34:06.429 17:09:52 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:34:06.429 17:09:52 -- scripts/common.sh@364 -- $ decimal 1 00:34:06.429 17:09:52 -- scripts/common.sh@352 -- $ local d=1 00:34:06.429 17:09:52 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:34:06.429 17:09:52 -- scripts/common.sh@354 -- $ echo 1 00:34:06.429 17:09:52 -- scripts/common.sh@364 -- $ ver1[v]=1 00:34:06.429 17:09:52 -- scripts/common.sh@365 -- $ decimal 2 00:34:06.429 17:09:52 -- scripts/common.sh@352 -- $ local d=2 00:34:06.429 17:09:52 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:34:06.429 17:09:52 -- scripts/common.sh@354 -- $ echo 2 00:34:06.429 17:09:52 -- scripts/common.sh@365 -- $ ver2[v]=2 00:34:06.429 17:09:52 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:34:06.429 17:09:52 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:34:06.429 17:09:52 -- scripts/common.sh@367 -- $ return 0 00:34:06.429 17:09:52 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:34:06.429 17:09:52 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:34:06.429 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:06.429 --rc genhtml_branch_coverage=1 00:34:06.429 --rc genhtml_function_coverage=1 00:34:06.429 --rc genhtml_legend=1 00:34:06.429 --rc geninfo_all_blocks=1 00:34:06.429 --rc geninfo_unexecuted_blocks=1 00:34:06.429 00:34:06.429 ' 00:34:06.429 17:09:52 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:34:06.429 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:06.429 --rc genhtml_branch_coverage=1 00:34:06.429 --rc genhtml_function_coverage=1 00:34:06.429 --rc genhtml_legend=1 00:34:06.429 --rc geninfo_all_blocks=1 00:34:06.429 --rc geninfo_unexecuted_blocks=1 00:34:06.429 00:34:06.429 ' 00:34:06.429 17:09:52 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:34:06.429 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:06.429 --rc genhtml_branch_coverage=1 00:34:06.429 --rc genhtml_function_coverage=1 00:34:06.429 --rc genhtml_legend=1 00:34:06.429 --rc geninfo_all_blocks=1 00:34:06.429 --rc geninfo_unexecuted_blocks=1 00:34:06.429 00:34:06.429 ' 00:34:06.429 17:09:52 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:34:06.429 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:06.429 --rc genhtml_branch_coverage=1 00:34:06.429 --rc genhtml_function_coverage=1 00:34:06.429 --rc genhtml_legend=1 00:34:06.429 --rc geninfo_all_blocks=1 00:34:06.429 --rc geninfo_unexecuted_blocks=1 00:34:06.429 00:34:06.429 ' 00:34:06.429 17:09:52 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:34:06.429 17:09:52 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:06.429 17:09:52 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:06.429 17:09:52 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:06.429 17:09:52 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:06.429 17:09:52 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:06.429 17:09:52 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:06.429 17:09:52 -- paths/export.sh@5 -- $ export PATH 00:34:06.429 17:09:52 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:06.429 17:09:52 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:34:06.429 17:09:52 -- common/autobuild_common.sh@440 -- $ date +%s 00:34:06.429 17:09:52 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1731773392.XXXXXX 00:34:06.429 17:09:52 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1731773392.lgvmbp 00:34:06.429 17:09:52 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:34:06.429 17:09:52 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:34:06.429 17:09:52 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:34:06.429 17:09:52 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:34:06.429 17:09:52 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:06.429 17:09:52 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:06.429 17:09:52 -- common/autobuild_common.sh@456 -- $ get_config_params 00:34:06.429 17:09:52 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:34:06.429 17:09:52 -- common/autotest_common.sh@10 -- $ set +x 00:34:06.429 17:09:52 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:34:06.429 17:09:52 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:34:06.429 17:09:52 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:06.429 17:09:52 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:06.429 17:09:52 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:06.429 17:09:52 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:06.429 17:09:52 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:06.429 17:09:52 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:06.429 17:09:52 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:06.429 17:09:52 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:06.429 17:09:52 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:06.429 + [[ -n 988771 ]] 00:34:06.429 + sudo kill 988771 00:34:06.440 [Pipeline] } 00:34:06.454 [Pipeline] // stage 00:34:06.459 [Pipeline] } 00:34:06.473 [Pipeline] // timeout 00:34:06.478 [Pipeline] } 00:34:06.492 [Pipeline] // catchError 00:34:06.497 [Pipeline] } 00:34:06.512 [Pipeline] // wrap 00:34:06.519 [Pipeline] } 00:34:06.531 [Pipeline] // catchError 00:34:06.540 [Pipeline] stage 00:34:06.542 [Pipeline] { (Epilogue) 00:34:06.555 [Pipeline] catchError 00:34:06.556 [Pipeline] { 00:34:06.569 [Pipeline] echo 00:34:06.571 Cleanup processes 00:34:06.576 [Pipeline] sh 00:34:06.864 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:06.864 1369085 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:06.878 [Pipeline] sh 00:34:07.165 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:07.165 ++ grep -v 'sudo pgrep' 00:34:07.165 ++ awk '{print $1}' 00:34:07.165 + sudo kill -9 00:34:07.165 + true 00:34:07.178 [Pipeline] sh 00:34:07.464 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:19.679 [Pipeline] sh 00:34:19.971 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:19.972 Artifacts sizes are good 00:34:19.989 [Pipeline] archiveArtifacts 00:34:19.997 Archiving artifacts 00:34:20.200 [Pipeline] sh 00:34:20.514 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:34:20.528 [Pipeline] cleanWs 00:34:20.539 [WS-CLEANUP] Deleting project workspace... 00:34:20.539 [WS-CLEANUP] Deferred wipeout is used... 00:34:20.547 [WS-CLEANUP] done 00:34:20.549 [Pipeline] } 00:34:20.566 [Pipeline] // catchError 00:34:20.579 [Pipeline] sh 00:34:20.875 + logger -p user.info -t JENKINS-CI 00:34:20.883 [Pipeline] } 00:34:20.896 [Pipeline] // stage 00:34:20.902 [Pipeline] } 00:34:20.916 [Pipeline] // node 00:34:20.922 [Pipeline] End of Pipeline 00:34:20.967 Finished: SUCCESS